00000800:00000200:3.1F:1746144484.709842:0:3304:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800a477b540] -> 12345-192.168.202.116@tcp (2) 00000800:00000200:3.1:1746144484.710112:0:3295:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800a477b540] -> 12345-192.168.202.116@tcp (2) 00000800:00000200:3.1:1746144484.710115:0:3295:0:(socklnd.c:186:ksocknal_destroy_peer()) peer_ni 12345-192.168.202.116@tcp ffff8800a477b9c0 deleted 00000800:00000010:3.1:1746144484.710117:0:3295:0:(socklnd.c:195:ksocknal_destroy_peer()) kfreed 'peer_ni': 184 at ffff8800a477b9c0. 00000800:00000200:3.1:1746144484.710119:0:3295:0:(socklnd.c:395:ksocknal_incr_conn_count()) Add conn type 1, ksnr_connected 2 ksnr_max_conns 1 00000800:00000200:3.1:1746144484.710124:0:3295:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.202.116@tcp ip 192.168.202.116:1023 00000800:00000200:3.1:1746144484.710127:0:3295:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet ffff8800a4778400 type 2, nob 96 niov 1 nkiov 0 00000800:00000200:3.1:1746144484.710217:0:3294:0:(socklnd.c:395:ksocknal_incr_conn_count()) Add conn type 1, ksnr_connected 2 ksnr_max_conns 1 00000800:00000200:3.1:1746144484.710466:0:3296:0:(socklnd.c:225:ksocknal_find_peer_locked()) got peer_ni [ffff8800a477b540] -> 12345-192.168.202.116@tcp (4) 00000800:00000200:3.1:1746144484.710468:0:3296:0:(socklnd.c:186:ksocknal_destroy_peer()) peer_ni 12345-192.168.202.116@tcp ffff8800a477b9c0 deleted 00000800:00000010:3.1:1746144484.710469:0:3296:0:(socklnd.c:195:ksocknal_destroy_peer()) kfreed 'peer_ni': 184 at ffff8800a477b9c0. 00000800:00000200:3.1:1746144484.710471:0:3296:0:(socklnd.c:395:ksocknal_incr_conn_count()) Add conn type 3, ksnr_connected a ksnr_max_conns 1 00000800:00000200:3.1:1746144484.710514:0:3294:0:(socklnd.c:395:ksocknal_incr_conn_count()) Add conn type 2, ksnr_connected e ksnr_max_conns 1 00010000:00000010:2.1F:1746144484.826810:0:11:0:(ldlm_resource.c:1331:__ldlm_resource_free()) slab-freed '(res)': 248 at ffff8800a86dd700. 00010000:00000010:2.1:1746144484.826827:0:11:0:(ldlm_lock.c:176:lock_handle_free()) slab-freed 'lock': 512 at ffff88009bf28000. 00010000:00000010:1.1F:1746144485.191883:0:20:0:(ldlm_resource.c:1331:__ldlm_resource_free()) slab-freed '(res)': 248 at ffff8800a4a75200. 00010000:00000010:3.1:1746144485.191898:0:11:0:(ldlm_lock.c:176:lock_handle_free()) slab-freed 'lock': 512 at ffff880136a81a00. 00010000:00000010:1.1:1746144485.191904:0:20:0:(ldlm_lock.c:176:lock_handle_free()) slab-freed 'lock': 512 at ffff88012dbbc800. 00010000:00000010:0.1F:1746144485.195419:0:27:0:(ldlm_resource.c:1331:__ldlm_resource_free()) slab-freed '(res)': 248 at ffff8800a86ddc00. 00010000:00000010:0.1:1746144485.195432:0:27:0:(ldlm_lock.c:176:lock_handle_free()) slab-freed 'lock': 512 at ffff88012dbbcc00. 00000100:00100000:0.0:1746144843.308392:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1982:x1830965173620480:12345-192.168.202.16@tcp:4:dd.0 Request processed in 56587us (56754us total) trans 4294967780 rc 0/0 00000100:00100000:0.0:1746144843.308412:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2315 00000100:00100000:0.0:1746144843.312069:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144843.359371:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00002000:00010000:0.0:1746144843.463879:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb size from disk: 40894464 -> 41943040 00002000:00010000:0.0:1746144843.463884:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb blocks from disk: 79885 -> 81933 00010000:00010000:0.0:1746144843.463894:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ff1800/0x4076af67275106c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.463904:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ff1800/0x4076af67275106c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.464135:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4ff1800/0x4076af67275106c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.464141:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ff1800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144843.464145:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4ff1800/0x4076af67275106c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.464151:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4ff1800/0x4076af67275106c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.464166:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4ff1800/0x4076af67275106c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.464172:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ff1800/0x4076af67275106c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [40894464->41943039] (req 40894464->41943039) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144843.464337:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1982:x1830965173621248:12345-192.168.202.16@tcp:4:dd.0 Request processed in 60198us (61065us total) trans 4294967783 rc 0/0 00000100:00100000:0.0:1746144843.464346:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2318 00000100:00100000:0.0:1746144843.468353:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173621504 00000100:00100000:0.0:1746144843.468361:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173621504 00000100:00100000:0.0:1746144843.468419:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2319 00000100:00100000:0.0:1746144843.468427:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1982:x1830965173621504:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144843.468464:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 41943040, mtime: 0x68140e4b, atime: 0x0, ctime: 0x68140e4b, blocks: 0x1400d 00010000:00010000:0.0:1746144843.468470:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800916fb000/0x4076af67275106c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.468481:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144843.468483:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144843.468486:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800916fb000/0x4076af67275106c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.468497:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800916fb000/0x4076af67275106c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [41943040->42991615] (req 41943040->42991615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144843.470279:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093443800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965171839488:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1746144843.470301:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144843.470321:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965171839488 00000100:00100000:0.0:1746144843.470323:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965171839488 00000100:00100000:0.0:1746144843.470346:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2997 00000100:00100000:0.0:1746144843.470351:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1830965171839488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1746144843.470367:0:8432:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:22 count 1 00010000:00010000:0.0:1746144843.470384:0:8432:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800916fbe00/0x4076af67275106d0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.470397:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5481c00/0x4076af672751023f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af904ec expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.470413:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144843.470414:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144843.470417:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800916fbe00/0x4076af67275106d0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.470435:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5481c00/0x4076af672751023f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af904ec expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.470445:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a5481c00/0x4076af672751023f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af904ec expref: 85 pid: 8430 timeout: 537 lvb_type: 0 00000100:00100000:0.0:1746144843.470454:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093442d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965171839616:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144843.470490:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144843.475228:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173621760 00000100:00100000:0.0:1746144843.475692:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173621760 00010000:00010000:0.0:1746144843.475714:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009170be00/0x4076af6727510246 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af904f3 expref: 6 pid: 8432 timeout: 537 lvb_type: 1 00000100:00100000:0.0:1746144843.475779:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8422 00000100:00100000:0.0:1746144843.475785:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965173621760:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144843.475793:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144843.475797:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009170be00/0x4076af6727510246 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af904f3 expref: 6 pid: 8432 timeout: 537 lvb_type: 1 00010000:00010000:0.0:1746144843.475805:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009170be00/0x4076af6727510246 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af904f3 expref: 6 pid: 8432 timeout: 537 lvb_type: 1 00010000:00010000:0.0:1746144843.475817:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009170be00/0x4076af6727510246 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af904f3 expref: 6 pid: 8432 timeout: 537 lvb_type: 1 00010000:00010000:0.0:1746144843.475826:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144843.475827:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144843.475829:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275106d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.475836:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275106d7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.475847:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144843.475862:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965173621760:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 78us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144843.475873:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8422 00002000:00010000:0.0:1746144843.662049:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb size from disk: 45088768 -> 46137344 00002000:00010000:0.0:1746144843.662053:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb ctime from disk: 1746144843 -> 1746144844 00002000:00010000:0.0:1746144843.662054:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb blocks from disk: 88077 -> 90127 00010000:00010000:0.0:1746144843.662064:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275106ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.662073:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275106ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.662085:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275106ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.662091:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5fc00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144843.662095:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275106ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.662102:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275106ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.662115:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275106ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144843.662120:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275106ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [45088768->46137343] (req 45088768->46137343) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144843.662236:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1982:x1830965173622528:12345-192.168.202.16@tcp:4:dd.0 Request processed in 42733us (42910us total) trans 4294967788 rc 0/0 00000100:00100000:0.0:1746144843.662245:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2322 00000100:00100000:0.0:1746144843.666878:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144843.725471:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144843.775900:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144843.825991:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144843.880138:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144843.973682:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144844.025195:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173624576 00000100:00100000:0.0:1746144844.025203:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173624576 00000100:00100000:0.0:1746144844.025249:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2330 00000100:00100000:0.0:1746144844.025256:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1982:x1830965173624576:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144844.025298:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 53477376, mtime: 0x68140e4c, atime: 0x0, ctime: 0x68140e4c, blocks: 0x1980f 00010000:00010000:0.0:1746144844.025309:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093937e00/0x4076af6727510724 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.025320:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144844.025322:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144844.025325:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093937e00/0x4076af6727510724 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.025337:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093937e00/0x4076af6727510724 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [53477376->54525951] (req 53477376->54525951) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746144844.113737:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967797 is committed 00000001:00080000:0.0:1746144844.165438:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967798 is committed 00000100:00100000:0.0:1746144844.171565:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173625344 00000100:00100000:0.0:1746144844.171573:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173625344 00000100:00100000:0.0:1746144844.171632:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2333 00000100:00100000:0.0:1746144844.171640:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1982:x1830965173625344:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144844.171680:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 56623104, mtime: 0x68140e4c, atime: 0x0, ctime: 0x68140e4c, blocks: 0x1b011 00010000:00010000:0.0:1746144844.171688:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727510739 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.171698:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144844.171700:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144844.171704:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727510739 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.171715:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727510739 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [56623104->57671679] (req 56623104->57671679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144844.227219:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173625600 00000100:00100000:0.0:1746144844.227227:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173625600 00000100:00100000:0.0:1746144844.227275:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2334 00000100:00100000:0.0:1746144844.227282:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1983:x1830965173625600:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144844.227321:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 57671680, mtime: 0x68140e4c, atime: 0x0, ctime: 0x68140e4c, blocks: 0x1b811 00010000:00010000:0.0:1746144844.227327:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009964c000/0x4076af6727510740 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.227339:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144844.227341:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144844.227345:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009964c000/0x4076af6727510740 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.227356:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009964c000/0x4076af6727510740 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [57671680->58720255] (req 57671680->58720255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144844.286191:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173625856 00000100:00100000:0.0:1746144844.286199:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173625856 00000100:00100000:0.0:1746144844.286248:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2335 00000100:00100000:0.0:1746144844.286254:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1982:x1830965173625856:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144844.286297:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 58720256, mtime: 0x68140e4c, atime: 0x0, ctime: 0x68140e4c, blocks: 0x1c011 00010000:00010000:0.0:1746144844.286304:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800929de200/0x4076af6727510747 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.286325:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144844.286326:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144844.286330:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800929de200/0x4076af6727510747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.286341:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800929de200/0x4076af6727510747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [58720256->59768831] (req 58720256->59768831) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144844.337052:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173626112 00000100:00100000:0.0:1746144844.337061:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173626112 00000100:00100000:0.0:1746144844.337116:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2336 00000100:00100000:0.0:1746144844.337123:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1983:x1830965173626112:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144844.337163:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 59768832, mtime: 0x68140e4c, atime: 0x0, ctime: 0x68140e4c, blocks: 0x1c811 00010000:00010000:0.0:1746144844.337170:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af672751074e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.337181:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144844.337182:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144844.337186:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af672751074e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.337197:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af672751074e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [59768832->60817407] (req 59768832->60817407) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144844.458796:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173626880 00000100:00100000:0.0:1746144844.458804:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173626880 00000100:00100000:0.0:1746144844.458863:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2339 00000100:00100000:0.0:1746144844.458870:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1983:x1830965173626880:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144844.458908:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 62914560, mtime: 0x68140e4c, atime: 0x0, ctime: 0x68140e4c, blocks: 0x1e011 00010000:00010000:0.0:1746144844.458915:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727510763 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.458926:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144844.458928:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144844.458932:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727510763 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.458942:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727510763 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [62914560->63963135] (req 62914560->63963135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144844.643559:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb size from disk: 66060288 -> 67108864 00002000:00010000:0.0:1746144844.643563:0:8436:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb mtime from disk: 1746144844 -> 1746144845 00002000:00010000:0.0:1746144844.643566:0:8436:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb ctime from disk: 1746144844 -> 1746144845 00002000:00010000:0.0:1746144844.643567:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb blocks from disk: 129041 -> 131089 00010000:00010000:0.0:1746144844.643577:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091cebe00/0x4076af6727510778 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.643587:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091cebe00/0x4076af6727510778 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.643594:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091cebe00/0x4076af6727510778 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.643620:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091cebe00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144844.643624:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091cebe00/0x4076af6727510778 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.643636:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091cebe00/0x4076af6727510778 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.643652:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091cebe00/0x4076af6727510778 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.643658:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cebe00/0x4076af6727510778 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [66060288->67108863] (req 66060288->67108863) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144844.643737:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1983:x1830965173627648:12345-192.168.202.16@tcp:4:dd.0 Request processed in 43877us (44129us total) trans 4294967808 rc 0/0 00000100:00100000:0.0:1746144844.643746:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2342 00000100:00100000:0.0:1746144844.649291:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00002000:00010000:0.0:1746144844.683096:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb size from disk: 67108864 -> 68157440 00002000:00010000:0.0:1746144844.683101:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb blocks from disk: 131089 -> 133139 00010000:00010000:0.0:1746144844.683111:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880093f05200/0x4076af672751077f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.683120:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093f05200/0x4076af672751077f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.683128:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093f05200/0x4076af672751077f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.683133:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093f05200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144844.683137:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093f05200/0x4076af672751077f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.683143:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093f05200/0x4076af672751077f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.683158:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093f05200/0x4076af672751077f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.683164:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f05200/0x4076af672751077f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [67108864->68157439] (req 67108864->68157439) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144844.683240:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965173627904:12345-192.168.202.16@tcp:4:dd.0 Request processed in 32934us (33953us total) trans 4294967809 rc 0/0 00000100:00100000:0.0:1746144844.683248:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2343 00000100:00100000:0.0:1746144844.687585:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173628160 00000100:00100000:0.0:1746144844.687594:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173628160 00000100:00100000:0.0:1746144844.687654:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2344 00000100:00100000:0.0:1746144844.687661:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1982:x1830965173628160:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144844.687701:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 68157440, mtime: 0x68140e4d, atime: 0x0, ctime: 0x68140e4d, blocks: 0x20813 00010000:00010000:0.0:1746144844.687709:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091a5ce00/0x4076af6727510786 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.687720:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144844.687722:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144844.687726:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5ce00/0x4076af6727510786 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.687736:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5ce00/0x4076af6727510786 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144844.727694:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb size from disk: 68157440 -> 69206016 00002000:00010000:0.0:1746144844.727700:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb blocks from disk: 133139 -> 135187 00010000:00010000:0.0:1746144844.727711:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091a5ce00/0x4076af6727510786 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.727722:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5ce00/0x4076af6727510786 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.727730:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091a5ce00/0x4076af6727510786 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.727736:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5ce00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144844.727739:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a5ce00/0x4076af6727510786 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.727746:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a5ce00/0x4076af6727510786 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.727760:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091a5ce00/0x4076af6727510786 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.727783:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5ce00/0x4076af6727510786 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [68157440->69206015] (req 68157440->69206015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144844.727859:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965173628160:12345-192.168.202.16@tcp:4:dd.0 Request processed in 40193us (40533us total) trans 4294967810 rc 0/0 00000100:00100000:0.0:1746144844.727871:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2344 00000100:00100000:0.0:1746144844.732464:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173628416 00000100:00100000:0.0:1746144844.732472:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173628416 00000100:00100000:0.0:1746144844.732531:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2345 00000100:00100000:0.0:1746144844.732538:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1982:x1830965173628416:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144844.732577:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 69206016, mtime: 0x68140e4d, atime: 0x0, ctime: 0x68140e4d, blocks: 0x21013 00010000:00010000:0.0:1746144844.732584:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092feac00/0x4076af672751078d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.732595:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144844.732596:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144844.732601:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092feac00/0x4076af672751078d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144844.732612:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092feac00/0x4076af672751078d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [69206016->70254591] (req 69206016->70254591) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144844.826311:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144844.876222:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144844.935086:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000001:00080000:0.0:1746144844.981585:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967815 is committed 00000100:00100000:0.0:1746144844.985191:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144845.039575:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144845.095311:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000001:00080000:0.0:1746144845.411232:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967904 is committed 00000001:00080000:0.0:1746144845.411290:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967916 is committed 00000001:00080000:0.0:1746144845.411295:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294967915 is committed 00000100:00100000:0.0:1746144845.417189:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144845.437154:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965171840512 00000100:00100000:0.0:1746144845.437157:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965171840512 00000100:00100000:0.0:1746144845.438236:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1746144845.438440:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1830965171840512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144845.438474:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1830965171840512:12345-0@lo:400:kworker.0 Request processed in 232us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144845.438479:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1746144845.438498:0:3308:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967916 gen 2 00000004:00080000:0.0:1746144845.438502:0:3308:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880093443800, transno 4294967916 00000100:00100000:0.0:1746144845.438509:0:3308:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1830965171840512:0@lo:400:kworker.0 00000100:00100000:0.0:1746144845.468144:0:3308:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746144845.468162:0:3308:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1830965171840640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746144845.468217:0:3308:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144845.469165:0:3308:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1830965171840640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746144845.471430:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00002000:00010000:0.0:1746144845.528577:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb size from disk: 83886080 -> 84934656 00002000:00010000:0.0:1746144845.528585:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb blocks from disk: 163861 -> 165909 00010000:00010000:0.0:1746144845.528597:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800916fa600/0x4076af67275107ef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.528609:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800916fa600/0x4076af67275107ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.528618:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800916fa600/0x4076af67275107ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.528630:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800916fa600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144845.528634:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800916fa600/0x4076af67275107ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.528642:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800916fa600/0x4076af67275107ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.528662:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800916fa600/0x4076af67275107ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.528668:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800916fa600/0x4076af67275107ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [83886080->84934655] (req 83886080->84934655) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144845.528845:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1982:x1830965173632000:12345-192.168.202.16@tcp:4:dd.0 Request processed in 56891us (57417us total) trans 4294967825 rc 0/0 00000100:00100000:0.0:1746144845.528855:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2359 00000100:00100000:0.0:1746144845.531899:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173632256 00000100:00100000:0.0:1746144845.531908:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173632256 00000100:00100000:0.0:1746144845.532012:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2360 00000100:00100000:0.0:1746144845.532020:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1982:x1830965173632256:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144845.532070:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 84934656, mtime: 0x68140e4d, atime: 0x0, ctime: 0x68140e4d, blocks: 0x28815 00010000:00010000:0.0:1746144845.532083:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091753800/0x4076af67275107f6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.532097:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144845.532099:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144845.532104:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753800/0x4076af67275107f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.532117:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753800/0x4076af67275107f6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [84934656->85983231] (req 84934656->85983231) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144845.591758:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173632512 00000100:00100000:0.0:1746144845.591831:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173632512 00000100:00100000:0.0:1746144845.591887:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2361 00000100:00100000:0.0:1746144845.592134:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1983:x1830965173632512:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144845.592190:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 85983232, mtime: 0x68140e4d, atime: 0x0, ctime: 0x68140e4d, blocks: 0x29015 00010000:00010000:0.0:1746144845.592198:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880092553200/0x4076af67275107fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.592213:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144845.592214:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144845.592219:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092553200/0x4076af67275107fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.592232:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092553200/0x4076af67275107fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [85983232->87031807] (req 85983232->87031807) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746144845.652901:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967827 is committed 00002000:00010000:0.0:1746144845.756105:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb size from disk: 88080384 -> 89128960 00002000:00010000:0.0:1746144845.756109:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x16:0x0] updating lvb blocks from disk: 172053 -> 174103 00010000:00010000:0.0:1746144845.756119:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751080b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.756127:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751080b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.756134:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751080b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.756140:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0d0000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144845.756144:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751080b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.756150:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751080b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.756165:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751080b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.756170:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751080b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [88080384->89128959] (req 88080384->89128959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144845.756238:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1983:x1830965173633024:12345-192.168.202.16@tcp:4:dd.0 Request processed in 38034us (39686us total) trans 4294967829 rc 0/0 00000100:00100000:0.0:1746144845.756246:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2363 00000100:00100000:0.0:1746144845.759149:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173633280 00000100:00100000:0.0:1746144845.759158:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173633280 00000100:00100000:0.0:1746144845.759211:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2364 00000100:00100000:0.0:1746144845.759218:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1982:x1830965173633280:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144845.759257:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 89128960, mtime: 0x68140e4e, atime: 0x0, ctime: 0x68140e4e, blocks: 0x2a817 00010000:00010000:0.0:1746144845.759264:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a60600/0x4076af6727510812 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.759276:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144845.759278:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144845.759282:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a60600/0x4076af6727510812 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.759686:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a60600/0x4076af6727510812 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [89128960->90177535] (req 89128960->90177535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144845.898350:0:31842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173634048 00000100:00100000:0.0:1746144845.898358:0:31842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173634048 00000100:00100000:0.0:1746144845.898428:0:31842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2367 00000100:00100000:0.0:1746144845.898435:0:31842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092588700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1982:x1830965173634048:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144845.898472:0:31842:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 92274688, mtime: 0x68140e4e, atime: 0x0, ctime: 0x68140e4e, blocks: 0x2c017 00010000:00010000:0.0:1746144845.898479:0:31842:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009170a200/0x4076af6727510827 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31842 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.898490:0:31842:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144845.898491:0:31842:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144845.898495:0:31842:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009170a200/0x4076af6727510827 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31842 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144845.898505:0:31842:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009170a200/0x4076af6727510827 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [92274688->93323263] (req 92274688->93323263) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31842 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144845.942376:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000001:00080000:0.0:1746144845.979345:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967834 is committed 00000100:00100000:0.0:1746144845.984985:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000001:00080000:0.0:1746144846.035460:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967835 is committed 00000100:00100000:0.0:1746144846.242210:0:31842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173635840 00000100:00100000:0.0:1746144846.242219:0:31842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173635840 00000100:00100000:0.0:1746144846.242262:0:31842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2374 00000100:00100000:0.0:1746144846.242268:0:31842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1982:x1830965173635840:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144846.242303:0:31842:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 99614720, mtime: 0x68140e4e, atime: 0x0, ctime: 0x68140e4e, blocks: 0x2f817 00010000:00010000:0.0:1746144846.242310:0:31842:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af6727510858 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31842 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144846.242320:0:31842:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144846.242322:0:31842:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144846.242325:0:31842:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af6727510858 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31842 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144846.242335:0:31842:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af6727510858 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [99614720->100663295] (req 99614720->100663295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31842 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746144846.285199:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967840 is committed 00000100:00100000:0.0:1746144846.290643:0:31842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173636096 00000100:00100000:0.0:1746144846.290651:0:31842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173636096 00000100:00100000:0.0:1746144846.290697:0:31842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2375 00000100:00100000:0.0:1746144846.290705:0:31842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1982:x1830965173636096:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144846.290746:0:31842:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 100663296, mtime: 0x68140e4e, atime: 0x0, ctime: 0x68140e4e, blocks: 0x30019 00010000:00010000:0.0:1746144846.290754:0:31842:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af672751085f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31842 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144846.290789:0:31842:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144846.290791:0:31842:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144846.290797:0:31842:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af672751085f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31842 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144846.290809:0:31842:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af672751085f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [100663296->101711871] (req 100663296->101711871) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31842 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144846.443034:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.487199:0:7114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173637120 00000100:00100000:0.0:1746144846.487207:0:7114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173637120 00000100:00100000:0.0:1746144846.487260:0:7114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 141 00000100:00100000:0.0:1746144846.487266:0:7114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+6:29655:x1830965173637120:12345-192.168.202.16@tcp:35:dd.0 00000001:00080000:0.0:1746144846.487519:0:7114:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294987448 00000100:00100000:0.0:1746144846.487576:0:7114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136198700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:29655:x1830965173637120:12345-192.168.202.16@tcp:35:dd.0 Request processed in 310us (482us total) trans 4294987449 rc 0/0 00000100:00100000:0.0:1746144846.487582:0:7114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 141 00000020:00080000:0.0:1746144846.487587:0:7114:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746144846.494155:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144846.495320:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144846.500447:0:21078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173637632 00000100:00100000:0.0:1746144846.500454:0:21078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173637632 00000100:00100000:0.0:1746144846.500942:0:21078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48176 00000100:00100000:0.0:1746144846.500950:0:21078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9d7af19e-38f7-44a8-82cf-031a58749c81+8:29660:x1830965173637632:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:0.0:1746144846.500966:0:21078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144846.500979:0:21078:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6600/0x4076af67275108ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90532 expref: -99 pid: 21078 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144846.501017:0:21078:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b7e00/0x4076af67275108b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21078 initiator: MDT0 00010000:00010000:0.0:1746144846.501030:0:21078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b7e00/0x4076af67275108b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21078 initiator: MDT0 00010000:00010000:0.0:1746144846.501038:0:21078:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b7e00/0x4076af67275108b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21078 initiator: MDT0 00000004:00200000:0.0:1746144846.501078:0:21078:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:0.0:1746144846.501080:0:21078:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144846.501089:0:21078:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b7e00/0x4076af67275108b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21078 initiator: MDT0 00010000:00010000:0.0:1746144846.501102:0:21078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6600/0x4076af67275108ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90532 expref: 10 pid: 21078 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144846.501290:0:21078:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b7e00/0x4076af67275108b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90532 expref: 9 pid: 21078 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144846.501297:0:21078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880092c80300) 00010000:00010000:0.0:1746144846.501299:0:21078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746144846.501301:0:21078:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925b7e00, rc 0) 00000100:00100000:0.0:1746144846.501433:0:21078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136199180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:9d7af19e-38f7-44a8-82cf-031a58749c81+9:29660:x1830965173637632:12345-192.168.202.16@tcp:101:dd.0 Request processed in 483us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144846.501438:0:21078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48176 00000100:00100000:0.0:1746144846.503224:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.505993:0:21078:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac85f80 pname:cluuid:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000_UUID:21078:1830965171840768:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144846.506011:0:21078:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093cff600/0x4076af67275108c1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21078 initiator: MDT0 00000100:00100000:0.0:1746144846.506137:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144846.514370:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144846.517930:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144846.533681:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144846.578466:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.578517:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.587709:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965173638784:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9036us (9242us total) trans 4294967917 rc 0/0 00000100:00100000:0.0:1746144846.587720:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2380 00002000:00100000:0.0:1746144846.587729:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x17:0x0] (0->1048575) req@ffff88009167dc00 x1830965173638784/t4294967917(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:487/0 lens 488/448 e 0 to 0 dl 1746144857 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.587738:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167dc00 with x1830965173638784 ext(0->1048575) 00002000:00010000:0.0:1746144846.587743:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009167dc00 00000100:00100000:0.0:1746144846.597886:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173639296 00000100:00100000:0.0:1746144846.597893:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173639296 00002000:00100000:0.0:1746144846.597925:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x17:0x0] (1048576->2097151) req@ffff880136199500 x1830965173639296/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.597934:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136199500 with x1830965173639296 ext(1048576->2097151) 00002000:00010000:0.0:1746144846.597939:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136199500 00000100:00100000:0.0:1746144846.598550:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2382 00000100:00100000:0.0:1746144846.598557:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136199500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965173639296:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144846.603235:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.603284:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.603305:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173639552 00000100:00100000:0.0:1746144846.603312:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173639552 00002000:00100000:0.0:1746144846.603345:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x16:0x0] (2097152->3145727) req@ffff88009167f480 x1830965173639552/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.603360:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167f480 with x1830965173639552 ext(2097152->3145727) 00002000:00010000:0.0:1746144846.603364:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167f480 00000100:00100000:0.0:1746144846.603390:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173639808 00000100:00100000:0.0:1746144846.603393:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173639808 00002000:00100000:0.0:1746144846.603403:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x16:0x0] (3145728->4194303) req@ffff88009167f100 x1830965173639808/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.603408:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167f100 with x1830965173639808 ext(3145728->4194303) 00002000:00010000:0.0:1746144846.603411:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167f100 00000100:00100000:0.0:1746144846.603439:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2383 00000100:00100000:0.0:1746144846.603445:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1983:x1830965173639552:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144846.620797:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965173639552:12345-192.168.202.16@tcp:3:dd.0 Request processed in 17311us (17527us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144846.620807:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2383 00002000:00100000:0.0:1746144846.620816:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x16:0x0] (2097152->3145727) req@ffff88009167f480 x1830965173639552/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/440 e 0 to 0 dl 1746144857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.620824:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167f480 with x1830965173639552 ext(2097152->3145727) 00002000:00010000:0.0:1746144846.620829:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167f480 00000100:00100000:0.0:1746144846.635438:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.646303:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.650163:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.650194:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.650219:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.650249:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.650272:0:25282:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173640576 00000100:00100000:0.0:1746144846.650277:0:25282:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173640576 00002000:00100000:0.0:1746144846.650303:0:25282:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x16:0x0] (4194304->5242879) req@ffff88012a2b0a80 x1830965173640576/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.650311:0:25282:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b0a80 with x1830965173640576 ext(4194304->5242879) 00002000:00010000:0.0:1746144846.650314:0:25282:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012a2b0a80 00000100:00100000:0.0:1746144846.650325:0:25282:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173640832 00000100:00100000:0.0:1746144846.650328:0:25282:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173640832 00002000:00100000:0.0:1746144846.650338:0:25282:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x16:0x0] (5242880->6291455) req@ffff88012a2b3800 x1830965173640832/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.650344:0:25282:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b3800 with x1830965173640832 ext(5242880->6291455) 00002000:00010000:0.0:1746144846.650346:0:25282:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012a2b3800 00000100:00100000:0.0:1746144846.650353:0:25282:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173641088 00000100:00100000:0.0:1746144846.650355:0:25282:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173641088 00002000:00100000:0.0:1746144846.650363:0:25282:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x16:0x0] (6291456->7340031) req@ffff88012a2b1880 x1830965173641088/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.650369:0:25282:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b1880 with x1830965173641088 ext(6291456->7340031) 00002000:00010000:0.0:1746144846.650381:0:25282:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012a2b1880 00000100:00100000:0.0:1746144846.650390:0:25282:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173641344 00000100:00100000:0.0:1746144846.650392:0:25282:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173641344 00002000:00100000:0.0:1746144846.650401:0:25282:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x16:0x0] (7340032->8388607) req@ffff88012a2b0700 x1830965173641344/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.650406:0:25282:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b0700 with x1830965173641344 ext(7340032->8388607) 00002000:00010000:0.0:1746144846.650408:0:25282:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012a2b0700 00000100:00100000:0.0:1746144846.651150:0:25282:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2388 00000100:00100000:0.0:1746144846.651157:0:25282:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1985:x1830965173640832:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144846.704557:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.704578:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173641856 00000100:00100000:0.0:1746144846.704584:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173641856 00002000:00100000:0.0:1746144846.704608:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (5242880->6291455) req@ffff88012a2b0380 x1830965173641856/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.704615:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b0380 with x1830965173641856 ext(5242880->6291455) 00002000:00010000:0.0:1746144846.704618:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012a2b0380 00000100:00100000:0.0:1746144846.704630:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2392 00000100:00100000:0.0:1746144846.704635:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1984:x1830965173641856:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144846.712421:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.717961:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.731940:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173643264 00000100:00100000:0.0:1746144846.731944:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173643264 00002000:00100000:0.0:1746144846.731961:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x16:0x0] (12582912->13631487) req@ffff8800924c8e00 x1830965173643264/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.731968:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c8e00 with x1830965173643264 ext(12582912->13631487) 00002000:00010000:0.0:1746144846.731971:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924c8e00 00000100:00100000:0.0:1746144846.731980:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2396 00000100:00100000:0.0:1746144846.731985:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1983:x1830965173642624:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144846.732582:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2398 00000100:00100000:0.0:1746144846.732588:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1982:x1830965173643392:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144846.742055:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1983:x1830965173642624:12345-192.168.202.16@tcp:3:dd.0 Request processed in 10060us (10393us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144846.742070:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2396 00002000:00100000:0.0:1746144846.742079:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x16:0x0] (8388608->9437183) req@ffff8800924c9f80 x1830965173642624/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/440 e 0 to 0 dl 1746144857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.742089:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924c9f80 with x1830965173642624 ext(8388608->9437183) 00002000:00010000:0.0:1746144846.742094:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924c9f80 00000100:00100000:0.0:1746144846.765758:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173644032 00000100:00100000:0.0:1746144846.765854:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173644032 00000100:00100000:0.0:1746144846.782109:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.792108:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.803133:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.854487:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173646080 00000100:00100000:0.0:1746144846.854495:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173646080 00002000:00100000:0.0:1746144846.854522:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x16:0x0] (16777216->17825791) req@ffff8800924ca300 x1830965173646080/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.854531:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924ca300 with x1830965173646080 ext(16777216->17825791) 00002000:00010000:0.0:1746144846.854535:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924ca300 00000100:00100000:0.0:1746144846.854557:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2415 00000100:00100000:0.0:1746144846.854562:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1984:x1830965173646080:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144846.855363:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.855387:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173646336 00000100:00100000:0.0:1746144846.855390:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173646336 00002000:00100000:0.0:1746144846.855406:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x16:0x0] (18874368->19922943) req@ffff880093255f80 x1830965173646336/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.855412:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093255f80 with x1830965173646336 ext(18874368->19922943) 00002000:00010000:0.0:1746144846.855415:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093255f80 00000100:00100000:0.0:1746144846.855429:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2416 00000100:00100000:0.0:1746144846.855434:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1984:x1830965173646336:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144846.856158:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.856190:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.856201:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173647104 00000100:00100000:0.0:1746144846.856204:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173647104 00002000:00100000:0.0:1746144846.856217:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x16:0x0] (25165824->26214399) req@ffff880093255180 x1830965173647104/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.856223:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093255180 with x1830965173647104 ext(25165824->26214399) 00002000:00010000:0.0:1746144846.856226:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093255180 00000100:00100000:0.0:1746144846.871069:0:25282:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173647488 00000100:00100000:0.0:1746144846.871077:0:25282:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173647488 00002000:00100000:0.0:1746144846.871103:0:25282:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x16:0x0] (26214400->27262975) req@ffff880136198380 x1830965173647488/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.871111:0:25282:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136198380 with x1830965173647488 ext(26214400->27262975) 00002000:00010000:0.0:1746144846.871114:0:25282:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136198380 00000100:00100000:0.0:1746144846.871138:0:25282:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2420 00000100:00100000:0.0:1746144846.871144:0:25282:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136198380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1984:x1830965173647488:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144846.874563:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1984:x1830965173646080:12345-192.168.202.16@tcp:3:dd.0 Request processed in 19991us (20465us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144846.874573:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2415 00002000:00100000:0.0:1746144846.874584:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x16:0x0] (16777216->17825791) req@ffff8800924ca300 x1830965173646080/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/440 e 0 to 0 dl 1746144857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.874594:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924ca300 with x1830965173646080 ext(16777216->17825791) 00002000:00010000:0.0:1746144846.874598:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924ca300 00000100:00100000:0.0:1746144846.875076:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.875110:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173647616 00000100:00100000:0.0:1746144846.875116:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173647616 00002000:00100000:0.0:1746144846.875140:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x16:0x0] (27262976->28311551) req@ffff880093254a80 x1830965173647616/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.875491:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254a80 with x1830965173647616 ext(27262976->28311551) 00002000:00010000:0.0:1746144846.875495:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093254a80 00000100:00100000:0.0:1746144846.875510:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2421 00000100:00100000:0.0:1746144846.875517:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1984:x1830965173647616:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144846.888653:0:31841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2423 00000100:00100000:0.0:1746144846.888661:0:31841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7454cbaf-97e3-4716-92c6-77cd48a94a90+21:1984:x1830965173647872:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144846.901569:0:31842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7454cbaf-97e3-4716-92c6-77cd48a94a90+21:1984:x1830965173646720:12345-192.168.202.16@tcp:3:dd.0 Request processed in 48002us (48862us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144846.901576:0:31842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2413 00002000:00100000:0.0:1746144846.901582:0:31842:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x16:0x0] (22020096->23068671) req@ffff88009b030700 x1830965173646720/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/440 e 0 to 0 dl 1746144857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.901589:0:31842:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b030700 with x1830965173646720 ext(22020096->23068671) 00002000:00010000:0.0:1746144846.901593:0:31842:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b030700 00000100:00100000:0.0:1746144846.914776:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1984:x1830965173646592:12345-192.168.202.16@tcp:3:dd.0 Request processed in 59137us (59233us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144846.914786:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2417 00002000:00100000:0.0:1746144846.914796:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x16:0x0] (20971520->22020095) req@ffff8800924cb800 x1830965173646592/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/440 e 0 to 0 dl 1746144857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.914804:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924cb800 with x1830965173646592 ext(20971520->22020095) 00002000:00010000:0.0:1746144846.914810:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924cb800 00000100:00100000:0.0:1746144846.916498:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173648640 00000100:00100000:0.0:1746144846.916502:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173648640 00002000:00100000:0.0:1746144846.916520:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x16:0x0] (31457280->32505855) req@ffff88009b030e00 x1830965173648640/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.916527:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b030e00 with x1830965173648640 ext(31457280->32505855) 00002000:00010000:0.0:1746144846.916531:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b030e00 00000100:00100000:0.0:1746144846.916550:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2427 00000100:00100000:0.0:1746144846.916555:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1984:x1830965173648640:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144846.930989:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.931008:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173649280 00000100:00100000:0.0:1746144846.931014:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173649280 00002000:00100000:0.0:1746144846.931045:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x17:0x0] (19922944->20971519) req@ffff880093254e00 x1830965173649280/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.931053:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254e00 with x1830965173649280 ext(19922944->20971519) 00002000:00010000:0.0:1746144846.931057:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093254e00 00000100:00100000:0.0:1746144846.931072:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2430 00000100:00100000:0.0:1746144846.931079:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+43:1985:x1830965173649280:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144846.931276:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1984:x1830965173647616:12345-192.168.202.16@tcp:3:dd.0 Request processed in 55759us (56200us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144846.931283:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2421 00002000:00100000:0.0:1746144846.931289:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x16:0x0] (27262976->28311551) req@ffff880093254a80 x1830965173647616/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/440 e 0 to 0 dl 1746144857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.931295:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254a80 with x1830965173647616 ext(27262976->28311551) 00002000:00010000:0.0:1746144846.931299:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093254a80 00000100:00100000:0.0:1746144846.937598:0:31841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1984:x1830965173647872:12345-192.168.202.16@tcp:3:dd.0 Request processed in 48930us (49714us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144846.937609:0:31841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2423 00002000:00100000:0.0:1746144846.937618:0:31841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x240000400:0x16:0x0] (29360128->30408703) req@ffff8800918a0000 x1830965173647872/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/440 e 0 to 0 dl 1746144857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.937627:0:31841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a0000 with x1830965173647872 ext(29360128->30408703) 00002000:00010000:0.0:1746144846.937632:0:31841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918a0000 00000100:00100000:0.0:1746144846.941249:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.942860:0:31842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9d7af19e-38f7-44a8-82cf-031a58749c81+48:1985:x1830965173648512:12345-192.168.202.16@tcp:4:dd.0 Request processed in 26534us (28719us total) trans 4294967934 rc 0/0 00000100:00100000:0.0:1746144846.942869:0:31842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2426 00002000:00100000:0.0:1746144846.942878:0:31842:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x17:0x0] (17825792->18874367) req@ffff88009b030a80 x1830965173648512/t4294967934(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:487/0 lens 488/448 e 0 to 0 dl 1746144857 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.942886:0:31842:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b030a80 with x1830965173648512 ext(17825792->18874367) 00002000:00010000:0.0:1746144846.942890:0:31842:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b030a80 00000100:00100000:0.0:1746144846.948656:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136199880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1984:x1830965173647744:12345-192.168.202.16@tcp:3:dd.0 Request processed in 60002us (60829us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144846.948663:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2422 00002000:00100000:0.0:1746144846.948668:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x16:0x0] (28311552->29360127) req@ffff880136199880 x1830965173647744/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/440 e 0 to 0 dl 1746144857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.948675:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136199880 with x1830965173647744 ext(28311552->29360127) 00002000:00010000:0.0:1746144846.948679:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136199880 00000100:00100000:0.0:1746144846.968877:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173650048 00000100:00100000:0.0:1746144846.968888:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173650048 00002000:00100000:0.0:1746144846.968926:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x17:0x0] (23068672->24117247) req@ffff88009b032300 x1830965173650048/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:487/0 lens 488/0 e 0 to 0 dl 1746144857 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.968936:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b032300 with x1830965173650048 ext(23068672->24117247) 00002000:00010000:0.0:1746144846.968941:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b032300 00000100:00100000:0.0:1746144846.971032:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2433 00000100:00100000:0.0:1746144846.971044:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1985:x1830965173650048:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144846.971246:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144846.983251:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+54:1985:x1830965173649536:12345-192.168.202.16@tcp:4:dd.0 Request processed in 41857us (42001us total) trans 4294967937 rc 0/0 00000100:00100000:0.0:1746144846.983262:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2431 00002000:00100000:0.0:1746144846.983270:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (20971520->22020095) req@ffff880093256300 x1830965173649536/t4294967937(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:487/0 lens 488/448 e 0 to 0 dl 1746144857 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144846.983278:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256300 with x1830965173649536 ext(20971520->22020095) 00002000:00010000:0.0:1746144846.983283:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093256300 00000100:00100000:0.0:1746144846.987904:0:3307:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746144846.987922:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965171840896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746144846.987975:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144846.988215:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965171840896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746144846.992228:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.000293:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+54:1985:x1830965173650048:12345-192.168.202.16@tcp:4:dd.0 Request processed in 29245us (31648us total) trans 4294967939 rc 0/0 00000100:00100000:0.0:1746144847.000302:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2433 00002000:00100000:0.0:1746144847.000311:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x17:0x0] (23068672->24117247) req@ffff88009b032300 x1830965173650048/t4294967939(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:487/0 lens 488/448 e 0 to 0 dl 1746144857 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.000319:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b032300 with x1830965173650048 ext(23068672->24117247) 00002000:00010000:0.0:1746144847.000324:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b032300 00000100:00100000:0.0:1746144847.004982:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2440 00000100:00100000:0.0:1746144847.004989:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1985:x1830965173650816:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144847.008441:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2444 00000100:00100000:0.0:1746144847.008452:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087db8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:9d7af19e-38f7-44a8-82cf-031a58749c81+54:1984:x1830965173652096:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.008575:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1985:x1830965173650688:12345-192.168.202.16@tcp:3:dd.0 Request processed in 15291us (16359us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144847.008582:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2435 00002000:00100000:0.0:1746144847.008588:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x16:0x0] (34603008->35651583) req@ffff880093256d80 x1830965173650688/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:487/0 lens 488/440 e 0 to 0 dl 1746144857 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.008595:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256d80 with x1830965173650688 ext(34603008->35651583) 00002000:00010000:0.0:1746144847.008599:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093256d80 00000100:00100000:0.0:1746144847.010620:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173652352 00000100:00100000:0.0:1746144847.010627:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173652352 00002000:00100000:0.0:1746144847.010650:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (26214400->27262975) req@ffff880087db8380 x1830965173652352/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.010659:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087db8380 with x1830965173652352 ext(26214400->27262975) 00002000:00010000:0.0:1746144847.010663:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087db8380 00000100:00100000:0.0:1746144847.010968:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2445 00000100:00100000:0.0:1746144847.010975:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087db8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1984:x1830965173652352:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.017710:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.017801:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173652608 00000100:00100000:0.0:1746144847.017807:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173652608 00002000:00100000:0.0:1746144847.017831:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x17:0x0] (27262976->28311551) req@ffff880093257100 x1830965173652608/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.017842:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257100 with x1830965173652608 ext(27262976->28311551) 00002000:00010000:0.0:1746144847.017845:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093257100 00000100:00100000:0.0:1746144847.030854:0:31844:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 13 min 3 max 116 00000100:00100000:0.0:1746144847.030865:0:31844:0:(service.c:3405:ptlrpc_start_thread()) starting thread 'll_ost_io00_013' 00000100:00100000:0.0:1746144847.030959:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1985:x1830965173650816:12345-192.168.202.16@tcp:3:dd.0 Request processed in 25965us (26334us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144847.030967:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2440 00002000:00100000:0.0:1746144847.030983:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x16:0x0] (35651584->36700159) req@ffff88009b033480 x1830965173650816/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/440 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.030992:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033480 with x1830965173650816 ext(35651584->36700159) 00002000:00010000:0.0:1746144847.030997:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b033480 00000100:00100000:0.0:1746144847.031016:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173653120 00000100:00100000:0.0:1746144847.031022:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173653120 00002000:00100000:0.0:1746144847.031044:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x16:0x0] (44040192->45088767) req@ffff8800924cb480 x1830965173653120/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.031050:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924cb480 with x1830965173653120 ext(44040192->45088767) 00002000:00010000:0.0:1746144847.031052:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924cb480 00000100:00100000:0.0:1746144847.031065:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2449 00000100:00100000:0.0:1746144847.031070:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1985:x1830965173653120:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144847.032051:0:31842:0:(service.c:3346:ptlrpc_start_thread()) ost_io[0] started 13 min 3 max 116 00000100:00100000:0.0:1746144847.032063:0:31842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173653376 00000100:00100000:0.0:1746144847.032067:0:31842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173653376 00002000:00100000:0.0:1746144847.032094:0:31842:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x17:0x0] (29360128->30408703) req@ffff8800924cad80 x1830965173653376/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.032101:0:31842:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924cad80 with x1830965173653376 ext(29360128->30408703) 00002000:00010000:0.0:1746144847.032105:0:31842:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924cad80 00000100:00100000:0.0:1746144847.040882:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087db8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965173652352:12345-192.168.202.16@tcp:4:dd.0 Request processed in 29902us (30316us total) trans 4294967942 rc 0/0 00000100:00100000:0.0:1746144847.040890:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2445 00002000:00100000:0.0:1746144847.040897:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (26214400->27262975) req@ffff880087db8380 x1830965173652352/t4294967942(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.040904:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087db8380 with x1830965173652352 ext(26214400->27262975) 00002000:00010000:0.0:1746144847.040908:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087db8380 00000100:00100000:0.0:1746144847.060742:0:18502:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1985:x1830965173652736:12345-192.168.202.16@tcp:3:dd.0 Request processed in 38308us (38894us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144847.060751:0:18502:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2447 00002000:00100000:0.0:1746144847.060760:0:18502:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x16:0x0] (42991616->44040191) req@ffff8800918a0e00 x1830965173652736/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/440 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.060781:0:18502:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a0e00 with x1830965173652736 ext(42991616->44040191) 00002000:00010000:0.0:1746144847.060787:0:18502:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918a0e00 00000100:00100000:0.0:1746144847.062388:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1984:x1830965173652992:12345-192.168.202.16@tcp:4:dd.0 Request processed in 39861us (40245us total) trans 4294967944 rc 0/0 00000100:00100000:0.0:1746144847.062396:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2448 00002000:00100000:0.0:1746144847.062404:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x17:0x0] (28311552->29360127) req@ffff8800918a1180 x1830965173652992/t4294967944(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.062724:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a1180 with x1830965173652992 ext(28311552->29360127) 00002000:00010000:0.0:1746144847.062731:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918a1180 00000100:00100000:0.0:1746144847.063378:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173654784 00000100:00100000:0.0:1746144847.063385:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173654784 00002000:00100000:0.0:1746144847.063410:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x16:0x0] (49283072->50331647) req@ffff880087db8e00 x1830965173654784/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.063416:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087db8e00 with x1830965173654784 ext(49283072->50331647) 00002000:00010000:0.0:1746144847.063419:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087db8e00 00000100:00100000:0.0:1746144847.085265:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.087535:0:25282:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1984:x1830965173654144:12345-192.168.202.16@tcp:4:dd.0 Request processed in 37579us (38642us total) trans 4294967947 rc 0/0 00000100:00100000:0.0:1746144847.087545:0:25282:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2454 00002000:00100000:0.0:1746144847.087555:0:25282:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x17:0x0] (31457280->32505855) req@ffff8800918a1880 x1830965173654144/t4294967947(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.087563:0:25282:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a1880 with x1830965173654144 ext(31457280->32505855) 00002000:00010000:0.0:1746144847.087567:0:25282:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918a1880 00000100:00100000:0.0:1746144847.089258:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.090015:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.092555:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1984:x1830965173654656:12345-192.168.202.16@tcp:4:dd.0 Request processed in 35484us (35804us total) trans 4294967948 rc 0/0 00000100:00100000:0.0:1746144847.092565:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2456 00002000:00100000:0.0:1746144847.092574:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x17:0x0] (32505856->33554431) req@ffff8800918a2300 x1830965173654656/t4294967948(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.092582:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a2300 with x1830965173654656 ext(32505856->33554431) 00002000:00010000:0.0:1746144847.092587:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918a2300 00000100:00100000:0.0:1746144847.095264:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173656576 00000100:00100000:0.0:1746144847.095272:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173656576 00002000:00100000:0.0:1746144847.095308:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x16:0x0] (57671680->58720255) req@ffff880087db9180 x1830965173656576/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.095315:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087db9180 with x1830965173656576 ext(57671680->58720255) 00002000:00010000:0.0:1746144847.095320:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087db9180 00000100:00100000:0.0:1746144847.095333:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173656704 00000100:00100000:0.0:1746144847.095335:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173656704 00002000:00100000:0.0:1746144847.095344:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x16:0x0] (58720256->59768831) req@ffff880087db9500 x1830965173656704/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.095350:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087db9500 with x1830965173656704 ext(58720256->59768831) 00002000:00010000:0.0:1746144847.095352:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087db9500 00000100:00100000:0.0:1746144847.095362:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2467 00000100:00100000:0.0:1746144847.095380:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087db9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+21:1985:x1830965173656576:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144847.102548:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.102617:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.131878:0:31841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1985:x1830965173657600:12345-192.168.202.16@tcp:4:dd.0 Request processed in 14728us (15631us total) trans 4294967951 rc 0/0 00000100:00100000:0.0:1746144847.131888:0:31841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2474 00002000:00100000:0.0:1746144847.131898:0:31841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x17:0x0] (35651584->36700159) req@ffff880087db9c00 x1830965173657600/t4294967951(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.131906:0:31841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087db9c00 with x1830965173657600 ext(35651584->36700159) 00002000:00010000:0.0:1746144847.131911:0:31841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087db9c00 00000100:00100000:0.0:1746144847.131931:0:31841:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173658624 00000100:00100000:0.0:1746144847.131936:0:31841:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173658624 00002000:00100000:0.0:1746144847.131957:0:31841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x17:0x0] (37748736->38797311) req@ffff880087dba300 x1830965173658624/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.131963:0:31841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087dba300 with x1830965173658624 ext(37748736->38797311) 00002000:00010000:0.0:1746144847.131965:0:31841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087dba300 00000100:00100000:0.0:1746144847.131977:0:31841:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2479 00000100:00100000:0.0:1746144847.131982:0:31841:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087dba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1984:x1830965173658624:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.140647:0:25282:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9d7af19e-38f7-44a8-82cf-031a58749c81+80:1985:x1830965173657984:12345-192.168.202.16@tcp:4:dd.0 Request processed in 18361us (18711us total) trans 4294967952 rc 0/0 00000100:00100000:0.0:1746144847.140657:0:25282:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2475 00002000:00100000:0.0:1746144847.140666:0:25282:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x17:0x0] (36700160->37748735) req@ffff8800918a2d80 x1830965173657984/t4294967952(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.140674:0:25282:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a2d80 with x1830965173657984 ext(36700160->37748735) 00002000:00010000:0.0:1746144847.140680:0:25282:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918a2d80 00000100:00100000:0.0:1746144847.145861:0:31841:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087dba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1984:x1830965173658624:12345-192.168.202.16@tcp:4:dd.0 Request processed in 13875us (14553us total) trans 4294967953 rc 0/0 00000100:00100000:0.0:1746144847.145867:0:31841:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2479 00002000:00100000:0.0:1746144847.145874:0:31841:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x280000400:0x17:0x0] (37748736->38797311) req@ffff880087dba300 x1830965173658624/t4294967953(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.145880:0:31841:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087dba300 with x1830965173658624 ext(37748736->38797311) 00002000:00010000:0.0:1746144847.145883:0:31841:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087dba300 00000100:00100000:0.0:1746144847.154498:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1984:x1830965173657728:12345-192.168.202.16@tcp:3:dd.0 Request processed in 37510us (37812us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144847.154507:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2473 00002000:00100000:0.0:1746144847.154517:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x16:0x0] (62914560->63963135) req@ffff8800918a2a00 x1830965173657728/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/440 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.154526:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a2a00 with x1830965173657728 ext(62914560->63963135) 00002000:00010000:0.0:1746144847.154531:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918a2a00 00000100:00100000:0.0:1746144847.154552:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173659136 00000100:00100000:0.0:1746144847.154557:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173659136 00002000:00100000:0.0:1746144847.154580:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x17:0x0] (39845888->40894463) req@ffff880091848000 x1830965173659136/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.154586:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091848000 with x1830965173659136 ext(39845888->40894463) 00002000:00010000:0.0:1746144847.154589:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091848000 00000100:00100000:0.0:1746144847.154603:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2481 00000100:00100000:0.0:1746144847.154607:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1984:x1830965173659136:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.154744:0:25029:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1984:x1830965173658112:12345-192.168.202.16@tcp:3:dd.0 Request processed in 32379us (32776us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144847.154750:0:25029:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2476 00002000:00100000:0.0:1746144847.154754:0:25029:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x16:0x0] (63963136->65011711) req@ffff8800918a3100 x1830965173658112/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/440 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.154760:0:25029:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a3100 with x1830965173658112 ext(63963136->65011711) 00002000:00010000:0.0:1746144847.154784:0:25029:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918a3100 00000100:00100000:0.0:1746144847.165070:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965173659136:12345-192.168.202.16@tcp:4:dd.0 Request processed in 10458us (11077us total) trans 4294967955 rc 0/0 00000100:00100000:0.0:1746144847.165077:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2481 00002000:00100000:0.0:1746144847.165083:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x17:0x0] (39845888->40894463) req@ffff880091848000 x1830965173659136/t4294967955(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.165090:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091848000 with x1830965173659136 ext(39845888->40894463) 00002000:00010000:0.0:1746144847.165094:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091848000 00000100:00100000:0.0:1746144847.187077:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2490 00000100:00100000:0.0:1746144847.187085:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+19:1984:x1830965173660416:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144847.194266:0:31843:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091848380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7454cbaf-97e3-4716-92c6-77cd48a94a90+22:1984:x1830965173659776:12345-192.168.202.16@tcp:3:dd.0 Request processed in 11764us (12297us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144847.194323:0:31843:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2483 00002000:00100000:0.0:1746144847.194332:0:31843:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x16:0x0] (68157440->69206015) req@ffff880091848380 x1830965173659776/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/440 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.194341:0:31843:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091848380 with x1830965173659776 ext(68157440->69206015) 00002000:00010000:0.0:1746144847.194345:0:31843:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091848380 00000100:00100000:0.0:1746144847.198248:0:31843:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173661312 00000100:00100000:0.0:1746144847.198256:0:31843:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173661312 00002000:00100000:0.0:1746144847.198289:0:31843:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x17:0x0] (42991616->44040191) req@ffff8800918a3b80 x1830965173661312/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.198298:0:31843:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a3b80 with x1830965173661312 ext(42991616->44040191) 00002000:00010000:0.0:1746144847.198302:0:31843:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918a3b80 00000100:00100000:0.0:1746144847.198317:0:31843:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2493 00000100:00100000:0.0:1746144847.198323:0:31843:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965173661312:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.200819:0:25282:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1984:x1830965173660032:12345-192.168.202.16@tcp:3:dd.0 Request processed in 18163us (18738us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144847.200827:0:25282:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2484 00002000:00100000:0.0:1746144847.200837:0:25282:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x16:0x0] (70254592->71303167) req@ffff880091848700 x1830965173660032/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/440 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.200850:0:25282:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091848700 with x1830965173660032 ext(70254592->71303167) 00002000:00010000:0.0:1746144847.200855:0:25282:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091848700 00000100:00100000:0.0:1746144847.200873:0:25282:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173661440 00000100:00100000:0.0:1746144847.200876:0:25282:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173661440 00002000:00100000:0.0:1746144847.200895:0:25282:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x16:0x0] (76546048->77594623) req@ffff880099a3f050 x1830965173661440/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.200900:0:25282:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099a3f050 with x1830965173661440 ext(76546048->77594623) 00002000:00010000:0.0:1746144847.200902:0:25282:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099a3f050 00000100:00100000:0.0:1746144847.200919:0:25282:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2494 00000100:00100000:0.0:1746144847.200923:0:25282:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1984:x1830965173661440:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144847.204575:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965173661056:12345-192.168.202.16@tcp:4:dd.0 Request processed in 12557us (12710us total) trans 4294967957 rc 0/0 00000100:00100000:0.0:1746144847.204585:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2492 00002000:00100000:0.0:1746144847.204595:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x17:0x0] (41943040->42991615) req@ffff8800918a3800 x1830965173661056/t4294967957(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.204602:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a3800 with x1830965173661056 ext(41943040->42991615) 00002000:00010000:0.0:1746144847.204607:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918a3800 00000100:00100000:0.0:1746144847.215336:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2495 00000100:00100000:0.0:1746144847.215345:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1984:x1830965173661824:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144847.215515:0:31842:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1984:x1830965173659904:12345-192.168.202.16@tcp:3:dd.0 Request processed in 28900us (30411us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144847.215522:0:31842:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2488 00002000:00100000:0.0:1746144847.215528:0:31842:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x240000400:0x16:0x0] (69206016->70254591) req@ffff880091849500 x1830965173659904/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/440 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.215535:0:31842:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091849500 with x1830965173659904 ext(69206016->70254591) 00002000:00010000:0.0:1746144847.215538:0:31842:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091849500 00000100:00100000:0.0:1746144847.216667:0:31843:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965173661312:12345-192.168.202.16@tcp:4:dd.0 Request processed in 18341us (18528us total) trans 4294967958 rc 0/0 00000100:00100000:0.0:1746144847.216674:0:31843:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2493 00002000:00100000:0.0:1746144847.216681:0:31843:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x17:0x0] (42991616->44040191) req@ffff8800918a3b80 x1830965173661312/t4294967958(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.216688:0:31843:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a3b80 with x1830965173661312 ext(42991616->44040191) 00002000:00010000:0.0:1746144847.216691:0:31843:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918a3b80 00000100:00100000:0.0:1746144847.219514:0:31843:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173662080 00000100:00100000:0.0:1746144847.219522:0:31843:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173662080 00002000:00100000:0.0:1746144847.219554:0:31843:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x16:0x0] (79691776->80740351) req@ffff88009184a300 x1830965173662080/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.219564:0:31843:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009184a300 with x1830965173662080 ext(79691776->80740351) 00002000:00010000:0.0:1746144847.219568:0:31843:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009184a300 00000100:00100000:0.0:1746144847.219596:0:31843:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2498 00000100:00100000:0.0:1746144847.219604:0:31843:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009184a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1984:x1830965173662080:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144847.227284:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.227312:0:31842:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173662336 00000100:00100000:0.0:1746144847.227319:0:31842:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173662336 00002000:00100000:0.0:1746144847.227351:0:31842:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x280000400:0x17:0x0] (45088768->46137343) req@ffff8801349cc380 x1830965173662336/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.227377:0:31842:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349cc380 with x1830965173662336 ext(45088768->46137343) 00002000:00010000:0.0:1746144847.227382:0:31842:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349cc380 00000100:00100000:0.0:1746144847.227398:0:31842:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2499 00000100:00100000:0.0:1746144847.227405:0:31842:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965173662336:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.239824:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1984:x1830965173660416:12345-192.168.202.16@tcp:3:dd.0 Request processed in 52739us (54682us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144847.239831:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2490 00002000:00100000:0.0:1746144847.239836:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x16:0x0] (73400320->74448895) req@ffff880091849c00 x1830965173660416/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/440 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.239843:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091849c00 with x1830965173660416 ext(73400320->74448895) 00002000:00010000:0.0:1746144847.239847:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091849c00 00000100:00100000:0.0:1746144847.252255:0:31843:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009184a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1984:x1830965173662080:12345-192.168.202.16@tcp:3:dd.0 Request processed in 32650us (32797us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144847.252263:0:31843:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2498 00002000:00100000:0.0:1746144847.252269:0:31843:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x16:0x0] (79691776->80740351) req@ffff88009184a300 x1830965173662080/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/440 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.252276:0:31843:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009184a300 with x1830965173662080 ext(79691776->80740351) 00002000:00010000:0.0:1746144847.252280:0:31843:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009184a300 00000100:00100000:0.0:1746144847.257100:0:31843:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173663488 00000100:00100000:0.0:1746144847.257109:0:31843:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173663488 00002000:00100000:0.0:1746144847.257146:0:31843:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x17:0x0] (48234496->49283071) req@ffff88009184aa00 x1830965173663488/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.257155:0:31843:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009184aa00 with x1830965173663488 ext(48234496->49283071) 00002000:00010000:0.0:1746144847.257161:0:31843:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009184aa00 00000100:00100000:0.0:1746144847.257188:0:31843:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2505 00000100:00100000:0.0:1746144847.257195:0:31843:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009184aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9d7af19e-38f7-44a8-82cf-031a58749c81+98:1985:x1830965173663488:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.259956:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1984:x1830965173661824:12345-192.168.202.16@tcp:3:dd.0 Request processed in 44609us (44833us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144847.259964:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2495 00002000:00100000:0.0:1746144847.259971:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x16:0x0] (77594624->78643199) req@ffff8800918a0a80 x1830965173661824/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/440 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.259979:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a0a80 with x1830965173661824 ext(77594624->78643199) 00002000:00010000:0.0:1746144847.259984:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918a0a80 00000100:00100000:0.0:1746144847.263878:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.273968:0:31843:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009184aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9d7af19e-38f7-44a8-82cf-031a58749c81+102:1985:x1830965173663488:12345-192.168.202.16@tcp:4:dd.0 Request processed in 16767us (17261us total) trans 4294967963 rc 0/0 00000100:00100000:0.0:1746144847.273976:0:31843:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2505 00002000:00100000:0.0:1746144847.273985:0:31843:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x280000400:0x17:0x0] (48234496->49283071) req@ffff88009184aa00 x1830965173663488/t4294967963(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.273993:0:31843:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009184aa00 with x1830965173663488 ext(48234496->49283071) 00002000:00010000:0.0:1746144847.273997:0:31843:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009184aa00 00000100:00100000:0.0:1746144847.283320:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173664000 00000100:00100000:0.0:1746144847.283329:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173664000 00002000:00100000:0.0:1746144847.283361:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x16:0x0] (83886080->84934655) req@ffff880087db8000 x1830965173664000/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.283381:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087db8000 with x1830965173664000 ext(83886080->84934655) 00002000:00010000:0.0:1746144847.283385:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087db8000 00000100:00100000:0.0:1746144847.283402:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173664256 00000100:00100000:0.0:1746144847.283405:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173664256 00002000:00100000:0.0:1746144847.283415:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x16:0x0] (85983232->87031807) req@ffff880087db8380 x1830965173664256/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.283421:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087db8380 with x1830965173664256 ext(85983232->87031807) 00002000:00010000:0.0:1746144847.283424:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087db8380 00000100:00100000:0.0:1746144847.283431:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173664512 00000100:00100000:0.0:1746144847.283433:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173664512 00002000:00100000:0.0:1746144847.283440:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x16:0x0] (88080384->89128959) req@ffff880087db8700 x1830965173664512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.283446:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087db8700 with x1830965173664512 ext(88080384->89128959) 00002000:00010000:0.0:1746144847.283448:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087db8700 00000100:00100000:0.0:1746144847.283456:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2507 00000100:00100000:0.0:1746144847.283463:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087db8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1985:x1830965173664000:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144847.304483:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087db8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+21:1985:x1830965173664768:12345-192.168.202.16@tcp:3:dd.0 Request processed in 20018us (21204us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144847.304491:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2510 00002000:00100000:0.0:1746144847.304497:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x16:0x0] (90177536->91226111) req@ffff880087db8a80 x1830965173664768/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/440 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.304505:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087db8a80 with x1830965173664768 ext(90177536->91226111) 00002000:00010000:0.0:1746144847.304508:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087db8a80 00000100:00100000:0.0:1746144847.313662:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.315900:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1985:x1830965173664128:12345-192.168.202.16@tcp:3:dd.0 Request processed in 30765us (30818us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144847.315910:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2512 00002000:00100000:0.0:1746144847.315919:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x16:0x0] (84934656->85983231) req@ffff880087544e00 x1830965173664128/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/440 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.315927:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087544e00 with x1830965173664128 ext(84934656->85983231) 00002000:00010000:0.0:1746144847.315931:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087544e00 00000100:00100000:0.0:1746144847.315948:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173665920 00000100:00100000:0.0:1746144847.315953:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173665920 00002000:00100000:0.0:1746144847.315971:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x16:0x0] (94371840->95420415) req@ffff880087db9c00 x1830965173665920/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.315977:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087db9c00 with x1830965173665920 ext(94371840->95420415) 00002000:00010000:0.0:1746144847.315979:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087db9c00 00000100:00100000:0.0:1746144847.315989:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2519 00000100:00100000:0.0:1746144847.315994:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1985:x1830965173665920:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144847.322875:0:31843:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173666048 00000100:00100000:0.0:1746144847.322883:0:31843:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173666048 00002000:00100000:0.0:1746144847.322919:0:31843:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x16:0x0] (95420416->96468991) req@ffff88009184b100 x1830965173666048/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.322928:0:31843:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009184b100 with x1830965173666048 ext(95420416->96468991) 00002000:00010000:0.0:1746144847.322933:0:31843:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009184b100 00000100:00100000:0.0:1746144847.322962:0:31843:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2520 00000100:00100000:0.0:1746144847.322969:0:31843:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009184b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1985:x1830965173666048:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144847.340857:0:25029:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173666688 00000100:00100000:0.0:1746144847.340862:0:25029:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173666688 00002000:00100000:0.0:1746144847.340882:0:25029:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x17:0x0] (53477376->54525951) req@ffff88009184b480 x1830965173666688/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.340894:0:25029:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009184b480 with x1830965173666688 ext(53477376->54525951) 00002000:00010000:0.0:1746144847.340898:0:25029:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009184b480 00000100:00100000:0.0:1746144847.340917:0:25029:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2523 00000100:00100000:0.0:1746144847.340922:0:25029:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009184b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+108:1984:x1830965173666688:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.351953:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.352755:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087db9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1985:x1830965173665536:12345-192.168.202.16@tcp:3:dd.0 Request processed in 48499us (48660us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144847.352788:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2517 00002000:00100000:0.0:1746144847.352795:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x16:0x0] (93323264->94371839) req@ffff880087db9500 x1830965173665536/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:488/0 lens 488/440 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.352802:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087db9500 with x1830965173665536 ext(93323264->94371839) 00002000:00010000:0.0:1746144847.352806:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087db9500 00000100:00100000:0.0:1746144847.371602:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.371619:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.371653:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173667584 00000100:00100000:0.0:1746144847.371659:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173667584 00002000:00100000:0.0:1746144847.371690:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (55574528->56623103) req@ffff8801349cd180 x1830965173667584/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.371699:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349cd180 with x1830965173667584 ext(55574528->56623103) 00002000:00010000:0.0:1746144847.371703:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349cd180 00000100:00100000:0.0:1746144847.371714:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173667840 00000100:00100000:0.0:1746144847.371716:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173667840 00002000:00100000:0.0:1746144847.371723:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (56623104->57671679) req@ffff8801349cd500 x1830965173667840/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.371734:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349cd500 with x1830965173667840 ext(56623104->57671679) 00002000:00010000:0.0:1746144847.371736:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349cd500 00000100:00100000:0.0:1746144847.371745:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2528 00000100:00100000:0.0:1746144847.371751:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+113:1984:x1830965173667584:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.371885:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2529 00000100:00100000:0.0:1746144847.371890:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+114:1984:x1830965173667840:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.382457:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.399103:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+118:1984:x1830965173667840:12345-192.168.202.16@tcp:4:dd.0 Request processed in 27209us (27479us total) trans 4294967971 rc 0/0 00000100:00100000:0.0:1746144847.399113:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2529 00002000:00100000:0.0:1746144847.399123:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x17:0x0] (56623104->57671679) req@ffff8801349cd500 x1830965173667840/t4294967971(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.399132:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349cd500 with x1830965173667840 ext(56623104->57671679) 00002000:00010000:0.0:1746144847.399137:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349cd500 00000100:00100000:0.0:1746144847.399155:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173669120 00000100:00100000:0.0:1746144847.399160:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173669120 00002000:00100000:0.0:1746144847.399177:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x17:0x0] (58720256->59768831) req@ffff880091848700 x1830965173669120/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.399183:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091848700 with x1830965173669120 ext(58720256->59768831) 00002000:00010000:0.0:1746144847.399185:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091848700 00000100:00100000:0.0:1746144847.399207:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2535 00000100:00100000:0.0:1746144847.399211:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+118:1984:x1830965173669120:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.406707:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087546a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+122:1984:x1830965173668096:12345-192.168.202.16@tcp:4:dd.0 Request processed in 25601us (25740us total) trans 4294967972 rc 0/0 00000100:00100000:0.0:1746144847.406716:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2530 00002000:00100000:0.0:1746144847.406725:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x17:0x0] (57671680->58720255) req@ffff880087546a00 x1830965173668096/t4294967972(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.406733:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087546a00 with x1830965173668096 ext(57671680->58720255) 00002000:00010000:0.0:1746144847.406738:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087546a00 00000100:00100000:0.0:1746144847.412591:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173669632 00000100:00100000:0.0:1746144847.412600:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173669632 00002000:00100000:0.0:1746144847.412633:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x17:0x0] (60817408->61865983) req@ffff880087547100 x1830965173669632/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.412641:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087547100 with x1830965173669632 ext(60817408->61865983) 00002000:00010000:0.0:1746144847.412646:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087547100 00000100:00100000:0.0:1746144847.412714:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2537 00000100:00100000:0.0:1746144847.413745:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+122:1985:x1830965173669632:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.427186:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.434578:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+128:1985:x1830965173669632:12345-192.168.202.16@tcp:4:dd.0 Request processed in 20828us (22048us total) trans 4294967975 rc 0/0 00000100:00100000:0.0:1746144847.434588:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2537 00002000:00100000:0.0:1746144847.434596:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x17:0x0] (60817408->61865983) req@ffff880087547100 x1830965173669632/t4294967975(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.434603:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087547100 with x1830965173669632 ext(60817408->61865983) 00002000:00010000:0.0:1746144847.434608:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087547100 00000100:00100000:0.0:1746144847.438436:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173670400 00000100:00100000:0.0:1746144847.438444:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173670400 00002000:00100000:0.0:1746144847.438478:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x17:0x0] (63963136->65011711) req@ffff880087547480 x1830965173670400/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.438486:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087547480 with x1830965173670400 ext(63963136->65011711) 00002000:00010000:0.0:1746144847.438490:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087547480 00000100:00100000:0.0:1746144847.438544:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2540 00000100:00100000:0.0:1746144847.438551:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+128:1985:x1830965173670400:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.444652:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+130:1985:x1830965173670144:12345-192.168.202.16@tcp:4:dd.0 Request processed in 17340us (17465us total) trans 4294967977 rc 0/0 00000100:00100000:0.0:1746144847.444663:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2539 00002000:00100000:0.0:1746144847.444672:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x17:0x0] (62914560->63963135) req@ffff8801349cdc00 x1830965173670144/t4294967977(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.444681:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349cdc00 with x1830965173670144 ext(62914560->63963135) 00002000:00010000:0.0:1746144847.444686:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349cdc00 00000100:00100000:0.0:1746144847.449049:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+130:1985:x1830965173670400:12345-192.168.202.16@tcp:4:dd.0 Request processed in 10491us (10658us total) trans 4294967978 rc 0/0 00000100:00100000:0.0:1746144847.449059:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2540 00002000:00100000:0.0:1746144847.449068:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x17:0x0] (63963136->65011711) req@ffff880087547480 x1830965173670400/t4294967978(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.449077:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087547480 with x1830965173670400 ext(63963136->65011711) 00002000:00010000:0.0:1746144847.449082:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087547480 00000100:00100000:0.0:1746144847.449863:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173670656 00000100:00100000:0.0:1746144847.449869:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173670656 00002000:00100000:0.0:1746144847.449893:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x17:0x0] (65011712->66060287) req@ffff880091848a80 x1830965173670656/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.449900:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091848a80 with x1830965173670656 ext(65011712->66060287) 00002000:00010000:0.0:1746144847.449903:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091848a80 00000100:00100000:0.0:1746144847.449930:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2541 00000100:00100000:0.0:1746144847.449936:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+130:1984:x1830965173670656:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.459305:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+132:1984:x1830965173670656:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9362us (9487us total) trans 4294967979 rc 0/0 00000100:00100000:0.0:1746144847.459315:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2541 00002000:00100000:0.0:1746144847.459325:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x17:0x0] (65011712->66060287) req@ffff880091848a80 x1830965173670656/t4294967979(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.459333:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091848a80 with x1830965173670656 ext(65011712->66060287) 00002000:00010000:0.0:1746144847.459338:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091848a80 00000100:00100000:0.0:1746144847.459741:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173670912 00000100:00100000:0.0:1746144847.459747:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173670912 00002000:00100000:0.0:1746144847.459797:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x17:0x0] (66060288->67108863) req@ffff880087547800 x1830965173670912/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.459805:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087547800 with x1830965173670912 ext(66060288->67108863) 00002000:00010000:0.0:1746144847.459808:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087547800 00000100:00100000:0.0:1746144847.459831:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2542 00000100:00100000:0.0:1746144847.459837:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+132:1984:x1830965173670912:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.473721:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.490633:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.514622:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.520962:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.530807:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.551749:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.558732:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.558785:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173673728 00000100:00100000:0.0:1746144847.558791:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173673728 00002000:00100000:0.0:1746144847.558825:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (77594624->78643199) req@ffff8801349cf480 x1830965173673728/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.558834:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349cf480 with x1830965173673728 ext(77594624->78643199) 00002000:00010000:0.0:1746144847.558838:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349cf480 00000100:00100000:0.0:1746144847.558868:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2553 00000100:00100000:0.0:1746144847.558874:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+154:1984:x1830965173673728:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.578966:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.606796:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173675008 00000100:00100000:0.0:1746144847.606805:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173675008 00000100:00100000:0.0:1746144847.639428:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+170:1984:x1830965173675520:12345-192.168.202.16@tcp:4:dd.0 Request processed in 10405us (10516us total) trans 4294967998 rc 0/0 00000100:00100000:0.0:1746144847.639440:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2560 00002000:00100000:0.0:1746144847.639450:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x17:0x0] (84934656->85983231) req@ffff880093857480 x1830965173675520/t4294967998(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.639458:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093857480 with x1830965173675520 ext(84934656->85983231) 00002000:00010000:0.0:1746144847.639463:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093857480 00000100:00100000:0.0:1746144847.639597:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173675776 00000100:00100000:0.0:1746144847.639604:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173675776 00002000:00100000:0.0:1746144847.639629:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x17:0x0] (85983232->87031807) req@ffff880091849180 x1830965173675776/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.639641:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091849180 with x1830965173675776 ext(85983232->87031807) 00002000:00010000:0.0:1746144847.639644:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091849180 00000100:00100000:0.0:1746144847.639658:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2561 00000100:00100000:0.0:1746144847.639664:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+170:1985:x1830965173675776:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.693660:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.693688:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173677056 00000100:00100000:0.0:1746144847.693697:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173677056 00002000:00100000:0.0:1746144847.693737:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x17:0x0] (91226112->92274687) req@ffff8801349cfb80 x1830965173677056/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.693748:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349cfb80 with x1830965173677056 ext(91226112->92274687) 00002000:00010000:0.0:1746144847.693754:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349cfb80 00000100:00100000:0.0:1746144847.694371:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2566 00000100:00100000:0.0:1746144847.694381:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+180:1985:x1830965173677056:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.706110:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+184:1985:x1830965173677056:12345-192.168.202.16@tcp:4:dd.0 Request processed in 11727us (12456us total) trans 4294968004 rc 0/0 00000100:00100000:0.0:1746144847.706118:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2566 00002000:00100000:0.0:1746144847.706125:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x17:0x0] (91226112->92274687) req@ffff8801349cfb80 x1830965173677056/t4294968004(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.706133:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801349cfb80 with x1830965173677056 ext(91226112->92274687) 00002000:00010000:0.0:1746144847.706137:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801349cfb80 00000100:00100000:0.0:1746144847.716089:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+184:1985:x1830965173677312:12345-192.168.202.16@tcp:4:dd.0 Request processed in 11158us (11385us total) trans 4294968005 rc 0/0 00000100:00100000:0.0:1746144847.716104:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2567 00002000:00100000:0.0:1746144847.716115:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (92274688->93323263) req@ffff880091849880 x1830965173677312/t4294968005(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.716125:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091849880 with x1830965173677312 ext(92274688->93323263) 00002000:00010000:0.0:1746144847.716131:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091849880 00000100:00100000:0.0:1746144847.716153:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173677568 00000100:00100000:0.0:1746144847.716160:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173677568 00002000:00100000:0.0:1746144847.716189:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (93323264->94371839) req@ffff880087dba680 x1830965173677568/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.716195:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087dba680 with x1830965173677568 ext(93323264->94371839) 00002000:00010000:0.0:1746144847.716198:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087dba680 00000100:00100000:0.0:1746144847.716225:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2568 00000100:00100000:0.0:1746144847.716231:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087dba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+184:1984:x1830965173677568:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.725802:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087dba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+186:1984:x1830965173677568:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9567us (10188us total) trans 4294968006 rc 0/0 00000100:00100000:0.0:1746144847.725814:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2568 00002000:00100000:0.0:1746144847.725827:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (93323264->94371839) req@ffff880087dba680 x1830965173677568/t4294968006(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.725837:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087dba680 with x1830965173677568 ext(93323264->94371839) 00002000:00010000:0.0:1746144847.726561:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087dba680 00000100:00100000:0.0:1746144847.735617:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+188:1984:x1830965173677824:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9492us (10540us total) trans 4294968007 rc 0/0 00000100:00100000:0.0:1746144847.735630:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2569 00002000:00100000:0.0:1746144847.735644:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x17:0x0] (94371840->95420415) req@ffff880093854a80 x1830965173677824/t4294968007(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.735655:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854a80 with x1830965173677824 ext(94371840->95420415) 00002000:00010000:0.0:1746144847.735662:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093854a80 00000100:00100000:0.0:1746144847.736926:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173678080 00000100:00100000:0.0:1746144847.736935:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173678080 00002000:00100000:0.0:1746144847.736970:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x17:0x0] (95420416->96468991) req@ffff880093855500 x1830965173678080/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.736978:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093855500 with x1830965173678080 ext(95420416->96468991) 00002000:00010000:0.0:1746144847.736982:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093855500 00000100:00100000:0.0:1746144847.736999:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2570 00000100:00100000:0.0:1746144847.737006:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+188:1985:x1830965173678080:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.746636:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+190:1985:x1830965173678080:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9620us (10202us total) trans 4294968008 rc 0/0 00000100:00100000:0.0:1746144847.746647:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2570 00002000:00100000:0.0:1746144847.746657:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x17:0x0] (95420416->96468991) req@ffff880093855500 x1830965173678080/t4294968008(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.746665:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093855500 with x1830965173678080 ext(95420416->96468991) 00002000:00010000:0.0:1746144847.746670:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093855500 00000100:00100000:0.0:1746144847.757608:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173678592 00000100:00100000:0.0:1746144847.757616:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173678592 00002000:00100000:0.0:1746144847.757649:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x17:0x0] (97517568->98566143) req@ffff880093f46d80 x1830965173678592/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.757657:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f46d80 with x1830965173678592 ext(97517568->98566143) 00002000:00010000:0.0:1746144847.757661:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f46d80 00000100:00100000:0.0:1746144847.757678:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2572 00000100:00100000:0.0:1746144847.757685:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+192:1985:x1830965173678592:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.757991:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 271 00000100:00100000:0.0:1746144847.757998:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1983:x1830965173679104:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144847.758018:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1983:x1830965173679104:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 21us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144847.758022:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 271 00000100:00080000:0.0:1746144847.759336:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746144847.759339:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144847.779932:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173679744 00000100:00100000:0.0:1746144847.779940:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173679744 00002000:00100000:0.0:1746144847.779978:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (99614720->100663295) req@ffff88009ae40e00 x1830965173679744/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.779987:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae40e00 with x1830965173679744 ext(99614720->100663295) 00002000:00010000:0.0:1746144847.779992:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae40e00 00000100:00100000:0.0:1746144847.780017:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2574 00000100:00100000:0.0:1746144847.780023:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1985:x1830965173679744:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.792651:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173680000 00000100:00100000:0.0:1746144847.792660:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173680000 00002000:00100000:0.0:1746144847.792698:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (100663296->101711871) req@ffff880087dbb100 x1830965173680000/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.792706:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087dbb100 with x1830965173680000 ext(100663296->101711871) 00002000:00010000:0.0:1746144847.792711:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087dbb100 00000100:00100000:0.0:1746144847.792739:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2575 00000100:00100000:0.0:1746144847.792745:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087dbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+48:1985:x1830965173680000:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.799579:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087dbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1985:x1830965173680000:12345-192.168.202.16@tcp:4:dd.0 Request processed in 6825us (6980us total) trans 4294968013 rc 0/0 00000100:00100000:0.0:1746144847.799590:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2575 00002000:00100000:0.0:1746144847.799599:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (100663296->101711871) req@ffff880087dbb100 x1830965173680000/t4294968013(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.799607:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087dbb100 with x1830965173680000 ext(100663296->101711871) 00002000:00010000:0.0:1746144847.799612:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087dbb100 00000100:00100000:0.0:1746144847.800827:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173680256 00000100:00100000:0.0:1746144847.800833:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173680256 00002000:00100000:0.0:1746144847.800859:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x17:0x0] (101711872->102760447) req@ffff88009ae41180 x1830965173680256/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.800867:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae41180 with x1830965173680256 ext(101711872->102760447) 00002000:00010000:0.0:1746144847.800870:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae41180 00000100:00100000:0.0:1746144847.800895:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2576 00000100:00100000:0.0:1746144847.800901:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1985:x1830965173680256:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.818001:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173680512 00000100:00100000:0.0:1746144847.818009:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173680512 00002000:00100000:0.0:1746144847.818048:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x17:0x0] (102760448->103809023) req@ffff88009ae42d80 x1830965173680512/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/0 e 0 to 0 dl 1746144858 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.818057:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae42d80 with x1830965173680512 ext(102760448->103809023) 00002000:00010000:0.0:1746144847.818061:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae42d80 00000100:00100000:0.0:1746144847.818091:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2577 00000100:00100000:0.0:1746144847.818099:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+52:1984:x1830965173680512:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144847.827102:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.827885:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144847.834500:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1984:x1830965173680512:12345-192.168.202.16@tcp:4:dd.0 Request processed in 16398us (17287us total) trans 4294968015 rc 0/0 00000100:00100000:0.0:1746144847.834511:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2577 00002000:00100000:0.0:1746144847.834523:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x17:0x0] (102760448->103809023) req@ffff88009ae42d80 x1830965173680512/t4294968015(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:488/0 lens 488/448 e 0 to 0 dl 1746144858 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144847.834532:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae42d80 with x1830965173680512 ext(102760448->103809023) 00002000:00010000:0.0:1746144847.834538:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae42d80 00000100:00080000:0.0:1746144849.776698:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144849.780325:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144849.780492:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746144849.785928:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144849.789070:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144849.790296:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144849.792052:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144849.793901:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144849.795615:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144849.798376:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.444031:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1830965171841792:0@lo:400:kworker.0 00000100:00100000:0.0:1746144850.444122:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144850.444250:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965171841664 00000100:00100000:0.0:1746144850.444256:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965171841664 00000100:00100000:0.0:1746144850.444306:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1746144850.444313:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1830965171841664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144850.444370:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1830965171841664:12345-0@lo:400:kworker.0 Request processed in 57us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144850.444376:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00080000:0.0:1746144850.444395:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746144850.444399:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144850.444426:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1830965171841792:0@lo:400:kworker.0 00000100:00080000:0.0:1746144850.445147:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144850.618048:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.618089:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173683328 00000100:00100000:0.0:1746144850.618098:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173683328 00000100:00100000:0.0:1746144850.618144:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48185 00000100:00100000:0.0:1746144850.618153:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+8:30292:x1830965173683328:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:0.0:1746144850.618177:0:10400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144850.618198:0:10400:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091709600/0x4076af672751097e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90578 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144850.618258:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091708200/0x4076af6727510985 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144850.618271:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091708200/0x4076af6727510985 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144850.618284:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091708200/0x4076af6727510985 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000004:00200000:0.0:1746144850.618355:0:10400:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:0.0:1746144850.618359:0:10400:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 24 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144850.618376:0:10400:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091708200/0x4076af6727510985 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144850.618401:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091709600/0x4076af672751097e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90578 expref: 10 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144850.618413:0:10400:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091708200/0x4076af6727510985 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90578 expref: 9 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144850.618420:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008a389300) 00010000:00010000:0.0:1746144850.618423:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746144850.618426:0:10400:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091708200, rc 0) 00000100:00100000:0.0:1746144850.618484:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+9:30292:x1830965173683328:12345-192.168.202.16@tcp:101:dd.0 Request processed in 332us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144850.618490:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48185 00000100:00100000:0.0:1746144850.619806:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.647563:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.647593:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173684224 00000100:00100000:0.0:1746144850.647600:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173684224 00002000:00100000:0.0:1746144850.647633:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x17:0x0] (1048576->2097151) req@ffff88009167df80 x1830965173684224/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:491/0 lens 488/0 e 0 to 0 dl 1746144861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144850.647642:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167df80 with x1830965173684224 ext(1048576->2097151) 00002000:00010000:0.0:1746144850.647647:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167df80 00000100:00100000:0.0:1746144850.647664:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2580 00000100:00100000:0.0:1746144850.647670:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965173684224:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144850.665680:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+13:1985:x1830965173684224:12345-192.168.202.16@tcp:4:dd.0 Request processed in 18004us (18118us total) trans 4294967846 rc 0/0 00000100:00100000:0.0:1746144850.665690:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2580 00002000:00100000:0.0:1746144850.665699:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x17:0x0] (1048576->2097151) req@ffff88009167df80 x1830965173684224/t4294967846(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:491/0 lens 488/448 e 0 to 0 dl 1746144861 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144850.665707:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167df80 with x1830965173684224 ext(1048576->2097151) 00002000:00010000:0.0:1746144850.665712:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167df80 00000100:00100000:0.0:1746144850.672848:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.688970:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.697042:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173685248 00000100:00100000:0.0:1746144850.697055:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173685248 00002000:00100000:0.0:1746144850.697107:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x17:0x0] (5242880->6291455) req@ffff8800a4f08000 x1830965173685248/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:491/0 lens 488/0 e 0 to 0 dl 1746144861 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144850.697117:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f08000 with x1830965173685248 ext(5242880->6291455) 00002000:00010000:0.0:1746144850.697122:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4f08000 00000100:00100000:0.0:1746144850.697155:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2584 00000100:00100000:0.0:1746144850.697163:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1985:x1830965173685248:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144850.709292:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.716460:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.728353:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.735094:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.736322:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.754867:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144850.755822:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144850.761726:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.854748:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144850.855234:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144850.873951:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.878122:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.880793:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.892573:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173688192 00000100:00100000:0.0:1746144850.892580:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173688192 00000100:00100000:0.0:1746144850.892621:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48190 00000100:00100000:0.0:1746144850.892628:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30301:x1830965173688192:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:0.0:1746144850.892641:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144850.892643:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746144850.892659:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6400/0x4076af67275109e7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af905a2 expref: 6 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144850.892686:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880099b3d100) 00010000:00010000:0.0:1746144850.892689:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144850.892698:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091708c00/0x4076af67275109ee lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af905a9 expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144850.892839:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091708a00/0x4076af67275109f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.892847:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091708a00/0x4076af67275109f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.892854:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091708a00/0x4076af67275109f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.892863:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af67275109fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.892869:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af67275109fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.892873:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af67275109fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.892922:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091708e00/0x4076af6727510a03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.892928:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091708e00/0x4076af6727510a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.892934:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091708e00/0x4076af6727510a03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:0.0:1746144850.892941:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 10485760 00010000:00010000:0.0:1746144850.893007:0:7111:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091708a00/0x4076af67275109f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.893012:0:7111:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091708a00/0x4076af67275109f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.893017:0:7111:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091708a00/0x4076af67275109f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.893022:0:7111:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091708a00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144850.893025:0:7111:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091708a00/0x4076af67275109f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.893030:0:7111:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091708a00/0x4076af67275109f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.893037:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880099b3d100) 00010000:00010000:0.0:1746144850.893039:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144850.893041:0:7111:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091708a00/0x4076af67275109f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.893045:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091708a00/0x4076af67275109f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.893056:0:7111:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af67275109fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.893061:0:7111:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af67275109fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.893065:0:7111:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af67275109fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.893069:0:7111:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091709c00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144850.893071:0:7111:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af67275109fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.893075:0:7111:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af67275109fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.893079:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdece3da0 (ffff88008a389700) 00010000:00010000:0.0:1746144850.893081:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144850.893083:0:7111:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af67275109fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.893086:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af67275109fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144850.893110:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091708c00/0x4076af67275109ee lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af905a9 expref: 8 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144850.893118:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091708e00/0x4076af6727510a03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af905a9 expref: 7 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144850.893123:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff880099b3d900) 00010000:00010000:0.0:1746144850.893126:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746144850.893128:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091708e00, rc 0) 00000100:00100000:0.0:1746144850.893156:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:30301:x1830965173688192:12345-192.168.202.16@tcp:101:dd.0 Request processed in 530us (638us total) trans 4294987463 rc 0/0 00000100:00100000:0.0:1746144850.893162:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48190 00000001:00080000:0.0:1746144850.949193:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967846 is committed 00000001:00080000:0.0:1746144850.949213:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967849 is committed 00000001:00080000:0.0:1746144850.949228:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967855 is committed 00000001:00080000:0.0:1746144850.949233:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967854 is committed 00000100:00100000:0.0:1746144850.962224:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.991966:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144850.994743:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:0.0:1746144850.999584:0:10400:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6000/0x4076af6727510a42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144850.999590:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6000/0x4076af6727510a42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000040:00080000:0.0:1746144851.000260:0:10400:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].12, 64 off8960 00000004:00080000:0.0:1746144851.000267:0:10400:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 445147503631ns, next at 446147502441ns, rc = 0 00010000:00010000:0.0:1746144851.000318:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091750400/0x4076af6727510a49 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000326:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091750400/0x4076af6727510a49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000341:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091750400/0x4076af6727510a49 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000347:0:10400:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091750400/0x4076af6727510a49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000354:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880091750400/0x4076af6727510a49 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000358:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091750400/0x4076af6727510a49 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000368:0:10400:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746144851.000383:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6000/0x4076af6727510a42 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000387:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6000/0x4076af6727510a42 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000392:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6000/0x4076af6727510a42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000396:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800925b6000 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144851.000399:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6000/0x4076af6727510a42 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000404:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6000/0x4076af6727510a42 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000411:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff880099b3d900) 00010000:00010000:0.0:1746144851.000414:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746144851.000416:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6000/0x4076af6727510a42 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000420:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6000/0x4076af6727510a42 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000471:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6600/0x4076af6727510a34 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000480:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6600/0x4076af6727510a34 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000484:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6600/0x4076af6727510a34 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000487:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800925b6600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144851.000489:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6600/0x4076af6727510a34 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000494:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6600/0x4076af6727510a34 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000500:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880099b3d100) 00010000:00010000:0.0:1746144851.000501:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144851.000503:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6600/0x4076af6727510a34 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.000506:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6600/0x4076af6727510a34 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00000004:00010000:0.0:1746144851.000516:0:10400:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009ac85880 reply state ffff8801356f1000 transno 4294987465 ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6800/0x4076af6727510a3b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000100:00100000:0.0:1746144851.000521:0:10400:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746144851.000572:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+14:30303:x1830965173689344:12345-192.168.202.16@tcp:36:rm.0 Request processed in 8483us (8612us total) trans 4294987465 rc 0/0 00000100:00100000:0.0:1746144851.000578:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48192 00010000:00010000:0.0:1746144851.002635:0:3292:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6800/0x4076af6727510a3b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.002645:0:3292:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6800/0x4076af6727510a3b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.002651:0:3292:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6800/0x4076af6727510a3b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.002655:0:3292:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800925b6800 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144851.002658:0:3292:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6800/0x4076af6727510a3b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.002664:0:3292:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6800/0x4076af6727510a3b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.002673:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xdece3da0 (ffff880099b3d600) 00010000:00010000:0.0:1746144851.002675:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144851.002678:0:3292:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6800/0x4076af6727510a3b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144851.002682:0:3292:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6800/0x4076af6727510a3b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xdece3da0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00000100:00100000:0.0:1746144851.996932:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965171842432 00000100:00100000:0.0:1746144851.996938:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965171842432 00000100:00100000:0.0:1746144851.996979:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1746144851.996986:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965171842432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746144851.997020:0:8434:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 624623616 pending 0 free 3739222016 avail 3737124864 00000100:00100000:0.0:1746144851.997049:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965171842432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144851.997054:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000001:00080000:0.0:1746144852.639639:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968015 is committed 00000001:00080000:0.0:1746144852.639690:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968016 is committed 00000100:00100000:0.0:1746144852.764371:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144852.764400:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144852.764436:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144852.764449:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144852.764463:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144852.764475:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144852.764498:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144852.764520:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173690240 00000100:00100000:0.0:1746144852.764527:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173690240 00000100:00100000:0.0:1746144852.764564:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173689856 00000100:00100000:0.0:1746144852.764567:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173689856 00000100:00100000:0.0:1746144852.764581:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 275 00000100:00100000:0.0:1746144852.764587:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1983:x1830965173690240:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144852.764643:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1983:x1830965173690240:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 56us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144852.764649:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 275 00000100:00100000:0.0:1746144852.764660:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 276 00000100:00100000:0.0:1746144852.764663:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+13:1983:x1830965173689856:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144852.764679:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+13:1983:x1830965173689856:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 15us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144852.764683:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 276 00000100:00080000:0.0:1746144852.764695:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746144852.764698:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746144852.764699:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144852.764719:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 360 00000100:00100000:0.0:1746144852.764723:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1983:x1830965173690112:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144852.764738:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1983:x1830965173690112:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 15us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144852.764746:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 360 00000100:00100000:0.0:1746144852.764853:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173689728 00000100:00100000:0.0:1746144852.764856:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173689728 00000100:00100000:0.0:1746144852.764874:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 355 00000100:00100000:0.0:1746144852.764878:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4574b85-29c1-4863-b96a-3fe350afea52+12:1983:x1830965173689728:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144852.764900:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4574b85-29c1-4863-b96a-3fe350afea52+12:1983:x1830965173689728:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 21us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144852.764904:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 355 00000100:00100000:0.0:1746144853.468181:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965171842688 00000100:00100000:0.0:1746144853.468186:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965171842688 00000100:00100000:0.0:1746144853.468219:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965171842816 00000100:00100000:0.0:1746144853.468221:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965171842816 00000100:00100000:0.0:1746144853.468431:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965171842560 00000100:00100000:0.0:1746144853.468434:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965171842560 00000100:00100000:0.0:1746144853.468454:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3006 00000100:00100000:0.0:1746144853.468460:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1830965171842688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1746144853.468479:0:10401:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:22 count 1 00002000:00010000:0.0:1746144853.468499:0:10401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 104857600, mtime: 0x68140e4e, atime: 0x0, ctime: 0x68140e4e, blocks: 0x32019 00010000:00010000:0.0:1746144853.468503:0:10401:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727510a57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144853.468512:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144853.468513:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144853.468517:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727510a57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144853.468527:0:10401:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727510a57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144853.468535:0:10401:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727510a57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144853.468540:0:10401:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727510a57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144853.468743:0:10401:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746144853.469218:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3308:x1830965171842688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 757us (1489us total) trans 4294967856 rc 0/0 00000100:00100000:0.0:1746144853.469224:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3006 00000100:00100000:0.0:1746144853.469238:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3008 00000100:00100000:0.0:1746144853.469244:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1830965171842560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1746144853.469255:0:10401:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:23 count 1 00002000:00010000:0.0:1746144853.469269:0:10401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 104857600, mtime: 0x68140e50, atime: 0x0, ctime: 0x68140e50, blocks: 0x32017 00010000:00010000:0.0:1746144853.469274:0:10401:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094376e00/0x4076af6727510a5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144853.469716:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144853.469718:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144853.469720:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094376e00/0x4076af6727510a5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144853.469730:0:10401:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094376e00/0x4076af6727510a5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144853.469736:0:10401:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094376e00/0x4076af6727510a5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144853.469742:0:10401:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094376e00/0x4076af6727510a5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144853.470112:0:10401:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746144853.510895:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1830965171842560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 41647us (42662us total) trans 4294968017 rc 0/0 00000100:00100000:0.0:1746144853.510905:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3008 00000100:00100000:0.0:1746144853.719056:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144853.721576:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144853.730497:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144853.736660:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144853.746532:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144853.746561:0:20492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173691776 00000100:00100000:0.0:1746144853.746567:0:20492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173691776 00000100:00100000:0.0:1746144853.746598:0:20492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48197 00000100:00100000:0.0:1746144853.746604:0:20492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:30931:x1830965173691776:12345-192.168.202.16@tcp:36:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144853.746642:0:20492:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144853.746661:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f2b2400/0x4076af6727510ac0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af905e1 expref: 7 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144853.746673:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff880099b35500) 00010000:00010000:0.0:1746144853.746677:0:20492:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144853.747235:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880094376e00/0x4076af6727510ace lrc: 3/0,1 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144853.747248:0:20492:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23000/0x4076af6727510a88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af905cc expref: 6 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144853.747255:0:20492:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094376e00/0x4076af6727510ace lrc: 4/0,1 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144853.747279:0:20492:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23000/0x4076af6727510a88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af905cc expref: 6 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144853.747289:0:20492:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23000/0x4076af6727510a88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af905cc expref: 6 pid: 20492 timeout: 547 lvb_type: 0 00000100:00100000:0.0:1746144853.747300:0:20492:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b031880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20492:1830965171843072:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144853.747382:0:20492:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144853.752516:0:20492:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b031880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20492:1830965171843072:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144853.752534:0:20492:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880094376e00/0x4076af6727510ace lrc: 3/0,1 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00000100:00100000:0.0:1746144853.752640:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:0.0:1746144853.754626:0:20492:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880094376e00/0x4076af6727510ace lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144853.754635:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094376e00/0x4076af6727510ace lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00000001:00080000:0.0:1746144853.754720:0:20492:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294987468 00000004:00010000:0.0:1746144853.754775:0:20492:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b030380 reply state ffff880092040000 transno 4294987469 ns: mdt-lustre-MDT0000_UUID lock: ffff880094376e00/0x4076af6727510ace lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00000100:00100000:0.0:1746144853.754782:0:20492:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746144853.755243:0:20492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:30931:x1830965173691776:12345-192.168.202.16@tcp:36:rw_seq_cst_vs_d.0 Request processed in 8638us (8715us total) trans 4294987469 rc 0/0 00000100:00100000:0.0:1746144853.755252:0:20492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48197 00000020:00080000:0.0:1746144853.755256:0:20492:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1746144853.758942:0:3292:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880094376e00/0x4076af6727510ace lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144853.758960:0:3292:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880094376e00/0x4076af6727510ace lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144853.758966:0:3292:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880094376e00/0x4076af6727510ace lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144853.758971:0:3292:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094376e00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144853.758974:0:3292:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094376e00/0x4076af6727510ace lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144853.758980:0:3292:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880094376e00/0x4076af6727510ace lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144853.758997:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff880099b35500) 00010000:00010000:0.0:1746144853.759000:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144853.759003:0:3292:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880094376e00/0x4076af6727510ace lrc: 2/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144853.759008:0:3292:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094376e00/0x4076af6727510ace lrc: 0/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00000100:00100000:0.0:1746144853.762097:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144853.764001:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144853.766369:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144853.768374:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144853.772396:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144853.775346:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144853.786620:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144853.789941:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144853.792387:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144853.795057:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144853.942878:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144853.946624:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.032528:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.037744:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.037808:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.037846:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.037874:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173694976 00000100:00100000:0.0:1746144854.037879:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173694976 00000100:00100000:0.0:1746144854.038796:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3015 00000100:00100000:0.0:1746144854.038803:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:30934:x1830965173694976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144854.038815:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144854.038827:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb69c00/0x4076af6727510b14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90620 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.038842:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144854.038846:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099536200/0x4076af6727510b0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90619 expref: 9 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.038852:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144854.038854:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb69c00/0x4076af6727510b14 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90620 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.038878:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099536200/0x4076af6727510b0d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90619 expref: 9 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.038890:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bb69c00/0x4076af6727510b14 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90620 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.038897:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb69c00, rc 0) 00000100:00100000:0.0:1746144854.038918:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:30934:x1830965173694976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 116us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144854.038923:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3015 00000100:00100000:0.0:1746144854.047912:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.050392:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.059023:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.062285:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.066449:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.066501:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.070572:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.070938:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.070969:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.074610:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.074639:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173697024 00000100:00100000:0.0:1746144854.074645:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173697024 00002000:00100000:0.0:1746144854.074672:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093256d80 x1830965173697024/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:495/0 lens 488/0 e 0 to 0 dl 1746144865 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.074681:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256d80 with x1830965173697024 ext(0->4095) 00010000:00010000:0.0:1746144854.074687:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af6727510b22 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9062e expref: 10 pid: 10401 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.074702:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af6727510b22 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9062e expref: 10 pid: 10401 timeout: 548 lvb_type: 0 00002000:00010000:0.0:1746144854.074707:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093256d80 00000100:00100000:0.0:1746144854.075058:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 122 00000100:00100000:0.0:1746144854.075064:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965173697024:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144854.075691:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965173697024:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 627us (1087us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144854.075697:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 122 00002000:00100000:0.0:1746144854.075701:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093256d80 x1830965173697024/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:495/0 lens 488/4536 e 0 to 0 dl 1746144865 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.075709:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256d80 with x1830965173697024 ext(0->4095) 00010000:00010000:0.0:1746144854.075714:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af6727510b22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9062e expref: 10 pid: 10401 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.075724:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af6727510b22 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9062e expref: 10 pid: 10401 timeout: 548 lvb_type: 0 00002000:00010000:0.0:1746144854.075730:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093256d80 00000100:00100000:0.0:1746144854.077195:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.079421:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.084114:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.088345:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173697792 00000100:00100000:0.0:1746144854.088353:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173697792 00000100:00100000:0.0:1746144854.088397:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3019 00000100:00100000:0.0:1746144854.088403:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+11:30934:x1830965173697792:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144854.088416:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144854.088428:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800925b7c00/0x4076af6727510b30 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9063c expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.088448:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144854.088450:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144854.088456:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800925b7c00/0x4076af6727510b30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9063c expref: 12 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.088466:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800925b7c00/0x4076af6727510b30 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9063c expref: 12 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.088474:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925b7c00, rc 0) 00000100:00100000:0.0:1746144854.088521:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+12:30934:x1830965173697792:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 119us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144854.088526:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3019 00000100:00100000:0.0:1746144854.093613:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.094538:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.096903:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.098742:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.098914:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.101857:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.104254:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173699328 00000100:00100000:0.0:1746144854.104265:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173699328 00002000:00100000:0.0:1746144854.104319:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff88012a2b2680 x1830965173699328/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:495/0 lens 496/0 e 0 to 0 dl 1746144865 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.104333:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b2680 with x1830965173699328 ext(0->7) 00010000:00010000:0.0:1746144854.104341:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727510b37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90643 expref: 13 pid: 8432 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.104354:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727510b37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90643 expref: 13 pid: 8432 timeout: 548 lvb_type: 0 00002000:00010000:0.0:1746144854.104360:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012a2b2680 00000100:00100000:0.0:1746144854.104388:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 126 00000100:00100000:0.0:1746144854.104394:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+13:1985:x1830965173699328:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144854.104749:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+15:1985:x1830965173699328:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 Request processed in 354us (586us total) trans 4294968022 rc 0/0 00000100:00100000:0.0:1746144854.104755:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 126 00002000:00100000:0.0:1746144854.104798:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff88012a2b2680 x1830965173699328/t4294968022(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:495/0 lens 496/448 e 0 to 0 dl 1746144865 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.104806:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b2680 with x1830965173699328 ext(0->7) 00010000:00010000:0.0:1746144854.104810:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727510b37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90643 expref: 15 pid: 8432 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.104818:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727510b37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90643 expref: 15 pid: 8432 timeout: 548 lvb_type: 0 00002000:00010000:0.0:1746144854.104823:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012a2b2680 00000100:00100000:0.0:1746144854.110784:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.115134:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.120402:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.120712:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.124461:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173700224 00000100:00100000:0.0:1746144854.124466:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173700224 00002000:00100000:0.0:1746144854.124503:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093e83100 x1830965173700224/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:495/0 lens 488/0 e 0 to 0 dl 1746144865 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.124594:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83100 with x1830965173700224 ext(0->4095) 00010000:00010000:0.0:1746144854.124601:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091708c00/0x4076af6727510b45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90651 expref: 7 pid: 8432 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.124610:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091708c00/0x4076af6727510b45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90651 expref: 7 pid: 8432 timeout: 548 lvb_type: 0 00002000:00010000:0.0:1746144854.124616:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093e83100 00000100:00100000:0.0:1746144854.124631:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 127 00000100:00100000:0.0:1746144854.124637:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1984:x1830965173700224:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144854.125112:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1984:x1830965173700224:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 473us (925us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144854.125119:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 127 00002000:00100000:0.0:1746144854.125123:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093e83100 x1830965173700224/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:495/0 lens 488/4536 e 0 to 0 dl 1746144865 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.125130:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83100 with x1830965173700224 ext(0->4095) 00010000:00010000:0.0:1746144854.125135:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091708c00/0x4076af6727510b45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90651 expref: 7 pid: 8432 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.125147:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091708c00/0x4076af6727510b45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90651 expref: 7 pid: 8432 timeout: 548 lvb_type: 0 00002000:00010000:0.0:1746144854.125152:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093e83100 00000100:00100000:0.0:1746144854.127164:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.130432:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.134382:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.138587:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.143497:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.147885:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.151416:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.151751:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.153753:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.155920:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.161293:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.163934:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.167225:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.169604:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.171839:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.171947:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.175282:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.175321:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.175344:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.178265:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.180455:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.182663:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.185864:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.188092:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.192294:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.198905:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.203632:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.203680:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.203701:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173705472 00000100:00100000:0.0:1746144854.203708:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173705472 00000100:00100000:0.0:1746144854.203751:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3031 00000100:00100000:0.0:1746144854.203757:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+20:30931:x1830965173705472:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144854.203786:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144854.203800:0:8433:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800925b7e00/0x4076af6727510b84 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90690 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.203825:0:8433:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880093f27a00/0x4076af6727510b76 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90682 expref: 21 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.203832:0:8433:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009334b800/0x4076af6727510b7d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90689 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.203837:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144854.203839:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144854.203842:0:8433:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800925b7e00/0x4076af6727510b84 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90690 expref: 21 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.203866:0:8433:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009334b800/0x4076af6727510b7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90689 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.203881:0:8433:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009334b800/0x4076af6727510b7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90689 expref: 6 pid: 10401 timeout: 548 lvb_type: 0 00000100:00100000:0.0:1746144854.203892:0:8433:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801391d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1830965171847680:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144854.203966:0:8433:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880093f27a00/0x4076af6727510b76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90682 expref: 21 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.203973:0:8433:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093f27a00/0x4076af6727510b76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90682 expref: 21 pid: 8433 timeout: 548 lvb_type: 0 00000100:00100000:0.0:1746144854.203981:0:8433:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801391d3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1830965171847808:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144854.203998:0:8433:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144854.206895:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.206939:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.207879:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173705856 00000100:00100000:0.0:1746144854.207882:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173705856 00010000:00010000:0.0:1746144854.207895:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009334b800/0x4076af6727510b7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90689 expref: 7 pid: 10401 timeout: 548 lvb_type: 0 00000100:00100000:0.0:1746144854.207918:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8451 00000100:00100000:0.0:1746144854.207923:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1984:x1830965173705856:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144854.207930:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144854.207938:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009334b800/0x4076af6727510b7d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90689 expref: 7 pid: 10401 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.207949:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009334b800/0x4076af6727510b7d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90689 expref: 7 pid: 10401 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.207960:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009334b800/0x4076af6727510b7d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90689 expref: 7 pid: 10401 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.207982:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144854.207984:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144854.207989:0:7099:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800925b7e00/0x4076af6727510b84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90690 expref: 20 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.207995:0:7099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800925b7e00/0x4076af6727510b84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90690 expref: 20 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.208012:0:7099:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800925b7e00/0x4076af6727510b84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90690 expref: 20 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.208021:0:7099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800925b7e00/0x4076af6727510b84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90690 expref: 20 pid: 8433 timeout: 548 lvb_type: 0 00000100:00100000:0.0:1746144854.208032:0:7099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801391d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965171848064:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144854.208082:0:7099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144854.209814:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.215214:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.218488:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.221864:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.224431:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.226384:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.228917:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.232577:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.238476:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.238934:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.238975:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.240893:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.243906:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.247051:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.249154:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.251866:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.258217:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.259378:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.264976:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.265024:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.268109:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.268147:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.271298:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173710208 00000100:00100000:0.0:1746144854.271315:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173710208 00002000:00100000:0.0:1746144854.271347:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093e83480 x1830965173710208/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:495/0 lens 488/0 e 0 to 0 dl 1746144865 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.271355:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83480 with x1830965173710208 ext(0->4095) 00010000:00010000:0.0:1746144854.271362:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af6727510bae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af906ba expref: 24 pid: 10401 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.271373:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af6727510bae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af906ba expref: 24 pid: 10401 timeout: 548 lvb_type: 0 00002000:00010000:0.0:1746144854.271383:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093e83480 00000100:00100000:0.0:1746144854.271396:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 139 00000100:00100000:0.0:1746144854.271401:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1985:x1830965173710208:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144854.271523:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1985:x1830965173710208:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 121us (281us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144854.271534:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 139 00002000:00100000:0.0:1746144854.271539:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093e83480 x1830965173710208/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:495/0 lens 488/4536 e 0 to 0 dl 1746144865 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.271545:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83480 with x1830965173710208 ext(0->4095) 00010000:00010000:0.0:1746144854.271549:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af6727510bae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af906ba expref: 24 pid: 10401 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.271557:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af6727510bae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af906ba expref: 24 pid: 10401 timeout: 548 lvb_type: 0 00002000:00010000:0.0:1746144854.271562:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093e83480 00000100:00100000:0.0:1746144854.277034:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.280552:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.284566:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.288384:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.290324:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.294667:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.296131:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.301432:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.301718:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.301749:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.305003:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.307449:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.310703:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.313930:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173712896 00000100:00100000:0.0:1746144854.313935:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173712896 00002000:00100000:0.0:1746144854.313961:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88012a2b1500 x1830965173712896/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:495/0 lens 488/0 e 0 to 0 dl 1746144865 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.313969:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b1500 with x1830965173712896 ext(0->4095) 00002000:00010000:0.0:1746144854.313973:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012a2b1500 00000100:00100000:0.0:1746144854.313994:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2614 00000100:00100000:0.0:1746144854.314000:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1983:x1830965173712896:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144854.314124:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1983:x1830965173712896:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 124us (442us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144854.314130:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2614 00002000:00100000:0.0:1746144854.314135:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88012a2b1500 x1830965173712896/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:495/0 lens 488/4536 e 0 to 0 dl 1746144865 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.314141:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b1500 with x1830965173712896 ext(0->4095) 00002000:00010000:0.0:1746144854.314144:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012a2b1500 00000100:00100000:0.0:1746144854.317202:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.319393:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.323740:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.327929:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.327978:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.330977:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.331094:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.331126:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.333751:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.337665:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.340183:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.343119:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.345513:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.349872:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.350350:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.352162:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.353095:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.353527:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.356666:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.360535:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.362752:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.367028:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.370199:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.371999:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.376950:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.377008:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.381689:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.382557:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.383565:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.386388:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.389079:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173718656 00000100:00100000:0.0:1746144854.389086:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173718656 00002000:00100000:0.0:1746144854.389115:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff880093e83b80 x1830965173718656/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:495/0 lens 496/0 e 0 to 0 dl 1746144865 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.389123:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83b80 with x1830965173718656 ext(0->7) 00010000:00010000:0.0:1746144854.389129:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f2b3400/0x4076af6727510c02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9070e expref: 33 pid: 8433 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.389140:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f2b3400/0x4076af6727510c02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9070e expref: 33 pid: 8433 timeout: 548 lvb_type: 0 00002000:00010000:0.0:1746144854.389146:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093e83b80 00000100:00100000:0.0:1746144854.389168:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 149 00000100:00100000:0.0:1746144854.389173:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1984:x1830965173718656:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144854.389448:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1984:x1830965173718656:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 Request processed in 273us (447us total) trans 4294968032 rc 0/0 00000100:00100000:0.0:1746144854.389455:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 149 00002000:00100000:0.0:1746144854.389463:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff880093e83b80 x1830965173718656/t4294968032(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:495/0 lens 496/448 e 0 to 0 dl 1746144865 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.389470:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83b80 with x1830965173718656 ext(0->7) 00010000:00010000:0.0:1746144854.389474:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f2b3400/0x4076af6727510c02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9070e expref: 35 pid: 8433 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.389482:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f2b3400/0x4076af6727510c02 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9070e expref: 35 pid: 8433 timeout: 548 lvb_type: 0 00002000:00010000:0.0:1746144854.389487:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093e83b80 00000100:00100000:0.0:1746144854.397017:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.398635:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.399998:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.401311:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.405474:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.405856:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.405885:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.409874:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.412565:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.415228:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.418232:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.421810:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.424018:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.424821:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.427451:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.427484:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.427511:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.427689:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8475 00000100:00100000:0.0:1746144854.427696:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1985:x1830965173721600:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144854.427703:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144854.427716:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009334b800/0x4076af6727510c25 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90731 expref: 7 pid: 8432 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.427723:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009334b800/0x4076af6727510c25 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90731 expref: 7 pid: 8432 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.427735:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009334b800/0x4076af6727510c25 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90731 expref: 7 pid: 8432 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.427936:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144854.427938:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144854.427945:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af6727510c2c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90738 expref: 36 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.427952:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af6727510c2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90738 expref: 35 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.427981:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af6727510c2c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90738 expref: 36 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144854.428047:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965171853056:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144854.428102:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144854.431364:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.435711:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.440337:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.448824:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.456645:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.457752:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.461483:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.461564:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.463984:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.464023:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.466506:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.468399:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.470562:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.472609:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.474650:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.476210:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.478750:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.482030:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.482082:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.484867:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.484897:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.484925:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.487208:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.490125:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.493418:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.495650:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.498907:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.504150:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.508217:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.509928:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.509980:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173727488 00000100:00100000:0.0:1746144854.509985:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173727488 00002000:00100000:0.0:1746144854.510011:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093fa0e00 x1830965173727488/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:495/0 lens 488/0 e 0 to 0 dl 1746144865 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.510020:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0e00 with x1830965173727488 ext(0->4095) 00010000:00010000:0.0:1746144854.510024:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7b000/0x4076af6727510c5d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90769 expref: 7 pid: 8432 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.510032:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ba7b000/0x4076af6727510c5d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90769 expref: 7 pid: 8432 timeout: 548 lvb_type: 0 00002000:00010000:0.0:1746144854.510041:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093fa0e00 00000100:00100000:0.0:1746144854.510056:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 161 00000100:00100000:0.0:1746144854.510062:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1985:x1830965173727488:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144854.510183:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1985:x1830965173727488:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 121us (255us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144854.510189:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 161 00002000:00100000:0.0:1746144854.510194:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093fa0e00 x1830965173727488/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:495/0 lens 488/4536 e 0 to 0 dl 1746144865 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.510200:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0e00 with x1830965173727488 ext(0->4095) 00010000:00010000:0.0:1746144854.510205:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7b000/0x4076af6727510c5d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90769 expref: 7 pid: 8432 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.510212:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ba7b000/0x4076af6727510c5d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90769 expref: 7 pid: 8432 timeout: 548 lvb_type: 0 00002000:00010000:0.0:1746144854.510217:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093fa0e00 00000100:00100000:0.0:1746144854.512655:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.512684:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.514883:0:8433:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012ce96480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144854.517600:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.532210:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.541398:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.547279:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173728640 00000100:00100000:0.0:1746144854.547289:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173728640 00000100:00100000:0.0:1746144854.547334:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3066 00000100:00100000:0.0:1746144854.547341:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+45:30931:x1830965173728640:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144854.547354:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144854.547367:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800925b7c00/0x4076af6727510c79 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90785 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.548349:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af6727510c72 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9077e expref: 46 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.548357:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144854.548359:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144854.548362:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800925b7c00/0x4076af6727510c79 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90785 expref: 46 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.548388:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af6727510c72 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9077e expref: 46 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.548397:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af6727510c72 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9077e expref: 46 pid: 8433 timeout: 548 lvb_type: 0 00000100:00100000:0.0:1746144854.548407:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093fa1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965171855360:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144854.548454:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144854.552151:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.552325:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.557338:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.559702:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.564334:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.567582:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.570115:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.574055:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.580633:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.580933:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.587509:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.587545:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.587580:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173731072 00000100:00100000:0.0:1746144854.587584:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173731072 00010000:00010000:0.0:1746144854.587607:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af6727510c80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9078c expref: 7 pid: 8432 timeout: 548 lvb_type: 0 00000100:00100000:0.0:1746144854.587628:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173730944 00000100:00100000:0.0:1746144854.587629:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173730944 00010000:00010000:0.0:1746144854.587636:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a400/0x4076af6727510c87 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90793 expref: 48 pid: 8432 timeout: 548 lvb_type: 0 00000100:00100000:0.0:1746144854.587659:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8488 00000100:00100000:0.0:1746144854.587664:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1983:x1830965173731072:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144854.587674:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144854.587690:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af6727510c80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9078c expref: 7 pid: 8432 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.587698:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af6727510c80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9078c expref: 7 pid: 8432 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.587715:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af6727510c80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9078c expref: 7 pid: 8432 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.587732:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144854.587746:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965173731072:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 82us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144854.587751:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8488 00000100:00100000:0.0:1746144854.587760:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8489 00000100:00100000:0.0:1746144854.587786:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+47:1983:x1830965173730944:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144854.587791:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144854.587797:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a400/0x4076af6727510c87 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90793 expref: 47 pid: 8432 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.587806:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a400/0x4076af6727510c87 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90793 expref: 47 pid: 8432 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.587816:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a400/0x4076af6727510c87 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90793 expref: 47 pid: 8432 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.587824:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144854.587825:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144854.587831:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad31e00/0x4076af6727510c8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9079a expref: 46 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.589069:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad31e00/0x4076af6727510c8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9079a expref: 46 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144854.589102:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad31e00/0x4076af6727510c8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9079a expref: 46 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144854.589116:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bbc4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965171856128:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144854.589194:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144854.590135:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.592835:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.599841:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.610854:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.613201:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.614889:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.615078:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173732224 00000100:00100000:0.0:1746144854.615082:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173732224 00002000:00100000:0.0:1746144854.615108:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009bbc7100 x1830965173732224/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:495/0 lens 488/0 e 0 to 0 dl 1746144865 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.615120:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc7100 with x1830965173732224 ext(0->4095) 00010000:00010000:0.0:1746144854.615126:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f2b2400/0x4076af6727510c95 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af907a1 expref: 50 pid: 8433 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.615135:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f2b2400/0x4076af6727510c95 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af907a1 expref: 50 pid: 8433 timeout: 548 lvb_type: 0 00002000:00010000:0.0:1746144854.615141:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bbc7100 00000100:00100000:0.0:1746144854.615153:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 170 00000100:00100000:0.0:1746144854.615158:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1984:x1830965173732224:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144854.615522:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+49:1984:x1830965173732224:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 362us (631us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144854.615531:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 170 00002000:00100000:0.0:1746144854.615536:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009bbc7100 x1830965173732224/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:495/0 lens 488/4536 e 0 to 0 dl 1746144865 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.615544:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc7100 with x1830965173732224 ext(0->4095) 00010000:00010000:0.0:1746144854.615548:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f2b2400/0x4076af6727510c95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af907a1 expref: 49 pid: 8433 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.615556:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f2b2400/0x4076af6727510c95 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af907a1 expref: 49 pid: 8433 timeout: 548 lvb_type: 0 00002000:00010000:0.0:1746144854.615561:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bbc7100 00000100:00100000:0.0:1746144854.618879:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.619641:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.624675:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.630150:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.633755:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.636554:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.638484:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.640905:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.642898:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.646260:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.650388:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.650600:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.651164:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.651176:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173734528 00000100:00100000:0.0:1746144854.651179:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173734528 00010000:00010000:0.0:1746144854.651191:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091709c00/0x4076af6727510caa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af907b6 expref: 51 pid: 8433 timeout: 548 lvb_type: 0 00000100:00100000:0.0:1746144854.653485:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.655867:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.657466:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.662493:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.663846:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.672003:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.681201:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.681235:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.681270:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.683736:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.687903:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.704069:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.707374:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.708229:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.711793:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.711857:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.715539:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.724535:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.734709:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.741555:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.748941:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173739776 00000100:00100000:0.0:1746144854.748949:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173739776 00002000:00100000:0.0:1746144854.748979:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093e82300 x1830965173739776/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:495/0 lens 488/0 e 0 to 0 dl 1746144865 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.748988:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82300 with x1830965173739776 ext(0->4095) 00002000:00010000:0.0:1746144854.748993:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e82300 00000100:00100000:0.0:1746144854.749014:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2642 00000100:00100000:0.0:1746144854.749019:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1983:x1830965173739776:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144854.749159:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1983:x1830965173739776:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 139us (532us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144854.749166:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2642 00002000:00100000:0.0:1746144854.749171:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093e82300 x1830965173739776/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:495/0 lens 488/4536 e 0 to 0 dl 1746144865 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144854.749177:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82300 with x1830965173739776 ext(0->4095) 00002000:00010000:0.0:1746144854.749180:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e82300 00000100:00100000:0.0:1746144854.752243:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.754732:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.754806:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.758164:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.760890:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.766090:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.769367:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.771193:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.773665:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.778345:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.780396:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.780707:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.784337:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.784459:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173742208 00000100:00100000:0.0:1746144854.784464:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173742208 00010000:00010000:0.0:1746144854.784481:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009334be00/0x4076af6727510cf0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af907fc expref: 59 pid: 8433 timeout: 548 lvb_type: 0 00000100:00100000:0.0:1746144854.784494:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173742464 00000100:00100000:0.0:1746144854.784495:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173742464 00010000:00010000:0.0:1746144854.784503:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009334b800/0x4076af6727510cf7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90803 expref: 7 pid: 8433 timeout: 548 lvb_type: 0 00000100:00100000:0.0:1746144854.784514:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8504 00000100:00100000:0.0:1746144854.784519:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1982:x1830965173742208:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144854.784527:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144854.784545:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009334be00/0x4076af6727510cf0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af907fc expref: 60 pid: 8433 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.784553:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009334be00/0x4076af6727510cf0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af907fc expref: 60 pid: 8433 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.784569:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009334be00/0x4076af6727510cf0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af907fc expref: 61 pid: 8433 timeout: 548 lvb_type: 0 00010000:00010000:0.0:1746144854.784744:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144854.784796:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1982:x1830965173742208:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 276us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144854.784801:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8504 00000100:00100000:0.0:1746144854.786733:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.788728:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.791809:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.794706:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.796273:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.798116:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.800896:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.804047:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.804712:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.805147:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.808486:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.811088:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.815907:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.819308:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.823060:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.823833:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.825547:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.825583:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.827261:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.827423:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.829664:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.831560:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.833818:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.836959:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.840625:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.845437:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.849921:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.854415:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.860122:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.864922:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.872239:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.879280:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.879390:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.882394:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.885035:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.887746:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.892940:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.895389:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.901971:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.907496:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.911792:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.912001:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.915275:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.931583:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.932452:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.934976:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.940612:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.943335:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.943413:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.946361:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.953965:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.955972:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.958790:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.961322:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.964044:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.970906:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.974157:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.979014:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.979529:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.980098:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.982531:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.990232:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144854.998464:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.001055:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.001419:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.003072:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.005677:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.007726:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.009395:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.017444:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.020876:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.022314:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.024533:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.024833:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.027478:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.027521:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.030093:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.032137:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.038352:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.040383:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.043095:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.049274:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.050053:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.052321:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.053591:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.053633:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.053819:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8531 00000100:00100000:0.0:1746144855.053825:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+80:1985:x1830965173759616:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144855.053834:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144855.053841:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a400/0x4076af6727510dad lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af908b9 expref: 80 pid: 10401 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.053850:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a400/0x4076af6727510dad lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af908b9 expref: 80 pid: 10401 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.053865:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a400/0x4076af6727510dad lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af908b9 expref: 80 pid: 10401 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.053887:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144855.053907:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+79:1985:x1830965173759616:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 83us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144855.053911:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8531 00000100:00100000:0.0:1746144855.056389:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.058111:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.059824:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.062894:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.064810:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.066064:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.070044:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.071961:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.075036:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.075058:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.075081:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.075137:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8533 00000100:00100000:0.0:1746144855.075145:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1985:x1830965173762048:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144855.075154:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144855.075170:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd400/0x4076af6727510dbb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af908c7 expref: 82 pid: 8433 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.075186:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd400/0x4076af6727510dbb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af908c7 expref: 82 pid: 8433 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.075201:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144855.075224:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1985:x1830965173762048:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 80us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144855.075230:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8533 00000100:00100000:0.0:1746144855.077684:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.081412:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.084556:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.092037:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.094891:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.096826:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.100063:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.103710:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.104044:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.104479:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.107356:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.109794:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.111380:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.116275:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.118171:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.119625:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.126145:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.129725:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.131566:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173765888 00000100:00100000:0.0:1746144855.131570:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173765888 00002000:00100000:0.0:1746144855.131592:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88013612df80 x1830965173765888/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:496/0 lens 488/0 e 0 to 0 dl 1746144866 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.131601:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612df80 with x1830965173765888 ext(0->4095) 00010000:00010000:0.0:1746144855.131607:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727510dec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af908f8 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.131616:0:31844:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727510dec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af908f8 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144855.131622:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013612df80 00000100:00100000:0.0:1746144855.131693:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 214 00000100:00100000:0.0:1746144855.131704:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1984:x1830965173765888:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144855.132526:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1984:x1830965173765888:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 826us (1041us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144855.132533:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 214 00002000:00100000:0.0:1746144855.132538:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88013612df80 x1830965173765888/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:496/0 lens 488/4536 e 0 to 0 dl 1746144866 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.132546:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612df80 with x1830965173765888 ext(0->4095) 00010000:00010000:0.0:1746144855.132551:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727510dec lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af908f8 expref: 7 pid: 10401 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.132560:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727510dec lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af908f8 expref: 7 pid: 10401 timeout: 549 lvb_type: 0 00002000:00010000:0.0:1746144855.132566:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013612df80 00000100:00100000:0.0:1746144855.136508:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.136555:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.138523:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.142394:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.145195:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.148077:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.151180:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.153752:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.155557:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.161464:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.165133:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.165217:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.169583:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.169632:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.171526:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.174277:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.179226:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.182851:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.185146:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.187645:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.190076:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.191065:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173770240 00000100:00100000:0.0:1746144855.191069:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173770240 00002000:00100000:0.0:1746144855.191090:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88013612ce00 x1830965173770240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:496/0 lens 488/0 e 0 to 0 dl 1746144866 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.191103:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ce00 with x1830965173770240 ext(0->4095) 00010000:00010000:0.0:1746144855.191108:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a400/0x4076af6727510e0f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9091b expref: 90 pid: 8432 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.191117:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a400/0x4076af6727510e0f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9091b expref: 90 pid: 8432 timeout: 549 lvb_type: 0 00002000:00010000:0.0:1746144855.191127:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013612ce00 00000100:00100000:0.0:1746144855.191422:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 220 00000100:00100000:0.0:1746144855.191429:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965173770240:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144855.191563:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965173770240:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 134us (704us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144855.191569:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 220 00002000:00100000:0.0:1746144855.191575:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88013612ce00 x1830965173770240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:496/0 lens 488/4536 e 0 to 0 dl 1746144866 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.191581:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ce00 with x1830965173770240 ext(0->4095) 00010000:00010000:0.0:1746144855.191586:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a400/0x4076af6727510e0f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9091b expref: 90 pid: 8432 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.191593:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a400/0x4076af6727510e0f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9091b expref: 90 pid: 8432 timeout: 549 lvb_type: 0 00002000:00010000:0.0:1746144855.191598:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013612ce00 00000100:00100000:0.0:1746144855.193159:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.193195:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.194228:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.195576:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.196907:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965171868928:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144855.196922:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091708600/0x4076af6727510e24 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90930 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.196933:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091708600, rc 0) 00000100:00100000:0.0:1746144855.196961:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:30934:x1830965173770624:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2623us (2734us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144855.196967:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3127 00000100:00100000:0.0:1746144855.197507:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.199459:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.201857:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.203785:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.207000:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.212590:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.212646:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.217208:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.217242:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.217274:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.218009:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e83800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965171869184:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144855.218016:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e80a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965171869312:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144855.218028:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091709c00/0x4076af6727510e32 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 8 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9093e expref: 93 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.218135:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091709c00, rc 0) 00000100:00100000:0.0:1746144855.218175:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+92:30931:x1830965173772288:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4581us (5592us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144855.218179:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3129 00000100:00100000:0.0:1746144855.222261:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.224245:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.228491:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.232903:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.234730:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.237214:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.240625:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.246918:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.250041:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.250509:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.250590:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.253369:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.261626:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.266419:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.270471:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.273552:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.274883:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3134 00000100:00100000:0.0:1746144855.274892:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965173775744:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144855.274906:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144855.274921:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094376e00/0x4076af6727510e55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90961 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.274945:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.274947:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.274952:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094376e00/0x4076af6727510e55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90961 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.274964:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094376e00/0x4076af6727510e55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90961 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.274972:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094376e00, rc 0) 00000100:00100000:0.0:1746144855.275024:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:30934:x1830965173775744:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 133us (1478us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144855.275030:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3134 00000100:00100000:0.0:1746144855.277143:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.280612:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.285135:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.285159:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.285863:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.289616:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.291965:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.295580:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.297887:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.300407:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.301848:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.307456:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.310628:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.310675:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.313345:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.314273:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.314316:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.318269:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.321629:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.325454:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.327619:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.329944:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.331930:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.335911:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.341048:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.344323:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.344365:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.344793:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.356226:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.361559:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.363916:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.369725:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.370184:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.371634:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.374943:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.379637:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.382945:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.385322:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.387216:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.390528:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.396118:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.398654:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.399684:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.399756:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.401815:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.403392:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.411981:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.415096:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.417383:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.421223:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.423978:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.428078:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.429213:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173786112 00000100:00100000:0.0:1746144855.429216:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173786112 00010000:00010000:0.0:1746144855.429233:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd200/0x4076af6727510eb0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af909bc expref: 105 pid: 10401 timeout: 549 lvb_type: 0 00000100:00100000:0.0:1746144855.429252:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8569 00000100:00100000:0.0:1746144855.429257:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+105:1985:x1830965173786112:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144855.429263:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144855.429450:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd200/0x4076af6727510eb0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af909bc expref: 105 pid: 10401 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.429459:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd200/0x4076af6727510eb0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af909bc expref: 105 pid: 10401 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.429471:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd200/0x4076af6727510eb0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af909bc expref: 105 pid: 10401 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.429481:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.429483:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.429488:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727510ebe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af909ca expref: 104 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.429494:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727510ebe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af909ca expref: 104 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.429513:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727510ebe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af909ca expref: 104 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.429522:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727510ebe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af909ca expref: 104 pid: 10401 timeout: 549 lvb_type: 0 00000100:00100000:0.0:1746144855.429530:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b030700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965171873920:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144855.429575:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144855.438994:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.442754:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.451971:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.456788:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173787520 00000100:00100000:0.0:1746144855.456796:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173787520 00002000:00100000:0.0:1746144855.456828:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093e80a80 x1830965173787520/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:496/0 lens 488/0 e 0 to 0 dl 1746144866 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.456836:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e80a80 with x1830965173787520 ext(0->4095) 00002000:00010000:0.0:1746144855.456841:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e80a80 00000100:00100000:0.0:1746144855.456892:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2701 00000100:00100000:0.0:1746144855.456899:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+106:1984:x1830965173787520:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144855.457036:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+106:1984:x1830965173787520:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 138us (404us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144855.457043:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2701 00002000:00100000:0.0:1746144855.457047:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093e80a80 x1830965173787520/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:496/0 lens 488/4536 e 0 to 0 dl 1746144866 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.457053:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e80a80 with x1830965173787520 ext(0->4095) 00002000:00010000:0.0:1746144855.457056:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093e80a80 00000100:00100000:0.0:1746144855.460640:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.461204:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.466449:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.466751:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.466809:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.470117:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.472308:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.476593:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.480546:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.484100:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965171875584 00000100:00100000:0.0:1746144855.484106:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965171875584 00000100:00100000:0.0:1746144855.484144:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1746144855.484149:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1830965171875584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746144855.484167:0:8434:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 768278528 pending 86900736 free 3751804928 avail 3749707776 00000100:00100000:0.0:1746144855.484203:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1830965171875584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144855.484208:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1746144855.485509:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.489217:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.489991:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.499156:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.506681:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.512342:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.517243:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.523719:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.523749:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.526358:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.526437:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.528311:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.533729:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173792384 00000100:00100000:0.0:1746144855.533737:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173792384 00002000:00100000:0.0:1746144855.533793:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff880093f45c00 x1830965173792384/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:496/0 lens 496/0 e 0 to 0 dl 1746144866 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.533803:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f45c00 with x1830965173792384 ext(0->7) 00010000:00010000:0.0:1746144855.533810:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800918d6c00/0x4076af6727510efd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a09 expref: 110 pid: 8430 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.533822:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800918d6c00/0x4076af6727510efd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a09 expref: 110 pid: 8430 timeout: 549 lvb_type: 0 00002000:00010000:0.0:1746144855.533828:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f45c00 00000100:00100000:0.0:1746144855.533846:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 247 00000100:00100000:0.0:1746144855.533852:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+110:1982:x1830965173792384:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144855.534118:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+112:1982:x1830965173792384:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 Request processed in 265us (471us total) trans 4294968071 rc 0/0 00000100:00100000:0.0:1746144855.534124:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 247 00002000:00100000:0.0:1746144855.534130:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff880093f45c00 x1830965173792384/t4294968071(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:496/0 lens 496/448 e 0 to 0 dl 1746144866 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.534136:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f45c00 with x1830965173792384 ext(0->7) 00010000:00010000:0.0:1746144855.534141:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800918d6c00/0x4076af6727510efd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a09 expref: 112 pid: 8430 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.534148:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800918d6c00/0x4076af6727510efd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a09 expref: 112 pid: 8430 timeout: 549 lvb_type: 0 00002000:00010000:0.0:1746144855.534153:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f45c00 00000100:00100000:0.0:1746144855.536899:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.540814:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f09880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965171876864:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144855.540828:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144855.540861:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+111:1984:x1830965173792512:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3805us (3969us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144855.540868:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8579 00000100:00100000:0.0:1746144855.542815:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.544199:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.552662:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.555362:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.555701:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:0.0:1746144855.556016:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918d7400/0x4076af6727510f04 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a10 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.556117:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918d7400/0x4076af6727510f04 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a10 expref: 7 pid: 8430 timeout: 549 lvb_type: 0 00000100:00100000:0.0:1746144855.556131:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093857b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965171877120:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144855.556165:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144855.558396:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.559801:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.562312:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.565194:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.568934:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.574733:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.578991:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.581917:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.584475:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.590263:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.595788:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.595977:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.595993:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173795968 00000100:00100000:0.0:1746144855.595998:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173795968 00010000:00010000:0.0:1746144855.596021:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbca00/0x4076af6727510f20 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a2c expref: 7 pid: 8430 timeout: 549 lvb_type: 0 00000100:00100000:0.0:1746144855.596037:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173796096 00000100:00100000:0.0:1746144855.596039:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173796096 00010000:00010000:0.0:1746144855.596047:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727510f19 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a25 expref: 115 pid: 8430 timeout: 549 lvb_type: 0 00000100:00100000:0.0:1746144855.596060:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8583 00000100:00100000:0.0:1746144855.596065:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d367480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1985:x1830965173795968:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144855.596077:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144855.601713:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.604815:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.607431:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.611687:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.614523:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.618865:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.625475:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.634230:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173798016 00000100:00100000:0.0:1746144855.634239:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173798016 00002000:00100000:0.0:1746144855.634280:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009bb4a300 x1830965173798016/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:496/0 lens 488/0 e 0 to 0 dl 1746144866 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.634300:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4a300 with x1830965173798016 ext(0->4095) 00002000:00010000:0.0:1746144855.634305:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb4a300 00000100:00100000:0.0:1746144855.634337:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2714 00000100:00100000:0.0:1746144855.634343:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1983:x1830965173798016:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144855.634507:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1983:x1830965173798016:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 163us (1785us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144855.634513:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2714 00002000:00100000:0.0:1746144855.634518:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009bb4a300 x1830965173798016/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:496/0 lens 488/4536 e 0 to 0 dl 1746144866 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.634524:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4a300 with x1830965173798016 ext(0->4095) 00002000:00010000:0.0:1746144855.634526:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb4a300 00000100:00100000:0.0:1746144855.635142:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.640397:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.640427:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.654119:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.662212:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.662241:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173799168 00000100:00100000:0.0:1746144855.662249:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173799168 00010000:00010000:0.0:1746144855.662277:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd200/0x4076af6727510f3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a48 expref: 119 pid: 8433 timeout: 549 lvb_type: 0 00000100:00100000:0.0:1746144855.662328:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8588 00000100:00100000:0.0:1746144855.662335:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+119:1985:x1830965173799168:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144855.662347:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144855.662366:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd200/0x4076af6727510f3c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a48 expref: 119 pid: 8433 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.662377:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd200/0x4076af6727510f3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a48 expref: 119 pid: 8433 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.662398:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd200/0x4076af6727510f3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a48 expref: 119 pid: 8433 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.662415:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.662417:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.662423:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7b800/0x4076af6727510f43 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a4f expref: 118 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.662429:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba7b800/0x4076af6727510f43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a4f expref: 118 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.662460:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ba7b800/0x4076af6727510f43 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a4f expref: 118 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144855.662471:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092587800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965171878784:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144855.663367:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144855.665831:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173799424 00000100:00100000:0.0:1746144855.665836:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173799424 00002000:00100000:0.0:1746144855.665865:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880135ea5f80 x1830965173799424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:496/0 lens 488/0 e 0 to 0 dl 1746144866 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.665873:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5f80 with x1830965173799424 ext(0->4095) 00002000:00010000:0.0:1746144855.665878:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ea5f80 00000100:00100000:0.0:1746144855.666004:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2715 00000100:00100000:0.0:1746144855.666011:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+118:1984:x1830965173799424:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144855.666156:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+118:1984:x1830965173799424:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 145us (499us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144855.666161:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2715 00002000:00100000:0.0:1746144855.666166:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880135ea5f80 x1830965173799424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:496/0 lens 488/4536 e 0 to 0 dl 1746144866 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.666172:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5f80 with x1830965173799424 ext(0->4095) 00002000:00010000:0.0:1746144855.666175:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ea5f80 00000100:00100000:0.0:1746144855.670245:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.674432:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.674549:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.679915:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173800192 00000100:00100000:0.0:1746144855.679923:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173800192 00002000:00100000:0.0:1746144855.679956:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880135ea5180 x1830965173800192/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:496/0 lens 488/0 e 0 to 0 dl 1746144866 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.679972:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5180 with x1830965173800192 ext(0->4095) 00010000:00010000:0.0:1746144855.679980:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7b800/0x4076af6727510f43 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a4f expref: 120 pid: 8433 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.679990:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ba7b800/0x4076af6727510f43 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a4f expref: 120 pid: 8433 timeout: 549 lvb_type: 0 00002000:00010000:0.0:1746144855.679995:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135ea5180 00000100:00100000:0.0:1746144855.680013:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 255 00000100:00100000:0.0:1746144855.680019:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+120:1985:x1830965173800192:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144855.680708:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+119:1985:x1830965173800192:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 688us (984us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144855.680714:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 255 00002000:00100000:0.0:1746144855.680719:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880135ea5180 x1830965173800192/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:496/0 lens 488/4536 e 0 to 0 dl 1746144866 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.680949:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5180 with x1830965173800192 ext(0->4095) 00010000:00010000:0.0:1746144855.680955:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7b800/0x4076af6727510f43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a4f expref: 119 pid: 8433 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.680964:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ba7b800/0x4076af6727510f43 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a4f expref: 119 pid: 8433 timeout: 549 lvb_type: 0 00002000:00010000:0.0:1746144855.680974:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135ea5180 00000100:00100000:0.0:1746144855.682390:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.682429:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.686645:0:8433:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb48700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1830965171879168:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144855.686662:0:8433:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a400/0x4076af6727510f58 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a64 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.686675:0:8433:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7a400, rc 0) 00000100:00100000:0.0:1746144855.687139:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:30934:x1830965173800576:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4336us (4708us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144855.687441:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3171 00000100:00100000:0.0:1746144855.688011:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173800832 00000100:00100000:0.0:1746144855.688016:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173800832 00002000:00100000:0.0:1746144855.688050:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009bb4aa00 x1830965173800832/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:496/0 lens 488/0 e 0 to 0 dl 1746144866 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.688059:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4aa00 with x1830965173800832 ext(0->4095) 00010000:00010000:0.0:1746144855.688065:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a200/0x4076af6727510f51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a5d expref: 118 pid: 8433 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.688077:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a200/0x4076af6727510f51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a5d expref: 118 pid: 8433 timeout: 549 lvb_type: 0 00002000:00010000:0.0:1746144855.688083:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb4aa00 00000100:00100000:0.0:1746144855.688108:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 256 00000100:00100000:0.0:1746144855.688114:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+118:1984:x1830965173800832:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144855.689149:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+118:1984:x1830965173800832:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 1032us (1438us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144855.689156:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 256 00002000:00100000:0.0:1746144855.689162:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009bb4aa00 x1830965173800832/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:496/0 lens 488/4536 e 0 to 0 dl 1746144866 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.689170:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4aa00 with x1830965173800832 ext(0->4095) 00010000:00010000:0.0:1746144855.689175:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a200/0x4076af6727510f51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a5d expref: 118 pid: 8433 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.689184:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a200/0x4076af6727510f51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a5d expref: 118 pid: 8433 timeout: 549 lvb_type: 0 00002000:00010000:0.0:1746144855.689189:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb4aa00 00000100:00100000:0.0:1746144855.691893:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.696096:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.700056:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.711257:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.714907:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173801728 00000100:00100000:0.0:1746144855.714914:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173801728 00000100:00100000:0.0:1746144855.714953:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3173 00000100:00100000:0.0:1746144855.714960:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+120:30931:x1830965173801728:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144855.714974:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144855.714986:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094377000/0x4076af6727510f66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90a72 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.715070:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a400/0x4076af6727510f58 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a64 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.715079:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7bc00/0x4076af6727510f5f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a6b expref: 121 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.715085:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.715086:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.715089:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094377000/0x4076af6727510f66 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a72 expref: 121 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.715114:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ba7bc00/0x4076af6727510f5f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a6b expref: 121 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.715123:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ba7bc00/0x4076af6727510f5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a6b expref: 121 pid: 8433 timeout: 549 lvb_type: 0 00000100:00100000:0.0:1746144855.715133:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093254700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965171879552:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144855.715537:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a400/0x4076af6727510f58 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a64 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.715545:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ba7a400/0x4076af6727510f58 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a64 expref: 6 pid: 8433 timeout: 549 lvb_type: 0 00000100:00100000:0.0:1746144855.715553:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965171879680:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144855.715574:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144855.719003:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.719739:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.721611:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173802112 00000100:00100000:0.0:1746144855.721615:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173802112 00002000:00100000:0.0:1746144855.721638:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800925a8e00 x1830965173802112/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:496/0 lens 488/0 e 0 to 0 dl 1746144866 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.721647:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a8e00 with x1830965173802112 ext(0->4095) 00010000:00010000:0.0:1746144855.721652:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7bc00/0x4076af6727510f5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a6b expref: 121 pid: 8433 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.721661:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ba7bc00/0x4076af6727510f5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a6b expref: 121 pid: 8433 timeout: 549 lvb_type: 0 00002000:00010000:0.0:1746144855.721666:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800925a8e00 00000100:00100000:0.0:1746144855.721676:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 258 00000100:00100000:0.0:1746144855.721680:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+121:1985:x1830965173802112:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144855.721799:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+121:1985:x1830965173802112:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 118us (2061us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144855.721804:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 258 00002000:00100000:0.0:1746144855.721808:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800925a8e00 x1830965173802112/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:496/0 lens 488/4536 e 0 to 0 dl 1746144866 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.721815:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a8e00 with x1830965173802112 ext(0->4095) 00010000:00010000:0.0:1746144855.721818:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7bc00/0x4076af6727510f5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a6b expref: 121 pid: 8433 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.721826:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ba7bc00/0x4076af6727510f5f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a6b expref: 121 pid: 8433 timeout: 549 lvb_type: 0 00002000:00010000:0.0:1746144855.721835:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800925a8e00 00000100:00100000:0.0:1746144855.726440:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.732748:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.739404:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.752659:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.755401:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.758143:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.759213:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.763236:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.763267:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173803904 00000100:00100000:0.0:1746144855.763273:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173803904 00002000:00100000:0.0:1746144855.763316:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8801358ef100 x1830965173803904/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:496/0 lens 488/0 e 0 to 0 dl 1746144866 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.763326:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358ef100 with x1830965173803904 ext(0->4095) 00010000:00010000:0.0:1746144855.763332:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbbc400/0x4076af6727510f74 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a80 expref: 124 pid: 8430 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.763344:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbbc400/0x4076af6727510f74 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a80 expref: 124 pid: 8430 timeout: 549 lvb_type: 0 00002000:00010000:0.0:1746144855.763350:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801358ef100 00000100:00100000:0.0:1746144855.763377:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 262 00000100:00100000:0.0:1746144855.763383:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+124:1984:x1830965173803904:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144855.763852:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+124:1984:x1830965173803904:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 468us (622us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144855.763862:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 262 00002000:00100000:0.0:1746144855.763868:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8801358ef100 x1830965173803904/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:496/0 lens 488/4536 e 0 to 0 dl 1746144866 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144855.763875:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358ef100 with x1830965173803904 ext(0->4095) 00010000:00010000:0.0:1746144855.763880:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012dbbc400/0x4076af6727510f74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a80 expref: 123 pid: 8430 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.763888:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012dbbc400/0x4076af6727510f74 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a80 expref: 123 pid: 8430 timeout: 549 lvb_type: 0 00002000:00010000:0.0:1746144855.763894:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801358ef100 00000100:00100000:0.0:1746144855.765533:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.776033:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.783969:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.787332:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173804800 00000100:00100000:0.0:1746144855.787337:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173804800 00000100:00100000:0.0:1746144855.787366:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3178 00000100:00100000:0.0:1746144855.787372:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+124:30931:x1830965173804800:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144855.787379:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144855.787385:0:8433:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a4a6b400/0x4076af6727510f89 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90a95 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.787413:0:8433:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd200/0x4076af6727510f7b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a87 expref: 125 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.787426:0:8433:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbbc200/0x4076af6727510f82 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a8e expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.787431:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.787433:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.787435:0:8433:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a4a6b400/0x4076af6727510f89 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a95 expref: 125 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.787740:0:8433:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbbc200/0x4076af6727510f82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a8e expref: 7 pid: 8430 timeout: 549 lvb_type: 0 00010000:00010000:0.0:1746144855.787749:0:8433:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbbc200/0x4076af6727510f82 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a8e expref: 7 pid: 8430 timeout: 549 lvb_type: 0 00000100:00100000:0.0:1746144855.787760:0:8433:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135eaa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1830965171880704:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144855.787834:0:8433:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd200/0x4076af6727510f7b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a87 expref: 125 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.787842:0:8433:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd200/0x4076af6727510f7b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90a87 expref: 125 pid: 8430 timeout: 549 lvb_type: 0 00000100:00100000:0.0:1746144855.787849:0:8433:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1830965171880832:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144855.787864:0:8433:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144855.791474:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.791546:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.798155:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.801574:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.805972:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.808237:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.814721:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.818176:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.820761:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.822389:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.824584:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.828018:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.830681:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.833113:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.837971:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.842423:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.845082:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.849833:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.860914:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173808384 00000100:00100000:0.0:1746144855.860918:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173808384 00010000:00010000:0.0:1746144855.860932:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba7b800/0x4076af6727510f9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90aa3 expref: 129 pid: 8430 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144855.860949:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173808640 00000100:00100000:0.0:1746144855.860951:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173808640 00010000:00010000:0.0:1746144855.860957:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727510fa5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ab1 expref: 9 pid: 8433 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144855.860971:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8602 00000100:00100000:0.0:1746144855.860975:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+129:1985:x1830965173808384:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144855.860981:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144855.860996:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ba7b800/0x4076af6727510f9e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90aa3 expref: 129 pid: 8430 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.861008:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ba7b800/0x4076af6727510f9e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90aa3 expref: 129 pid: 8430 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.861023:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7b800/0x4076af6727510f9e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90aa3 expref: 129 pid: 8430 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.861035:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144855.861064:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+128:1985:x1830965173808384:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 89us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144855.861069:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8602 00000100:00100000:0.0:1746144855.861080:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8603 00000100:00100000:0.0:1746144855.861083:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1985:x1830965173808640:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144855.861087:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144855.861092:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727510fa5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ab1 expref: 9 pid: 8433 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.861099:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727510fa5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ab1 expref: 9 pid: 8433 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.861107:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727510fa5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ab1 expref: 9 pid: 8433 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.861113:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.861114:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.861118:0:7099:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbbca00/0x4076af6727510fac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ab8 expref: 127 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.861128:0:7099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbca00/0x4076af6727510fac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ab8 expref: 127 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.861143:0:7099:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbbca00/0x4076af6727510fac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ab8 expref: 127 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.861151:0:7099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbbca00/0x4076af6727510fac lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ab8 expref: 127 pid: 8433 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144855.861160:0:7099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f73480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965171882112:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144855.861192:0:7099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144855.864207:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.867308:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.880856:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.881473:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.886308:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.888578:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.891591:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.897999:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.906882:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.912175:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.912198:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173810432 00000100:00100000:0.0:1746144855.912205:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173810432 00010000:00010000:0.0:1746144855.912908:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727510fba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ac6 expref: 132 pid: 8433 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144855.912942:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8606 00000100:00100000:0.0:1746144855.912948:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+132:1985:x1830965173810432:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144855.912959:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144855.912988:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727510fba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ac6 expref: 132 pid: 8433 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.912998:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727510fba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ac6 expref: 132 pid: 8433 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.913017:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727510fba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ac6 expref: 132 pid: 8433 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.913032:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.913034:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.913040:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af6727510fc1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90acd expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.913047:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af6727510fc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90acd expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.913084:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af6727510fc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90acd expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144855.913096:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ed500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965171882880:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144855.913161:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144855.914306:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.914703:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ed500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965171882880:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144855.914717:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144855.914743:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+131:1985:x1830965173810432:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1795us (2572us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144855.914751:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8606 00000100:00100000:0.0:1746144855.915195:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.919020:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965171883008:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144855.919041:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918d7200/0x4076af6727510fc8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ad4 expref: 132 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.919055:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918d7200, rc 0) 00000100:00100000:0.0:1746144855.919085:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+132:30931:x1830965173810560:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3397us (4781us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144855.919092:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3187 00000100:00100000:0.0:1746144855.919109:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173811072 00000100:00100000:0.0:1746144855.919113:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173811072 00000100:00100000:0.0:1746144855.919139:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3188 00000100:00100000:0.0:1746144855.919144:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+132:30934:x1830965173811072:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144855.919153:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144855.919161:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091709c00/0x4076af6727510fcf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90adb expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.919176:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.919179:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918d7200/0x4076af6727510fc8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ad4 expref: 133 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.919189:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144855.919192:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091709c00/0x4076af6727510fcf lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90adb expref: 133 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.919212:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918d7200/0x4076af6727510fc8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ad4 expref: 133 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.919219:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091709c00/0x4076af6727510fcf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90adb expref: 133 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.919225:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091709c00, rc 0) 00000100:00100000:0.0:1746144855.919238:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+133:30934:x1830965173811072:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 93us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144855.919242:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3188 00000100:00100000:0.0:1746144855.919257:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173810944 00000100:00100000:0.0:1746144855.919260:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173810944 00010000:00010000:0.0:1746144855.919270:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af6727510fc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90acd expref: 7 pid: 20722 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144855.919285:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8607 00000100:00100000:0.0:1746144855.919421:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1984:x1830965173810944:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144855.919427:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144855.919441:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af6727510fc1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90acd expref: 7 pid: 20722 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.919449:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af6727510fc1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90acd expref: 7 pid: 20722 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.919463:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af6727510fc1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90acd expref: 7 pid: 20722 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.919470:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.919471:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.919475:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918d7200/0x4076af6727510fc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ad4 expref: 132 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.919481:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918d7200/0x4076af6727510fc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ad4 expref: 132 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.919495:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800918d7200/0x4076af6727510fc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ad4 expref: 132 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.919503:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918d7200/0x4076af6727510fc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ad4 expref: 132 pid: 20722 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144855.919512:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965171883264:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144855.919559:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144855.926597:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918efb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965171883264:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144855.926612:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144855.927071:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965173810944:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7649us (8214us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144855.927078:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8607 00000100:00100000:0.0:1746144855.939997:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.940019:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173811712 00000100:00100000:0.0:1746144855.940026:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173811712 00010000:00010000:0.0:1746144855.940051:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918d7200/0x4076af6727510fc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ad4 expref: 135 pid: 20722 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144855.940074:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8608 00000100:00100000:0.0:1746144855.940080:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+135:1983:x1830965173811712:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144855.940091:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144855.940108:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918d7200/0x4076af6727510fc8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ad4 expref: 135 pid: 20722 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.940118:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918d7200/0x4076af6727510fc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ad4 expref: 135 pid: 20722 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.940135:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918d7200/0x4076af6727510fc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ad4 expref: 135 pid: 20722 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.940145:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.940146:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.940152:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709c00/0x4076af6727510fcf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90adb expref: 134 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.940158:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091709c00/0x4076af6727510fcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90adb expref: 134 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.940182:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091709c00/0x4076af6727510fcf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90adb expref: 134 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144855.940195:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965171883392:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144855.940258:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144855.943500:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965171883392:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144855.943512:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144855.943529:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+134:1983:x1830965173811712:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3450us (3538us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144855.943535:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8608 00000100:00100000:0.0:1746144855.957895:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173812864 00000100:00100000:0.0:1746144855.957899:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173812864 00010000:00010000:0.0:1746144855.957915:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092705e00/0x4076af6727510fd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ae2 expref: 7 pid: 8433 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144855.957929:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8609 00000100:00100000:0.0:1746144855.957934:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1985:x1830965173812864:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144855.957941:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144855.957952:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092705e00/0x4076af6727510fd6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ae2 expref: 7 pid: 8433 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.957960:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092705e00/0x4076af6727510fd6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ae2 expref: 7 pid: 8433 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.957977:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092705e00/0x4076af6727510fd6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ae2 expref: 7 pid: 8433 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144855.957985:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144855.958004:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965173812864:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 70us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144855.958009:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8609 00000100:00100000:0.0:1746144855.959625:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.959897:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.964162:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.967199:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.973261:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.974003:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173814144 00000100:00100000:0.0:1746144855.974008:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173814144 00000100:00100000:0.0:1746144855.974040:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3192 00000100:00100000:0.0:1746144855.974047:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+135:30934:x1830965173814144:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144855.974058:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144855.974070:0:8433:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091cebc00/0x4076af6727510feb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90af7 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.974087:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.974088:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144855.974093:0:8433:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091cebc00/0x4076af6727510feb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90af7 expref: 136 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.974104:0:8433:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091cebc00/0x4076af6727510feb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90af7 expref: 136 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144855.974113:0:8433:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cebc00, rc 0) 00000100:00100000:0.0:1746144855.974139:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+136:30934:x1830965173814144:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 93us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144855.974144:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3192 00000100:00100000:0.0:1746144855.975438:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.979434:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.981338:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.981546:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.984295:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.985082:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.985459:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.987818:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.990519:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.993423:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144855.997082:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.001524:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.006255:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.006623:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.010984:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.011016:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.014061:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.020733:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.038028:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.044186:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.044237:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.044810:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3199 00000100:00100000:0.0:1746144856.044817:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965173818368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144856.044825:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144856.044832:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091cebc00/0x4076af672751101c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90b28 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.044844:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144856.044848:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092704600/0x4076af6727511015 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b21 expref: 141 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.044853:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144856.044856:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091cebc00/0x4076af672751101c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b28 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.044873:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092704600/0x4076af6727511015 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b21 expref: 141 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.044882:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091cebc00/0x4076af672751101c lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b28 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.044891:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cebc00, rc 0) 00000100:00100000:0.0:1746144856.046070:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:30934:x1830965173818368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1249us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144856.046076:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3199 00000100:00100000:0.0:1746144856.048917:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.053565:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.060482:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.064760:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.072956:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.081687:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.081731:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.086843:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.088813:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.092434:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.092493:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.097816:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.101841:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173820800 00000100:00100000:0.0:1746144856.101850:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173820800 00002000:00100000:0.0:1746144856.101883:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff880093254700 x1830965173820800/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:497/0 lens 496/0 e 0 to 0 dl 1746144867 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144856.101891:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254700 with x1830965173820800 ext(0->7) 00010000:00010000:0.0:1746144856.101898:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800918d7e00/0x4076af672751102a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b36 expref: 142 pid: 8430 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.101909:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800918d7e00/0x4076af672751102a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b36 expref: 142 pid: 8430 timeout: 550 lvb_type: 0 00002000:00010000:0.0:1746144856.101915:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093254700 00000100:00100000:0.0:1746144856.101943:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 286 00000100:00100000:0.0:1746144856.101950:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+142:1985:x1830965173820800:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144856.102210:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+144:1985:x1830965173820800:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 Request processed in 259us (667us total) trans 4294968087 rc 0/0 00000100:00100000:0.0:1746144856.102216:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 286 00002000:00100000:0.0:1746144856.102222:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff880093254700 x1830965173820800/t4294968087(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:497/0 lens 496/448 e 0 to 0 dl 1746144867 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144856.102228:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254700 with x1830965173820800 ext(0->7) 00010000:00010000:0.0:1746144856.102232:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800918d7e00/0x4076af672751102a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b36 expref: 144 pid: 8430 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.102240:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800918d7e00/0x4076af672751102a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b36 expref: 144 pid: 8430 timeout: 550 lvb_type: 0 00002000:00010000:0.0:1746144856.102249:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093254700 00000100:00100000:0.0:1746144856.110042:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.113992:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.117062:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.117103:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.120166:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.122301:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.126621:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.133309:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.139062:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.142372:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.153907:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173822976 00000100:00100000:0.0:1746144856.153913:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173822976 00000100:00100000:0.0:1746144856.153939:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3206 00000100:00100000:0.0:1746144856.153944:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+146:30931:x1830965173822976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144856.153953:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144856.153966:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093eb2000/0x4076af672751104d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90b59 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.153987:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af672751103f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b4b expref: 147 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.153994:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092705800/0x4076af6727511046 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b52 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.154000:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144856.154002:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144856.154006:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093eb2000/0x4076af672751104d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b59 expref: 147 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.154029:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092705800/0x4076af6727511046 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b52 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.154039:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092705800/0x4076af6727511046 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b52 expref: 7 pid: 8433 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144856.154050:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965171887104:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144856.154269:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af672751103f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b4b expref: 147 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.154278:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af672751103f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b4b expref: 147 pid: 8430 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144856.154296:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965171887232:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144856.154314:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144856.158730:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965171887104:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144856.158740:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965171887232:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144856.158774:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093eb2000/0x4076af672751104d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b59 expref: 147 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.158788:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093eb2000, rc 0) 00000100:00100000:0.0:1746144856.158820:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+147:30931:x1830965173822976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4875us (7165us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144856.158828:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3206 00000100:00100000:0.0:1746144856.160695:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.160729:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.160783:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.160801:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173823104 00000100:00100000:0.0:1746144856.160807:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173823104 00010000:00010000:0.0:1746144856.160833:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af672751103f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b4b expref: 147 pid: 8430 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144856.160863:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173823360 00000100:00100000:0.0:1746144856.160865:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173823360 00010000:00010000:0.0:1746144856.160874:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092705800/0x4076af6727511046 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b52 expref: 7 pid: 8433 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144856.160887:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8625 00000100:00100000:0.0:1746144856.160892:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+147:1985:x1830965173823104:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144856.160903:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144856.160919:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af672751103f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b4b expref: 147 pid: 8430 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.160926:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af672751103f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b4b expref: 147 pid: 8430 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.160943:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af672751103f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b4b expref: 147 pid: 8430 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.160957:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144856.160985:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+146:1985:x1830965173823104:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 93us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144856.160990:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8625 00000100:00100000:0.0:1746144856.167053:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.175070:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.190361:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.195272:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3208 00000100:00100000:0.0:1746144856.195295:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+148:30931:x1830965173824128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144856.195313:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144856.195328:0:8433:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a9d7600/0x4076af672751105b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90b67 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.195351:0:8433:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918d6a00/0x4076af6727511054 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b60 expref: 149 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.195358:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144856.195359:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144856.195362:0:8433:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a9d7600/0x4076af672751105b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b67 expref: 149 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.195389:0:8433:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918d6a00/0x4076af6727511054 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b60 expref: 149 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.195399:0:8433:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918d6a00/0x4076af6727511054 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b60 expref: 149 pid: 20722 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144856.195409:0:8433:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1830965171887744:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144856.195471:0:8433:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144856.198082:0:8433:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1830965171887744:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144856.198104:0:8433:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a9d7600/0x4076af672751105b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b67 expref: 149 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.198118:0:8433:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a9d7600, rc 0) 00000100:00100000:0.0:1746144856.198147:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+149:30931:x1830965173824128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2867us (7790us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144856.198153:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3208 00000100:00100000:0.0:1746144856.200852:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.200899:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.204414:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.213094:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.218047:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.222348:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.225363:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.226182:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.228945:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.231154:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.231193:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.235592:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.239009:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.243135:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.249029:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.251666:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.259533:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.259855:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.259885:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173827840 00000100:00100000:0.0:1746144856.259889:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173827840 00002000:00100000:0.0:1746144856.259911:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88008a006680 x1830965173827840/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:497/0 lens 488/0 e 0 to 0 dl 1746144867 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144856.259920:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a006680 with x1830965173827840 ext(0->4095) 00010000:00010000:0.0:1746144856.259926:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092704600/0x4076af672751107e lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b8a expref: 154 pid: 8433 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.259937:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092704600/0x4076af672751107e lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b8a expref: 154 pid: 8433 timeout: 550 lvb_type: 0 00002000:00010000:0.0:1746144856.259942:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008a006680 00000100:00100000:0.0:1746144856.259954:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 297 00000100:00100000:0.0:1746144856.259959:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+154:1983:x1830965173827840:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144856.260505:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+154:1983:x1830965173827840:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 544us (649us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144856.260511:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 297 00002000:00100000:0.0:1746144856.260516:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88008a006680 x1830965173827840/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746144867 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144856.260523:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a006680 with x1830965173827840 ext(0->4095) 00010000:00010000:0.0:1746144856.260528:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092704600/0x4076af672751107e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b8a expref: 154 pid: 8433 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.260536:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092704600/0x4076af672751107e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90b8a expref: 154 pid: 8433 timeout: 550 lvb_type: 0 00002000:00010000:0.0:1746144856.260545:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008a006680 00000100:00100000:0.0:1746144856.266155:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.267446:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.271134:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.274379:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.278364:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.283603:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.288930:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.292281:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.298092:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.302483:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.305965:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.306011:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.309587:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.309616:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.309643:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.314162:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.317001:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.321166:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.325603:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.331568:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.338077:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.342195:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.342306:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.345481:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.345639:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.345785:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3221 00000100:00100000:0.0:1746144856.345794:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+156:30934:x1830965173832192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144856.345806:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144856.345817:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af67275110b6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90bc2 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.345834:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144856.345838:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a41ec400/0x4076af67275110af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90bbb expref: 157 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.345842:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144856.345845:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af67275110b6 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90bc2 expref: 157 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.345874:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a41ec400/0x4076af67275110af lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90bbb expref: 157 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.345884:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af67275110b6 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90bc2 expref: 157 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.345892:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091cea000, rc 0) 00000100:00100000:0.0:1746144856.345929:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+157:30934:x1830965173832192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 136us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144856.345934:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3221 00000100:00100000:0.0:1746144856.348542:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.356196:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.361145:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.368489:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.372715:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.372939:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.375401:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.378943:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.382644:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.386857:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.391605:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.394366:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.395902:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.401186:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.404149:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.404195:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.408009:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.408041:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.409362:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.412957:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.414566:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.417279:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.430187:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.432107:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173836928 00000100:00100000:0.0:1746144856.432111:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173836928 00000100:00100000:0.0:1746144856.432141:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3228 00000100:00100000:0.0:1746144856.432146:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+162:30931:x1830965173836928:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144856.432155:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144856.432165:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af67275110e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90bf3 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.432182:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092705c00/0x4076af67275110d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90be5 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.432189:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880092705800/0x4076af67275110e0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90bec expref: 163 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.432195:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144856.432196:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144856.432199:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af67275110e7 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90bf3 expref: 163 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.432220:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092705800/0x4076af67275110e0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90bec expref: 163 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.432229:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092705800/0x4076af67275110e0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90bec expref: 163 pid: 8433 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144856.432238:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cf2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965171891968:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144856.432320:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880092705c00/0x4076af67275110d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90be5 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.432328:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092705c00/0x4076af67275110d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90be5 expref: 6 pid: 20722 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144856.432336:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cf2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965171892096:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144856.432350:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144856.435204:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.435296:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.439027:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.439111:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.444243:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.447435:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.452062:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.458034:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.462925:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.464882:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.469680:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.471369:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.472414:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173839360 00000100:00100000:0.0:1746144856.472416:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173839360 00010000:00010000:0.0:1746144856.472431:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a41eca00/0x4076af67275110f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c01 expref: 165 pid: 8433 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144856.472445:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8650 00000100:00100000:0.0:1746144856.472449:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+165:1983:x1830965173839360:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144856.472456:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144856.472465:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a41eca00/0x4076af67275110f5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c01 expref: 165 pid: 8433 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.472473:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a41eca00/0x4076af67275110f5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c01 expref: 165 pid: 8433 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.472489:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a41eca00/0x4076af67275110f5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c01 expref: 165 pid: 8433 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.472509:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144856.472528:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+164:1983:x1830965173839360:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 78us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144856.472533:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8650 00000100:00100000:0.0:1746144856.474397:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.477940:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.481140:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.483076:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.487471:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.493469:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.497326:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.498833:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.501051:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.504071:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.507621:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.511531:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.516278:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.519320:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.529496:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.529529:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.529557:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.529657:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f09880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965171893760:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144856.529666:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965171893888:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144856.529686:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092705a00/0x4076af672751111f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c2b expref: 170 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.529700:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092705a00, rc 0) 00000100:00100000:0.0:1746144856.529732:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+170:30931:x1830965173842176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3485us (3900us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144856.529739:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3236 00000100:00100000:0.0:1746144856.530777:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8656 00000100:00100000:0.0:1746144856.530785:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1985:x1830965173842560:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144856.530792:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144856.530802:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092704600/0x4076af6727511118 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c24 expref: 7 pid: 20722 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.530811:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092704600/0x4076af6727511118 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c24 expref: 7 pid: 20722 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.530823:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092704600/0x4076af6727511118 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c24 expref: 7 pid: 20722 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.530846:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144856.530848:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144856.530854:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092705a00/0x4076af672751111f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c2b expref: 169 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.530860:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092705a00/0x4076af672751111f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c2b expref: 169 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.530879:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092705a00/0x4076af672751111f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c2b expref: 169 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.530888:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092705a00/0x4076af672751111f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c2b expref: 169 pid: 20722 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144856.530903:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008aad9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965171894144:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144856.533039:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.536834:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.541398:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.545082:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.552510:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.557111:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.560007:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.560505:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.560529:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173844096 00000100:00100000:0.0:1746144856.560532:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173844096 00010000:00010000:0.0:1746144856.560548:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092705c00/0x4076af6727511126 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c32 expref: 172 pid: 8432 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144856.560565:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8658 00000100:00100000:0.0:1746144856.560570:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aadad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+172:1984:x1830965173844096:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144856.560577:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144856.560588:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092705c00/0x4076af6727511126 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c32 expref: 172 pid: 8432 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.560596:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092705c00/0x4076af6727511126 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c32 expref: 172 pid: 8432 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.560615:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144856.560633:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008aadad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+172:1984:x1830965173844096:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 64us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144856.560639:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8658 00000100:00100000:0.0:1746144856.562431:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.562949:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8659 00000100:00100000:0.0:1746144856.562956:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008aadb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1984:x1830965173844224:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144856.562967:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144856.562983:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092705400/0x4076af672751112d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c39 expref: 7 pid: 8432 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.562992:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092705400/0x4076af672751112d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c39 expref: 7 pid: 8432 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.563009:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092705400/0x4076af672751112d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c39 expref: 7 pid: 8432 timeout: 550 lvb_type: 0 00010000:00010000:0.0:1746144856.563028:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144856.563030:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144856.563035:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd200/0x4076af6727511134 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c40 expref: 169 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.563043:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd200/0x4076af6727511134 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c40 expref: 169 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.563074:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd200/0x4076af6727511134 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c40 expref: 169 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144856.563083:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008aadb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965171894656:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144856.563144:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144856.565715:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.569210:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.571376:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.573406:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.575917:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.579990:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.581920:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.585661:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.587262:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.594068:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.594112:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.598629:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.600905:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.604846:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.621117:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.621292:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.623899:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.623936:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.626592:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.629341:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.643422:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.647722:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.651335:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.651367:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.653862:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.655015:0:8433:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4f09c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1830965171896320:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144856.655029:0:8433:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092704600/0x4076af672751116c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90c78 expref: 177 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.655036:0:8433:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092704600, rc 0) 00000100:00100000:0.0:1746144856.655743:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.659340:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.663335:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.668260:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.671817:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.676395:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.683319:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.683409:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.685365:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.685400:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.689426:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173851136 00000100:00100000:0.0:1746144856.689432:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173851136 00002000:00100000:0.0:1746144856.689462:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009bb48700 x1830965173851136/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:497/0 lens 488/0 e 0 to 0 dl 1746144867 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144856.689471:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb48700 with x1830965173851136 ext(0->4095) 00002000:00010000:0.0:1746144856.689475:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb48700 00000100:00100000:0.0:1746144856.689495:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2766 00000100:00100000:0.0:1746144856.689502:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+178:1983:x1830965173851136:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144856.689645:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+178:1983:x1830965173851136:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 142us (407us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144856.689650:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2766 00002000:00100000:0.0:1746144856.689656:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009bb48700 x1830965173851136/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746144867 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144856.689663:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb48700 with x1830965173851136 ext(0->4095) 00002000:00010000:0.0:1746144856.689666:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb48700 00000100:00100000:0.0:1746144856.703652:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.710208:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.713667:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.716306:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.720090:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.723654:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.727525:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.733479:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.738455:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.741396:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.744959:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.747726:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.752430:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.752481:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.758872:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.758909:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.758945:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.761002:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.766456:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.769400:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.773900:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.776580:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.779395:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.782962:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.783262:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.785060:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.785089:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.785127:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.785140:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173855872 00000100:00100000:0.0:1746144856.785143:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173855872 00000100:00100000:0.0:1746144856.785172:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3259 00000100:00100000:0.0:1746144856.785178:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a6ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:30934:x1830965173855872:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144856.785186:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144856.785501:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af67275111c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90ccc expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.785517:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a41ed600/0x4076af67275111b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90cc5 expref: 184 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.785523:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144856.785524:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144856.785527:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af67275111c0 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ccc expref: 7 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.785542:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a41ed600/0x4076af67275111b9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90cc5 expref: 184 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.785551:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a41ed600/0x4076af67275111b9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90cc5 expref: 184 pid: 8433 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144856.785558:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a6efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965171899008:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144856.785576:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144856.787157:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.788751:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.790824:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.793937:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.796120:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.798822:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.806240:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.812098:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173857664 00000100:00100000:0.0:1746144856.812106:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173857664 00000100:00100000:0.0:1746144856.812500:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3261 00000100:00100000:0.0:1746144856.812506:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+186:30931:x1830965173857664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144856.812516:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144856.812529:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbbc400/0x4076af67275111ce lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90cda expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.812551:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af67275111c0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ccc expref: 7 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.812559:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af67275111c7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90cd3 expref: 187 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.812565:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144856.812566:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144856.812569:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbc400/0x4076af67275111ce lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90cda expref: 187 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.812594:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af67275111c7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90cd3 expref: 187 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.812609:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af67275111c7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90cd3 expref: 187 pid: 20722 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144856.812619:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965171899264:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144856.812691:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af67275111c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ccc expref: 7 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144856.812699:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af67275111c0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ccc expref: 7 pid: 20722 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144856.812706:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965171899392:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144856.812725:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144856.816565:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.816611:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.817305:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.821829:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.827976:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.833972:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.838525:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.843035:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.846520:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.850515:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.850566:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.856237:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.856751:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.856810:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.856827:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173860096 00000100:00100000:0.0:1746144856.856924:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173860096 00010000:00010000:0.0:1746144856.856950:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092705e00/0x4076af67275111d5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ce1 expref: 7 pid: 8430 timeout: 551 lvb_type: 0 00000100:00100000:0.0:1746144856.857214:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173859968 00000100:00100000:0.0:1746144856.857217:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173859968 00010000:00010000:0.0:1746144856.857229:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af67275111dc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ce8 expref: 190 pid: 20722 timeout: 550 lvb_type: 0 00000100:00100000:0.0:1746144856.862389:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.875365:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.882867:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.892338:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.892389:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.897757:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.897822:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.902923:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.906599:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173862144 00000100:00100000:0.0:1746144856.906605:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173862144 00002000:00100000:0.0:1746144856.906635:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800a4f09880 x1830965173862144/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:497/0 lens 488/0 e 0 to 0 dl 1746144867 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144856.906643:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f09880 with x1830965173862144 ext(0->4095) 00002000:00010000:0.0:1746144856.906647:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4f09880 00000100:00100000:0.0:1746144856.906660:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2780 00000100:00100000:0.0:1746144856.906666:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+190:1985:x1830965173862144:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144856.906808:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+190:1985:x1830965173862144:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 142us (513us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144856.906815:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2780 00002000:00100000:0.0:1746144856.906819:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800a4f09880 x1830965173862144/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:497/0 lens 488/4536 e 0 to 0 dl 1746144867 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144856.906825:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f09880 with x1830965173862144 ext(0->4095) 00002000:00010000:0.0:1746144856.906828:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4f09880 00000100:00100000:0.0:1746144856.912710:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.919973:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.922321:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.926358:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.929443:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.930841:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.934368:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.934421:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.936993:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.937991:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.939569:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.944471:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.949880:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.953625:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.959619:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.963003:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.966417:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.968756:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.970747:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.970800:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.973440:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.976817:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.981956:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.991552:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.994179:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144856.996986:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.000349:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.001399:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.008843:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.013060:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.015516:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.018859:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.023117:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.025932:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.027244:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.030451:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.032301:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.032753:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.035615:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.041719:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173869824 00000100:00100000:0.0:1746144857.041727:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173869824 00002000:00100000:0.0:1746144857.041758:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff88009bb48000 x1830965173869824/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:498/0 lens 496/0 e 0 to 0 dl 1746144868 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144857.041794:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb48000 with x1830965173869824 ext(0->7) 00010000:00010000:0.0:1746144857.041802:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092705400/0x4076af6727511245 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d51 expref: 198 pid: 20722 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.041814:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092705400/0x4076af6727511245 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d51 expref: 198 pid: 20722 timeout: 551 lvb_type: 0 00002000:00010000:0.0:1746144857.041825:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb48000 00000100:00100000:0.0:1746144857.041842:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 351 00000100:00100000:0.0:1746144857.041848:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+198:1985:x1830965173869824:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144857.043346:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+200:1985:x1830965173869824:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1491us (2197us total) trans 4294968115 rc 0/0 00000100:00100000:0.0:1746144857.043353:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 351 00002000:00100000:0.0:1746144857.043361:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff88009bb48000 x1830965173869824/t4294968115(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:498/0 lens 496/448 e 0 to 0 dl 1746144868 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144857.043369:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb48000 with x1830965173869824 ext(0->7) 00010000:00010000:0.0:1746144857.043376:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092705400/0x4076af6727511245 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d51 expref: 200 pid: 20722 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.043387:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092705400/0x4076af6727511245 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d51 expref: 200 pid: 20722 timeout: 551 lvb_type: 0 00002000:00010000:0.0:1746144857.043392:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009bb48000 00000100:00100000:0.0:1746144857.046103:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.049355:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173870208 00000100:00100000:0.0:1746144857.049361:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173870208 00002000:00100000:0.0:1746144857.049388:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88012cf2ca80 x1830965173870208/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:498/0 lens 488/0 e 0 to 0 dl 1746144868 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144857.049397:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2ca80 with x1830965173870208 ext(0->4095) 00002000:00010000:0.0:1746144857.049400:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cf2ca80 00000100:00100000:0.0:1746144857.049413:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2788 00000100:00100000:0.0:1746144857.049420:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1982:x1830965173870208:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144857.049564:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1982:x1830965173870208:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 144us (560us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144857.049569:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2788 00002000:00100000:0.0:1746144857.049573:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88012cf2ca80 x1830965173870208/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:498/0 lens 488/4536 e 0 to 0 dl 1746144868 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144857.049579:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2ca80 with x1830965173870208 ext(0->4095) 00002000:00010000:0.0:1746144857.049582:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cf2ca80 00000100:00100000:0.0:1746144857.052297:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.055712:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.061135:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.061284:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.064011:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.064059:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.064985:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.068126:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173871616 00000100:00100000:0.0:1746144857.068132:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173871616 00002000:00100000:0.0:1746144857.068159:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093bb3480 x1830965173871616/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:498/0 lens 488/0 e 0 to 0 dl 1746144868 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144857.068168:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bb3480 with x1830965173871616 ext(0->4095) 00010000:00010000:0.0:1746144857.068174:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af672751125a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d66 expref: 201 pid: 8432 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.068185:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af672751125a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d66 expref: 201 pid: 8432 timeout: 551 lvb_type: 0 00002000:00010000:0.0:1746144857.068195:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bb3480 00000100:00100000:0.0:1746144857.068218:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 352 00000100:00100000:0.0:1746144857.068224:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+201:1984:x1830965173871616:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144857.068373:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+201:1984:x1830965173871616:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 149us (314us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144857.068379:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 352 00002000:00100000:0.0:1746144857.068383:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093bb3480 x1830965173871616/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:498/0 lens 488/4536 e 0 to 0 dl 1746144868 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144857.068390:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bb3480 with x1830965173871616 ext(0->4095) 00010000:00010000:0.0:1746144857.068394:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af672751125a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d66 expref: 201 pid: 8432 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.068402:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af672751125a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d66 expref: 201 pid: 8432 timeout: 551 lvb_type: 0 00002000:00010000:0.0:1746144857.068407:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bb3480 00000100:00100000:0.0:1746144857.073247:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.077396:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.080816:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.085069:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.085310:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.085358:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3284 00000100:00100000:0.0:1746144857.085362:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+202:30931:x1830965173872512:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144857.085369:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144857.085381:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af6727511268 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90d7b expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.085418:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af6727511261 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d6d expref: 203 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.085424:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af672751126f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d74 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.085429:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.085430:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.085432:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af6727511268 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d7b expref: 203 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.085457:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af672751126f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d74 expref: 7 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.085463:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af672751126f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d74 expref: 7 pid: 8433 timeout: 551 lvb_type: 0 00000100:00100000:0.0:1746144857.085472:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965171904384:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144857.085524:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af6727511261 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d6d expref: 203 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.085531:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af6727511261 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d6d expref: 203 pid: 8433 timeout: 551 lvb_type: 0 00000100:00100000:0.0:1746144857.085543:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965171904512:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144857.085561:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144857.087950:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.089603:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.093445:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.102492:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.106812:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.110033:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.119957:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173874048 00000100:00100000:0.0:1746144857.119965:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173874048 00000100:00100000:0.0:1746144857.120265:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173874176 00000100:00100000:0.0:1746144857.120269:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173874176 00000100:00100000:0.0:1746144857.120574:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3287 00000100:00100000:0.0:1746144857.120579:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+205:30934:x1830965173874176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144857.120584:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144857.120590:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918d7a00/0x4076af6727511284 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90d90 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.120602:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.120604:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.120609:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918d7a00/0x4076af6727511284 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d90 expref: 206 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.120620:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918d7a00/0x4076af6727511284 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90d90 expref: 206 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.120632:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918d7a00, rc 0) 00000100:00100000:0.0:1746144857.120663:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+206:30934:x1830965173874176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 85us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144857.120668:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3287 00000100:00100000:0.0:1746144857.125515:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.125565:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.128674:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.130821:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.135739:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.138927:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.144383:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.152537:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.152620:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.155019:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.155244:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.157621:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.159867:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.162469:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.164983:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.167076:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.169031:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.172325:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.174831:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.176627:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.176655:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.176678:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.177147:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8712 00000100:00100000:0.0:1746144857.177153:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+209:1985:x1830965173878016:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144857.177160:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144857.177298:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091708600/0x4076af6727511299 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90da5 expref: 209 pid: 8430 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.177306:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091708600/0x4076af6727511299 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90da5 expref: 209 pid: 8430 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.177317:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091708600/0x4076af6727511299 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90da5 expref: 209 pid: 8430 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.177338:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.177340:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.177345:0:7099:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092704c00/0x4076af67275112a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90db3 expref: 208 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.177354:0:7099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092704c00/0x4076af67275112a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90db3 expref: 208 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.177620:0:7099:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092704c00/0x4076af67275112a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90db3 expref: 208 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.177628:0:7099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092704c00/0x4076af67275112a7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90db3 expref: 208 pid: 8433 timeout: 551 lvb_type: 0 00000100:00100000:0.0:1746144857.177636:0:7099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f46d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965171906560:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144857.177669:0:7099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144857.180626:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.182584:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.186400:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.189934:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.192541:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.196082:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.198458:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.198589:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.200571:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.205086:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.210424:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.212221:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.214582:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.218926:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.220855:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.224573:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.227376:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.227462:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.227601:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8718 00000100:00100000:0.0:1746144857.227608:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5138c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1983:x1830965173881856:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144857.227615:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144857.227623:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092705e00/0x4076af67275112c3 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90dcf expref: 7 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.227632:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092705e00/0x4076af67275112c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90dcf expref: 7 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.227647:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092705e00/0x4076af67275112c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90dcf expref: 7 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.227657:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.227659:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.227664:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092705200/0x4076af67275112d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ddd expref: 213 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.227671:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092705200/0x4076af67275112d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ddd expref: 212 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.227689:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092705200/0x4076af67275112d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ddd expref: 212 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144857.227696:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087dbbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965171907712:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144857.227726:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144857.228165:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.229456:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.231205:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.235847:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.238814:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.245231:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.247139:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.247616:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.249953:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.250731:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.250796:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.252968:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.257266:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.284534:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.284588:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.288912:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.292903:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.298290:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.308328:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.311079:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.316355:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.320047:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.320082:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.320108:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.320136:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173886592 00000100:00100000:0.0:1746144857.320142:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173886592 00010000:00010000:0.0:1746144857.320170:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092704a00/0x4076af6727511302 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e0e expref: 220 pid: 8433 timeout: 551 lvb_type: 0 00000100:00100000:0.0:1746144857.320188:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173886720 00000100:00100000:0.0:1746144857.320190:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173886720 00010000:00010000:0.0:1746144857.320197:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092704600/0x4076af67275112fb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e07 expref: 7 pid: 8433 timeout: 551 lvb_type: 0 00000100:00100000:0.0:1746144857.320214:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8725 00000100:00100000:0.0:1746144857.320220:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5138850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+220:1983:x1830965173886592:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144857.320230:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144857.320246:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092704a00/0x4076af6727511302 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e0e expref: 220 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.320256:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092704a00/0x4076af6727511302 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e0e expref: 220 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.320287:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144857.320317:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5138850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+220:1983:x1830965173886592:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 96us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144857.320323:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8725 00000100:00100000:0.0:1746144857.320359:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8726 00000100:00100000:0.0:1746144857.320364:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1983:x1830965173886720:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144857.320369:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144857.320376:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092704600/0x4076af67275112fb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e07 expref: 7 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.320384:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092704600/0x4076af67275112fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e07 expref: 7 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.320394:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.320395:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.320401:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092705e00/0x4076af6727511309 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e15 expref: 219 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.320408:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092705e00/0x4076af6727511309 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e15 expref: 219 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.320430:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092705e00/0x4076af6727511309 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e15 expref: 219 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144857.320443:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009181c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965171909504:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144857.320485:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144857.328394:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.333658:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.335559:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.338149:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.342004:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.342045:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.345693:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.346612:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173888512 00000100:00100000:0.0:1746144857.346615:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173888512 00010000:00010000:0.0:1746144857.346629:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b003a00/0x4076af6727511317 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e23 expref: 7 pid: 8432 timeout: 551 lvb_type: 0 00000100:00100000:0.0:1746144857.346653:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8729 00000100:00100000:0.0:1746144857.346659:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1984:x1830965173888512:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144857.346665:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144857.346674:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b003a00/0x4076af6727511317 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e23 expref: 7 pid: 8432 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.346682:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b003a00/0x4076af6727511317 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e23 expref: 7 pid: 8432 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.346694:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b003a00/0x4076af6727511317 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e23 expref: 7 pid: 8432 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.346722:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.346723:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.346729:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af672751131e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e2a expref: 219 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.346736:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af672751131e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e2a expref: 219 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.346829:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af672751131e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e2a expref: 219 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144857.346839:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009181f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965171910144:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144857.346897:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144857.347000:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.348603:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.350650:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.353103:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.356425:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.358327:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.360505:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.362929:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.366917:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.369975:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.370540:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.371828:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.375533:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.380184:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.382834:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.392757:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.396058:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.399445:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.404844:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.404895:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.409209:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.409236:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.409387:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.409403:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173892608 00000100:00100000:0.0:1746144857.409406:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173892608 00010000:00010000:0.0:1746144857.409419:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091708c00/0x4076af672751133a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e46 expref: 7 pid: 8430 timeout: 551 lvb_type: 0 00000100:00100000:0.0:1746144857.409434:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8735 00000100:00100000:0.0:1746144857.409439:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1983:x1830965173892608:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144857.409445:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144857.409452:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091708c00/0x4076af672751133a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e46 expref: 7 pid: 8430 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.409460:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091708c00/0x4076af672751133a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e46 expref: 7 pid: 8430 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.409471:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091708c00/0x4076af672751133a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e46 expref: 7 pid: 8430 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.409481:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.409483:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.409488:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727511348 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e54 expref: 223 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.409495:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727511348 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e54 expref: 223 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.410028:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727511348 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e54 expref: 225 pid: 8432 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.410036:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727511348 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e54 expref: 225 pid: 8432 timeout: 551 lvb_type: 0 00000100:00100000:0.0:1746144857.410043:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb4b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965171911552:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144857.410226:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144857.412696:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.416398:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.418155:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.420118:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.422925:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.426943:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.434464:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.434511:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.437462:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173894528 00000100:00100000:0.0:1746144857.437467:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173894528 00010000:00010000:0.0:1746144857.437487:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af672751134f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e5b expref: 227 pid: 8432 timeout: 551 lvb_type: 0 00000100:00100000:0.0:1746144857.437573:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8737 00000100:00100000:0.0:1746144857.437580:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+227:1985:x1830965173894528:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144857.437590:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144857.437607:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af672751134f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e5b expref: 227 pid: 8432 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.437616:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af672751134f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e5b expref: 227 pid: 8432 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.437633:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af672751134f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90e5b expref: 227 pid: 8432 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.437818:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144857.437871:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+226:1985:x1830965173894528:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 291us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144857.437877:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8737 00000100:00100000:0.0:1746144857.438846:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.441407:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.443934:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.445938:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.448002:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.450188:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.452533:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.456804:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.461455:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.461501:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.465320:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.465358:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.466053:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.467691:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.471392:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.477247:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.483542:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.491692:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.491744:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.495148:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.508685:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.511669:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.532733:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.534837:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.537449:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.537711:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.540467:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.542644:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.545744:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.548208:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.551500:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.555390:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.557172:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.559080:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.560477:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.562980:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.563052:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.565254:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.580409:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.584075:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.584095:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173902336 00000100:00100000:0.0:1746144857.584102:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173902336 00000100:00100000:0.0:1746144857.584260:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3330 00000100:00100000:0.0:1746144857.584266:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+235:30934:x1830965173902336:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144857.584287:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144857.584299:0:8433:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af67275113b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90ebd expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.584319:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.584321:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.584331:0:8433:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af67275113b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ebd expref: 236 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.584343:0:8433:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af67275113b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ebd expref: 236 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.584351:0:8433:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918d6600, rc 0) 00000100:00100000:0.0:1746144857.584379:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+236:30934:x1830965173902336:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 113us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144857.584384:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3330 00000100:00100000:0.0:1746144857.584499:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.584538:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173902464 00000100:00100000:0.0:1746144857.584541:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173902464 00000100:00100000:0.0:1746144857.584555:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3331 00000100:00100000:0.0:1746144857.584560:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+236:30931:x1830965173902464:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144857.584566:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144857.584572:0:8433:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918d7a00/0x4076af67275113b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90ec4 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.584583:0:8433:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091cebc00/0x4076af67275113aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90eb6 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.584589:0:8433:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af67275113b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ebd expref: 237 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.584593:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.584594:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.584597:0:8433:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918d7a00/0x4076af67275113b8 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ec4 expref: 237 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.584618:0:8433:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af67275113b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ebd expref: 237 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.584628:0:8433:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af67275113b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ebd expref: 237 pid: 8433 timeout: 551 lvb_type: 0 00000100:00100000:0.0:1746144857.584638:0:8433:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1830965171914752:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144857.584708:0:8433:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091cebc00/0x4076af67275113aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90eb6 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.584715:0:8433:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091cebc00/0x4076af67275113aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90eb6 expref: 6 pid: 8433 timeout: 551 lvb_type: 0 00000100:00100000:0.0:1746144857.584726:0:8433:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918efb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1830965171914880:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144857.584743:0:8433:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144857.586686:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173902720 00000100:00100000:0.0:1746144857.586691:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173902720 00002000:00100000:0.0:1746144857.586716:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093bb3480 x1830965173902720/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:498/0 lens 488/0 e 0 to 0 dl 1746144868 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144857.587120:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bb3480 with x1830965173902720 ext(0->4095) 00010000:00010000:0.0:1746144857.587127:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af67275113b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ebd expref: 237 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.587136:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af67275113b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ebd expref: 237 pid: 8433 timeout: 551 lvb_type: 0 00002000:00010000:0.0:1746144857.587142:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bb3480 00000100:00100000:0.0:1746144857.587162:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 394 00000100:00100000:0.0:1746144857.587168:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+237:1984:x1830965173902720:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144857.587287:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+237:1984:x1830965173902720:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 119us (631us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144857.587293:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 394 00002000:00100000:0.0:1746144857.587297:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093bb3480 x1830965173902720/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:498/0 lens 488/4536 e 0 to 0 dl 1746144868 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144857.587304:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bb3480 with x1830965173902720 ext(0->4095) 00010000:00010000:0.0:1746144857.587309:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af67275113b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ebd expref: 237 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.587316:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800918d6600/0x4076af67275113b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ebd expref: 237 pid: 8433 timeout: 551 lvb_type: 0 00002000:00010000:0.0:1746144857.587322:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bb3480 00000100:00100000:0.0:1746144857.591558:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.602405:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.610332:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.611674:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.614105:0:8433:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8433:1830965171915392:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144857.614122:0:8433:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b76ee00/0x4076af67275113c6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ed2 expref: 239 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.614134:0:8433:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b76ee00, rc 0) 00000100:00100000:0.0:1746144857.614159:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+240:30931:x1830965173904128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2401us (2487us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144857.614172:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3333 00000100:00100000:0.0:1746144857.616640:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173904640 00000100:00100000:0.0:1746144857.616644:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173904640 00002000:00100000:0.0:1746144857.616670:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093bb1880 x1830965173904640/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:498/0 lens 488/0 e 0 to 0 dl 1746144868 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144857.616677:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bb1880 with x1830965173904640 ext(0->4095) 00010000:00010000:0.0:1746144857.616683:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b76ee00/0x4076af67275113c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ed2 expref: 239 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.616692:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b76ee00/0x4076af67275113c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ed2 expref: 239 pid: 8433 timeout: 551 lvb_type: 0 00002000:00010000:0.0:1746144857.616699:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bb1880 00000100:00100000:0.0:1746144857.616712:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 397 00000100:00100000:0.0:1746144857.616717:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+239:1984:x1830965173904640:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144857.617110:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+239:1984:x1830965173904640:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 391us (623us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144857.617116:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 397 00002000:00100000:0.0:1746144857.617121:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093bb1880 x1830965173904640/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:498/0 lens 488/4536 e 0 to 0 dl 1746144868 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144857.617128:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bb1880 with x1830965173904640 ext(0->4095) 00010000:00010000:0.0:1746144857.617132:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b76ee00/0x4076af67275113c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ed2 expref: 239 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.617140:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b76ee00/0x4076af67275113c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ed2 expref: 239 pid: 8433 timeout: 551 lvb_type: 0 00002000:00010000:0.0:1746144857.617145:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bb1880 00000100:00100000:0.0:1746144857.620836:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.627135:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.635149:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.637239:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.639457:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.639496:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.641697:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.646088:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.648986:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.651453:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.653637:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.655610:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.658870:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.663029:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.663087:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.666242:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.667224:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.667260:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.671301:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.674179:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.676906:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.684167:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.685525:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.688262:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.694304:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.697059:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.697090:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.697112:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.697149:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173909760 00000100:00100000:0.0:1746144857.697154:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173909760 00010000:00010000:0.0:1746144857.697178:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af67275113f7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f03 expref: 6 pid: 8433 timeout: 551 lvb_type: 0 00000100:00100000:0.0:1746144857.697194:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173909888 00000100:00100000:0.0:1746144857.697196:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173909888 00010000:00010000:0.0:1746144857.697203:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af67275113f0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90efc expref: 18 pid: 8433 timeout: 551 lvb_type: 0 00000100:00100000:0.0:1746144857.697220:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8760 00000100:00100000:0.0:1746144857.697225:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965173909760:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144857.697234:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144857.697251:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af67275113f7 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f03 expref: 6 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.697261:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af67275113f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f03 expref: 6 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.697291:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144857.697316:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965173909760:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 91us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144857.697321:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8760 00000100:00100000:0.0:1746144857.697354:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8761 00000100:00100000:0.0:1746144857.697358:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965173909888:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144857.697363:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144857.697371:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af67275113f0 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90efc expref: 18 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.697378:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af67275113f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90efc expref: 18 pid: 8433 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.697387:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.697388:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.697394:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af67275113fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f0a expref: 18 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.697401:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af67275113fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f0a expref: 18 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.697421:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af67275113fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f0a expref: 18 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144857.697430:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093fa3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965171917312:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144857.697470:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144857.699756:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.702885:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.706364:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.715449:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.716742:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.717789:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.720675:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.723563:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.726076:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.727926:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.729971:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.733892:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.736576:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.740894:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.743353:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.745667:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.745717:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.745738:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.748454:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.756407:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.763233:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.765948:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.769071:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.769116:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.772345:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.772390:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.772405:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.772419:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.772431:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.773167:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.773179:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173915648 00000100:00100000:0.0:1746144857.773181:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173915648 00000100:00100000:0.0:1746144857.773202:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 280 00000100:00100000:0.0:1746144857.773206:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965173915648:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144857.773228:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965173915648:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 22us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144857.773232:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 280 00000100:00100000:0.0:1746144857.773255:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.773261:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173915904 00000100:00100000:0.0:1746144857.773263:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173915904 00000100:00100000:0.0:1746144857.773291:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 281 00000100:00100000:0.0:1746144857.773295:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1985:x1830965173915904:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144857.773310:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1985:x1830965173915904:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 15us (55us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144857.773314:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 281 00000100:00100000:0.0:1746144857.773345:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.775900:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.780963:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.794492:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.798853:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.799281:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.803558:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.809666:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.813611:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.817560:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.823240:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.825993:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.828906:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.831929:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.834688:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.834786:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.834972:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.834988:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173918848 00000100:00100000:0.0:1746144857.834990:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173918848 00010000:00010000:0.0:1746144857.835000:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727511452 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f5e expref: 27 pid: 8430 timeout: 551 lvb_type: 0 00000100:00100000:0.0:1746144857.835017:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8774 00000100:00100000:0.0:1746144857.835021:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1985:x1830965173918848:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144857.835026:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144857.835033:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727511452 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f5e expref: 27 pid: 8430 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.835045:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727511452 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f5e expref: 27 pid: 8430 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.835055:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727511452 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f5e expref: 27 pid: 8430 timeout: 551 lvb_type: 0 00010000:00010000:0.0:1746144857.835065:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.835066:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.835071:0:7099:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d3b7200/0x4076af6727511459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f65 expref: 26 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.835076:0:7099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3b7200/0x4076af6727511459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f65 expref: 26 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.835098:0:7099:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d3b7200/0x4076af6727511459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f65 expref: 26 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.835107:0:7099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d3b7200/0x4076af6727511459 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f65 expref: 26 pid: 10401 timeout: 551 lvb_type: 0 00000100:00100000:0.0:1746144857.835116:0:7099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965171920384:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144857.838413:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.848721:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.857669:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173919872 00000100:00100000:0.0:1746144857.857674:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173919872 00010000:00010000:0.0:1746144857.857689:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d3b7200/0x4076af6727511459 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f65 expref: 29 pid: 10401 timeout: 552 lvb_type: 0 00000100:00100000:0.0:1746144857.857707:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8775 00000100:00100000:0.0:1746144857.857712:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+29:1983:x1830965173919872:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144857.857718:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144857.857734:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d3b7200/0x4076af6727511459 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f65 expref: 29 pid: 10401 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144857.857742:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d3b7200/0x4076af6727511459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f65 expref: 29 pid: 10401 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144857.857756:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d3b7200/0x4076af6727511459 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f65 expref: 29 pid: 10401 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144857.857786:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.857788:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.857793:0:7099:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e33da00/0x4076af6727511460 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f6c expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.857798:0:7099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e33da00/0x4076af6727511460 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f6c expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.857816:0:7099:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e33da00/0x4076af6727511460 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f6c expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.857825:0:7099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e33da00/0x4076af6727511460 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f6c expref: 5 pid: 10401 timeout: 552 lvb_type: 0 00000100:00100000:0.0:1746144857.857840:0:7099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4f9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965171920640:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144857.860350:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.863420:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.865635:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.871883:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.874615:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.880248:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.888196:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.892249:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.892862:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.893030:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3359 00000100:00100000:0.0:1746144857.893037:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+30:30931:x1830965173921408:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144857.893045:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144857.893053:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800942aae00/0x4076af672751147c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90f88 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.893074:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b76e400/0x4076af672751146e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f7a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.893081:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.893082:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.893086:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942aae00/0x4076af672751147c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f88 expref: 32 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.893109:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b76e400/0x4076af672751146e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f7a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.893120:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b76e400/0x4076af672751146e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f7a expref: 5 pid: 10401 timeout: 552 lvb_type: 0 00000100:00100000:0.0:1746144857.893129:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b031c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965171921152:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144857.893187:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144857.896245:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173921536 00000100:00100000:0.0:1746144857.896251:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173921536 00010000:00010000:0.0:1746144857.896284:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b76e400/0x4076af672751146e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f7a expref: 6 pid: 10401 timeout: 552 lvb_type: 0 00000100:00100000:0.0:1746144857.896312:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8778 00000100:00100000:0.0:1746144857.896318:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965173921536:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144857.896327:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144857.896343:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b76e400/0x4076af672751146e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f7a expref: 6 pid: 10401 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144857.896353:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b76e400/0x4076af672751146e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f7a expref: 6 pid: 10401 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144857.896371:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b76e400/0x4076af672751146e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f7a expref: 6 pid: 10401 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144857.896383:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.896385:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.896391:0:7099:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800942aae00/0x4076af672751147c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f88 expref: 30 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.896402:0:7099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800942aae00/0x4076af672751147c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f88 expref: 30 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.896425:0:7099:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800942aae00/0x4076af672751147c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f88 expref: 30 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.896434:0:7099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800942aae00/0x4076af672751147c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f88 expref: 30 pid: 20722 timeout: 552 lvb_type: 0 00000100:00100000:0.0:1746144857.896443:0:7099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b031f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965171921408:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144857.896500:0:7099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144857.906870:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.912984:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.920444:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.924027:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.926647:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.928966:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.930335:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.932295:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.935740:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.937809:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.940260:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.944301:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.948906:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.952875:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.962002:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.962444:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.966504:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.966557:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.966857:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.966899:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173924736 00000100:00100000:0.0:1746144857.966910:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173924736 00010000:00010000:0.0:1746144857.966947:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d6d600/0x4076af6727511491 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f9d expref: 7 pid: 8432 timeout: 552 lvb_type: 0 00000100:00100000:0.0:1746144857.966974:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173924992 00000100:00100000:0.0:1746144857.966976:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173924992 00010000:00010000:0.0:1746144857.966985:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130d6dc00/0x4076af6727511498 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fa4 expref: 35 pid: 8432 timeout: 552 lvb_type: 0 00000100:00100000:0.0:1746144857.967016:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8783 00000100:00100000:0.0:1746144857.967022:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1983:x1830965173924736:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144857.967042:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144857.967068:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130d6d600/0x4076af6727511491 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f9d expref: 7 pid: 8432 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144857.967078:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130d6d600/0x4076af6727511491 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f9d expref: 7 pid: 8432 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144857.967300:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130d6d600/0x4076af6727511491 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90f9d expref: 8 pid: 8432 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144857.967318:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.967328:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144857.967335:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af672751149f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fab expref: 33 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.967341:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af672751149f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fab expref: 33 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.967401:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af672751149f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fab expref: 33 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144857.967418:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af672751149f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fab expref: 33 pid: 20722 timeout: 552 lvb_type: 0 00000100:00100000:0.0:1746144857.967428:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e81880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965171922688:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144857.967523:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144857.969861:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.971682:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.975861:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.980534:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.988388:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.990417:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.993530:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.994585:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144857.997245:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.002277:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.004881:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.009752:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.021247:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.021306:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.021511:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3370 00000100:00100000:0.0:1746144858.021517:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+39:30934:x1830965173927936:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144858.021523:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144858.021528:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093167e00/0x4076af67275114c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90fd5 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.021536:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144858.021539:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bb9fa00/0x4076af67275114c2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fce expref: 40 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.021544:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144858.021546:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093167e00/0x4076af67275114c9 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fd5 expref: 40 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.021562:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bb9fa00/0x4076af67275114c2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fce expref: 40 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.021571:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093167e00/0x4076af67275114c9 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fd5 expref: 40 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.021579:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093167e00, rc 0) 00000100:00100000:0.0:1746144858.021597:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+40:30934:x1830965173927936:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 81us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144858.021601:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3370 00000100:00100000:0.0:1746144858.026118:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.029175:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.033904:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.040741:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.045114:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.046967:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.050018:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.050060:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.057628:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.057667:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.057737:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.057801:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173929856 00000100:00100000:0.0:1746144858.057804:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173929856 00010000:00010000:0.0:1746144858.057824:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091708200/0x4076af67275114d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fdc expref: 6 pid: 8432 timeout: 552 lvb_type: 0 00000100:00100000:0.0:1746144858.057840:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173929600 00000100:00100000:0.0:1746144858.057841:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173929600 00010000:00010000:0.0:1746144858.057848:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880093167e00/0x4076af67275114c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fd5 expref: 42 pid: 8430 timeout: 552 lvb_type: 0 00000100:00100000:0.0:1746144858.057867:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8791 00000100:00100000:0.0:1746144858.057872:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965173929856:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144858.057880:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144858.057896:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091708200/0x4076af67275114d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fdc expref: 6 pid: 8432 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144858.057905:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091708200/0x4076af67275114d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fdc expref: 6 pid: 8432 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144858.057920:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091708200/0x4076af67275114d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fdc expref: 6 pid: 8432 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144858.057940:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144858.057971:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965173929856:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 99us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144858.057977:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8791 00000100:00100000:0.0:1746144858.060403:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.065857:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.074965:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.082999:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173930624 00000100:00100000:0.0:1746144858.083006:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173930624 00000100:00100000:0.0:1746144858.083049:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3374 00000100:00100000:0.0:1746144858.083056:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+43:30931:x1830965173930624:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144858.083068:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144858.083079:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093167a00/0x4076af67275114e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af90ff1 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.083098:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b76e200/0x4076af67275114de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fea expref: 44 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.083105:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144858.083106:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144858.083109:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093167a00/0x4076af67275114e5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ff1 expref: 44 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.083127:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b76e200/0x4076af67275114de lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fea expref: 44 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.083142:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b76e200/0x4076af67275114de lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90fea expref: 44 pid: 8432 timeout: 552 lvb_type: 0 00000100:00100000:0.0:1746144858.083151:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965171924736:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144858.083932:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.085698:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144858.085903:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965171924736:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144858.085920:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093167a00/0x4076af67275114e5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ff1 expref: 43 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.085932:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093167a00, rc 0) 00000100:00100000:0.0:1746144858.085953:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+43:30931:x1830965173930624:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2898us (3074us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144858.085959:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3374 00000100:00100000:0.0:1746144858.087261:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.087341:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.090741:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.094450:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.097839:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.100906:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.104044:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.106484:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.116341:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.116397:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.123182:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.123220:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.123251:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173933184 00000100:00100000:0.0:1746144858.123257:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173933184 00010000:00010000:0.0:1746144858.123293:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af67275114ec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ff8 expref: 6 pid: 8432 timeout: 552 lvb_type: 0 00000100:00100000:0.0:1746144858.123328:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8796 00000100:00100000:0.0:1746144858.123335:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965173933184:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144858.123346:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144858.123365:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af67275114ec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ff8 expref: 6 pid: 8432 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144858.123373:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af67275114ec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af90ff8 expref: 6 pid: 8432 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144858.123394:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144858.123427:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965173933184:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 92us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144858.123432:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8796 00000100:00100000:0.0:1746144858.127049:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.127126:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.130683:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.134834:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.136893:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.140960:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.144118:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.149059:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.151992:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.152062:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.155067:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.156379:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.156799:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.159228:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.163400:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.167421:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.174614:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.176303:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.184511:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.184573:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.184595:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.187727:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.187751:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173937536 00000100:00100000:0.0:1746144858.187756:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173937536 00002000:00100000:0.0:1746144858.187805:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880135ea9880 x1830965173937536/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:499/0 lens 488/0 e 0 to 0 dl 1746144869 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144858.187813:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea9880 with x1830965173937536 ext(0->4095) 00010000:00010000:0.0:1746144858.187819:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130d6cc00/0x4076af6727511524 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91030 expref: 49 pid: 8432 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144858.187828:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130d6cc00/0x4076af6727511524 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91030 expref: 49 pid: 8432 timeout: 552 lvb_type: 0 00002000:00010000:0.0:1746144858.187835:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135ea9880 00000100:00100000:0.0:1746144858.190043:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+48:1985:x1830965173937152:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5379us (5444us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144858.190051:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8803 00000100:00100000:0.0:1746144858.199648:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.202397:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.204879:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.207370:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.209970:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.212420:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.213022:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.214861:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.220999:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.236457:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.236509:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.241808:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.246810:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.249467:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.255636:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.259038:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.261043:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.264415:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.268956:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.272944:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.276343:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.283180:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.284806:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.284844:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.287504:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.296098:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.301087:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.301342:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173943168 00000100:00100000:0.0:1746144858.301348:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173943168 00002000:00100000:0.0:1746144858.301377:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880087db9f80 x1830965173943168/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:499/0 lens 488/0 e 0 to 0 dl 1746144869 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144858.301385:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087db9f80 with x1830965173943168 ext(0->4095) 00002000:00010000:0.0:1746144858.301388:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087db9f80 00000100:00100000:0.0:1746144858.301402:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2863 00000100:00100000:0.0:1746144858.301407:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087db9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1985:x1830965173943168:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144858.301676:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087db9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1985:x1830965173943168:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 268us (590us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144858.301681:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2863 00002000:00100000:0.0:1746144858.301686:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880087db9f80 x1830965173943168/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746144869 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144858.301692:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087db9f80 with x1830965173943168 ext(0->4095) 00002000:00010000:0.0:1746144858.301695:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087db9f80 00000100:00100000:0.0:1746144858.305176:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.306988:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.309293:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.311690:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.314186:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.314239:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.314428:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.317026:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.317049:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173944576 00000100:00100000:0.0:1746144858.317053:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173944576 00002000:00100000:0.0:1746144858.317082:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009ad5f800 x1830965173944576/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:499/0 lens 488/0 e 0 to 0 dl 1746144869 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144858.317096:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5f800 with x1830965173944576 ext(0->4095) 00010000:00010000:0.0:1746144858.317102:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b76e400/0x4076af6727511571 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9107d expref: 56 pid: 10401 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144858.317114:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b76e400/0x4076af6727511571 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9107d expref: 56 pid: 10401 timeout: 552 lvb_type: 0 00002000:00010000:0.0:1746144858.317120:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ad5f800 00000100:00100000:0.0:1746144858.317143:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 451 00000100:00100000:0.0:1746144858.317149:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1984:x1830965173944576:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144858.317289:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1984:x1830965173944576:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 139us (269us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144858.317294:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 451 00002000:00100000:0.0:1746144858.317299:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009ad5f800 x1830965173944576/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746144869 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144858.317306:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5f800 with x1830965173944576 ext(0->4095) 00010000:00010000:0.0:1746144858.317310:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b76e400/0x4076af6727511571 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9107d expref: 56 pid: 10401 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144858.317318:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b76e400/0x4076af6727511571 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9107d expref: 56 pid: 10401 timeout: 552 lvb_type: 0 00002000:00010000:0.0:1746144858.317323:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ad5f800 00000100:00100000:0.0:1746144858.324103:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.327946:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.329866:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.333876:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.336557:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.336621:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.339049:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.361179:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.366708:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.369186:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.377275:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.377328:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.380965:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.381801:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.386301:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.389470:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.393171:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.396581:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.407838:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.409144:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.410982:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.411023:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.414664:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.417683:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.422490:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.428437:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.430487:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.432598:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.435621:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.438256:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.451945:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cf2e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965171931648:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144858.451960:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144858.451979:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965173950592:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6000us (7272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144858.451986:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8824 00000100:00100000:0.0:1746144858.467210:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.467236:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173951232 00000100:00100000:0.0:1746144858.467242:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173951232 00010000:00010000:0.0:1746144858.467277:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af67275115b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af910c3 expref: 67 pid: 10401 timeout: 552 lvb_type: 0 00000100:00100000:0.0:1746144858.467299:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8825 00000100:00100000:0.0:1746144858.467306:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965173951232:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144858.467317:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144858.467333:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af67275115b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af910c3 expref: 67 pid: 10401 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144858.467344:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af67275115b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af910c3 expref: 67 pid: 10401 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144858.467363:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af67275115b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af910c3 expref: 67 pid: 10401 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144858.467374:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144858.467376:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144858.467382:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a5097e00/0x4076af67275115be lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af910ca expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.467389:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5097e00/0x4076af67275115be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af910ca expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.467413:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a5097e00/0x4076af67275115be lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af910ca expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144858.467423:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a417dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965171931776:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144858.467488:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144858.475893:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.475933:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.479127:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.483170:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173952128 00000100:00100000:0.0:1746144858.483177:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173952128 00002000:00100000:0.0:1746144858.483208:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093bb1c00 x1830965173952128/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:499/0 lens 488/0 e 0 to 0 dl 1746144869 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144858.483217:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bb1c00 with x1830965173952128 ext(0->4095) 00010000:00010000:0.0:1746144858.483224:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0600/0x4076af67275115c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af910d1 expref: 66 pid: 20722 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144858.483235:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0600/0x4076af67275115c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af910d1 expref: 66 pid: 20722 timeout: 552 lvb_type: 0 00002000:00010000:0.0:1746144858.483240:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bb1c00 00000100:00100000:0.0:1746144858.483274:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 460 00000100:00100000:0.0:1746144858.483281:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965173952128:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144858.483424:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965173952128:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 143us (336us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144858.483429:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 460 00002000:00100000:0.0:1746144858.483434:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093bb1c00 x1830965173952128/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746144869 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144858.483440:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bb1c00 with x1830965173952128 ext(0->4095) 00010000:00010000:0.0:1746144858.483444:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0600/0x4076af67275115c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af910d1 expref: 66 pid: 20722 timeout: 552 lvb_type: 0 00010000:00010000:0.0:1746144858.483453:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0600/0x4076af67275115c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af910d1 expref: 66 pid: 20722 timeout: 552 lvb_type: 0 00002000:00010000:0.0:1746144858.483458:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bb1c00 00000100:00100000:0.0:1746144858.485337:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.488498:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.491101:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.493084:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.495891:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.502678:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.504956:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.504991:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.509022:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.509951:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.510280:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.512653:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.518208:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.522918:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.528429:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.532232:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.532282:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.534711:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.535898:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.539355:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.544737:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.552195:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.556128:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.563352:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.569400:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.571898:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.579380:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.584009:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.591609:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.594512:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.610189:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.610391:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.612710:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.614859:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.617134:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.622115:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.626074:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093bb0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965171934592:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144858.626092:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144858.626205:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+75:1982:x1830965173959040:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3901us (4129us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144858.626218:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8837 00000100:00100000:0.0:1746144858.627566:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173959296 00000100:00100000:0.0:1746144858.627574:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173959296 00002000:00100000:0.0:1746144858.627606:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093bb0700 x1830965173959296/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:499/0 lens 488/0 e 0 to 0 dl 1746144869 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144858.627615:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bb0700 with x1830965173959296 ext(0->4095) 00002000:00010000:0.0:1746144858.627619:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bb0700 00000100:00100000:0.0:1746144858.627650:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2882 00000100:00100000:0.0:1746144858.627656:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965173959296:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144858.627834:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965173959296:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 176us (1446us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144858.627840:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2882 00002000:00100000:0.0:1746144858.627845:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093bb0700 x1830965173959296/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:499/0 lens 488/4536 e 0 to 0 dl 1746144869 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144858.627852:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bb0700 with x1830965173959296 ext(0->4095) 00002000:00010000:0.0:1746144858.627855:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093bb0700 00000100:00100000:0.0:1746144858.630164:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.631191:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.631210:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173959552 00000100:00100000:0.0:1746144858.631213:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173959552 00000100:00100000:0.0:1746144858.631231:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3419 00000100:00100000:0.0:1746144858.631236:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+77:30934:x1830965173959552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144858.631243:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144858.631257:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009946ae00/0x4076af6727511620 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9112c expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.631277:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144858.631280:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d6dc00/0x4076af6727511619 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91125 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.631285:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144858.631287:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009946ae00/0x4076af6727511620 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9112c expref: 78 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.631310:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130d6dc00/0x4076af6727511619 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91125 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.631320:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009946ae00/0x4076af6727511620 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9112c expref: 78 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.631328:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009946ae00, rc 0) 00000100:00100000:0.0:1746144858.631348:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+78:30934:x1830965173959552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 111us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144858.631353:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3419 00000100:00100000:0.0:1746144858.634839:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.639300:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.644507:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.647833:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.662168:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.680458:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.680501:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.684295:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.689929:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.694237:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.708728:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.718979:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.724181:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.724227:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.727713:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.733023:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.736894:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.761923:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.768982:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.773053:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.778101:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.778489:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.797919:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.803624:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.810114:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.812331:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.817870:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.835469:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.835495:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.841582:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.841662:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.849469:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.852601:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.862120:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173966464 00000100:00100000:0.0:1746144858.862127:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173966464 00010000:00010000:0.0:1746144858.862151:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091708200/0x4076af6727511658 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91164 expref: 87 pid: 8432 timeout: 553 lvb_type: 0 00000100:00100000:0.0:1746144858.862172:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8848 00000100:00100000:0.0:1746144858.862178:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1983:x1830965173966464:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144858.862188:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144858.862203:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091708200/0x4076af6727511658 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91164 expref: 87 pid: 8432 timeout: 553 lvb_type: 0 00010000:00010000:0.0:1746144858.862212:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091708200/0x4076af6727511658 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91164 expref: 87 pid: 8432 timeout: 553 lvb_type: 0 00010000:00010000:0.0:1746144858.862230:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091708200/0x4076af6727511658 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91164 expref: 87 pid: 8432 timeout: 553 lvb_type: 0 00010000:00010000:0.0:1746144858.862248:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144858.862250:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144858.862255:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130d6dc00/0x4076af672751165f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9116b expref: 86 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.862284:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130d6dc00/0x4076af672751165f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9116b expref: 86 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144858.862309:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130d6dc00/0x4076af672751165f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9116b expref: 86 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144858.862319:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965171937280:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144858.862374:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144858.864173:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.871285:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.875949:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.891414:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.895708:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.898944:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.905493:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.922400:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173968128 00000100:00100000:0.0:1746144858.922404:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173968128 00002000:00100000:0.0:1746144858.922424:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff880093bb2680 x1830965173968128/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:499/0 lens 496/0 e 0 to 0 dl 1746144869 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144858.922432:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bb2680 with x1830965173968128 ext(0->7) 00010000:00010000:0.0:1746144858.922438:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b0f2a00/0x4076af672751166d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91179 expref: 87 pid: 8432 timeout: 553 lvb_type: 0 00010000:00010000:0.0:1746144858.922447:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b0f2a00/0x4076af672751166d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91179 expref: 87 pid: 8432 timeout: 553 lvb_type: 0 00002000:00010000:0.0:1746144858.922452:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bb2680 00000100:00100000:0.0:1746144858.922462:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 484 00000100:00100000:0.0:1746144858.922466:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965173968128:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144858.922679:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965173968128:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 Request processed in 212us (635us total) trans 4294968173 rc 0/0 00000100:00100000:0.0:1746144858.922684:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 484 00002000:00100000:0.0:1746144858.922689:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff880093bb2680 x1830965173968128/t4294968173(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:499/0 lens 496/448 e 0 to 0 dl 1746144869 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144858.922700:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093bb2680 with x1830965173968128 ext(0->7) 00010000:00010000:0.0:1746144858.922704:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b0f2a00/0x4076af672751166d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91179 expref: 89 pid: 8432 timeout: 553 lvb_type: 0 00010000:00010000:0.0:1746144858.922711:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b0f2a00/0x4076af672751166d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91179 expref: 89 pid: 8432 timeout: 553 lvb_type: 0 00002000:00010000:0.0:1746144858.922716:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093bb2680 00000100:00100000:0.0:1746144858.925411:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.944547:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.963856:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.969243:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.976537:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.980133:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.981525:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.986207:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.986441:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.990201:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144858.996564:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.000444:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.010044:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.011448:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.014321:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.014388:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.017525:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.021592:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.030326:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.033509:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.036552:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.038756:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.041245:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.043662:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.046270:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.046307:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.048165:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.051574:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.057046:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.063548:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.068682:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.075455:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.077190:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.080606:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.081582:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.084594:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.090636:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.096815:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.103097:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.109627:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.111906:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.114402:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.116617:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.118973:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.135057:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.139686:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.142357:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.146796:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a417ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965171941376:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144859.146817:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144859.146859:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+100:1984:x1830965173977472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1969us (4503us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144859.146866:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8866 00000100:00100000:0.0:1746144859.148334:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.151017:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.159125:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.159177:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.163788:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.164511:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.164694:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.164831:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173978624 00000100:00100000:0.0:1746144859.164873:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173978624 00000100:00100000:0.0:1746144859.164984:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3449 00000100:00100000:0.0:1746144859.164989:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+101:30934:x1830965173978624:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144859.165000:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144859.165008:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0600/0x4076af67275116f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af911fe expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.165022:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e33d600/0x4076af67275116eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af911f7 expref: 101 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.165027:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144859.165028:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144859.165031:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0600/0x4076af67275116f2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af911fe expref: 101 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.165054:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012e33d600/0x4076af67275116eb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af911f7 expref: 101 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.165107:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012e33d600/0x4076af67275116eb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70080400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af911f7 expref: 101 pid: 10401 timeout: 553 lvb_type: 0 00000100:00100000:0.0:1746144859.165118:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093855500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965171941760:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144859.165250:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144859.167280:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.167311:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173978880 00000100:00100000:0.0:1746144859.167316:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173978880 00002000:00100000:0.0:1746144859.167341:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093854380 x1830965173978880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:500/0 lens 488/0 e 0 to 0 dl 1746144870 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144859.167348:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854380 with x1830965173978880 ext(0->4095) 00010000:00010000:0.0:1746144859.167353:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012e33d600/0x4076af67275116eb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af911f7 expref: 101 pid: 10401 timeout: 553 lvb_type: 0 00010000:00010000:0.0:1746144859.167367:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012e33d600/0x4076af67275116eb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af911f7 expref: 101 pid: 10401 timeout: 553 lvb_type: 0 00002000:00010000:0.0:1746144859.167372:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093854380 00000100:00100000:0.0:1746144859.167385:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 500 00000100:00100000:0.0:1746144859.167391:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1984:x1830965173978880:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144859.176921:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.180238:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.182399:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.185714:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.187377:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.188514:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.191391:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.195197:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.207511:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.213514:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.214904:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.217234:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.219068:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.221045:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.234994:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.240718:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.254661:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.259958:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.278441:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173983104 00000100:00100000:0.0:1746144859.278451:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173983104 00000100:00100000:0.0:1746144859.278506:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3456 00000100:00100000:0.0:1746144859.278514:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965173983104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144859.278528:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144859.278543:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0d1600/0x4076af6727511723 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9122f expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.278566:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b82b200/0x4076af672751171c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91228 expref: 105 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.278577:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144859.278578:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144859.278582:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d1600/0x4076af6727511723 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9122f expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.278613:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b82b200/0x4076af672751171c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91228 expref: 105 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.278622:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b82b200/0x4076af672751171c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91228 expref: 105 pid: 10401 timeout: 553 lvb_type: 0 00000100:00100000:0.0:1746144859.278632:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093369880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965171943552:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144859.279680:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144859.284581:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.294524:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.294573:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.297310:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.300758:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.304356:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.309353:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.312129:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.313710:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.315348:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.317666:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.319578:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.323433:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.326422:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.326571:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.330836:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.330875:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.343217:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.353093:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.358542:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.358590:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.362448:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.367965:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.372890:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.380844:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.398468:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.407823:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.413639:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965171945344:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144859.413670:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144859.413710:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093441180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+113:1984:x1830965173987840:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5477us (5898us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144859.413718:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8883 00000100:00100000:0.0:1746144859.418276:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.420233:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.425111:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.432123:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.432192:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.432220:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173988864 00000100:00100000:0.0:1746144859.432228:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173988864 00010000:00010000:0.0:1746144859.432281:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af6727511754 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91260 expref: 6 pid: 10401 timeout: 553 lvb_type: 0 00000100:00100000:0.0:1746144859.432310:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173988736 00000100:00100000:0.0:1746144859.432313:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173988736 00010000:00010000:0.0:1746144859.432322:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af672751175b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91267 expref: 116 pid: 10401 timeout: 553 lvb_type: 0 00000100:00100000:0.0:1746144859.432336:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8884 00000100:00100000:0.0:1746144859.432343:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093443480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965173988864:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144859.432355:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144859.432377:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af6727511754 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91260 expref: 6 pid: 10401 timeout: 553 lvb_type: 0 00010000:00010000:0.0:1746144859.432388:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af6727511754 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91260 expref: 6 pid: 10401 timeout: 553 lvb_type: 0 00010000:00010000:0.0:1746144859.432414:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144859.432452:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093443480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965173988864:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 110us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144859.432458:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8884 00000100:00100000:0.0:1746144859.432473:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8885 00000100:00100000:0.0:1746144859.432477:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+116:1985:x1830965173988736:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144859.432483:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144859.432489:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af672751175b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91267 expref: 116 pid: 10401 timeout: 553 lvb_type: 0 00010000:00010000:0.0:1746144859.432498:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af672751175b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91267 expref: 116 pid: 10401 timeout: 553 lvb_type: 0 00010000:00010000:0.0:1746144859.432510:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144859.432512:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144859.432518:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012e33cc00/0x4076af6727511762 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9126e expref: 116 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.432527:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e33cc00/0x4076af6727511762 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9126e expref: 116 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.432555:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012e33cc00/0x4076af6727511762 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9126e expref: 116 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144859.432565:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012a2b1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965171945728:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144859.432628:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144859.433483:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012a2b1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965171945728:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144859.433490:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144859.433502:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+114:1985:x1830965173988736:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1025us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144859.433507:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8885 00000100:00100000:0.0:1746144859.436268:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.436347:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.447457:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.451337:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.458593:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.466509:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.466557:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.471606:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.478963:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.483172:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.489118:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.491662:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.500005:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.523270:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.523301:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.532947:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.537723:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.544230:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.552382:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.561116:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.561145:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.561223:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.564225:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173994240 00000100:00100000:0.0:1746144859.564229:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173994240 00002000:00100000:0.0:1746144859.564264:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800a417fb80 x1830965173994240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:500/0 lens 488/0 e 0 to 0 dl 1746144870 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144859.564272:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417fb80 with x1830965173994240 ext(0->4095) 00010000:00010000:0.0:1746144859.564277:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5481a00/0x4076af672751179a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af912a6 expref: 121 pid: 20722 timeout: 553 lvb_type: 0 00010000:00010000:0.0:1746144859.564287:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5481a00/0x4076af672751179a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af912a6 expref: 121 pid: 20722 timeout: 553 lvb_type: 0 00002000:00010000:0.0:1746144859.564292:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a417fb80 00000100:00100000:0.0:1746144859.564316:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 519 00000100:00100000:0.0:1746144859.564321:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+121:1984:x1830965173994240:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144859.564460:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+121:1984:x1830965173994240:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 138us (365us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144859.564466:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 519 00002000:00100000:0.0:1746144859.564471:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800a417fb80 x1830965173994240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:500/0 lens 488/4536 e 0 to 0 dl 1746144870 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144859.564477:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417fb80 with x1830965173994240 ext(0->4095) 00010000:00010000:0.0:1746144859.564482:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a5481a00/0x4076af672751179a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af912a6 expref: 121 pid: 20722 timeout: 553 lvb_type: 0 00010000:00010000:0.0:1746144859.564490:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a5481a00/0x4076af672751179a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af912a6 expref: 121 pid: 20722 timeout: 553 lvb_type: 0 00002000:00010000:0.0:1746144859.564495:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a417fb80 00000100:00100000:0.0:1746144859.568451:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.572406:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.576805:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.581603:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.584073:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.588989:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.598138:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.605672:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.605837:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.607398:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.609395:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.613425:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.615809:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.622287:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.624228:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.628422:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.631276:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.631321:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.634616:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.635040:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.635076:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.635093:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173997824 00000100:00100000:0.0:1746144859.635097:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173997824 00010000:00010000:0.0:1746144859.635120:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af67275117bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af912c9 expref: 126 pid: 10401 timeout: 553 lvb_type: 0 00000100:00100000:0.0:1746144859.635738:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173998080 00000100:00100000:0.0:1746144859.635741:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173998080 00010000:00010000:0.0:1746144859.635750:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5481800/0x4076af67275117b6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af912c2 expref: 6 pid: 20722 timeout: 553 lvb_type: 0 00000100:00100000:0.0:1746144859.639039:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.644109:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.651033:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.661834:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.665189:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.665233:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.670218:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.671108:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.671133:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965173999616 00000100:00100000:0.0:1746144859.671135:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965173999616 00010000:00010000:0.0:1746144859.671149:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0d8400/0x4076af67275117cb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af912d7 expref: 128 pid: 8430 timeout: 553 lvb_type: 0 00000100:00100000:0.0:1746144859.671174:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8901 00000100:00100000:0.0:1746144859.671179:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+128:1984:x1830965173999616:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144859.671186:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144859.671200:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d0d8400/0x4076af67275117cb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af912d7 expref: 128 pid: 8430 timeout: 553 lvb_type: 0 00010000:00010000:0.0:1746144859.671207:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d0d8400/0x4076af67275117cb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af912d7 expref: 128 pid: 8430 timeout: 553 lvb_type: 0 00010000:00010000:0.0:1746144859.671225:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144859.671267:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+128:1984:x1830965173999616:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 88us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144859.671272:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8901 00000100:00100000:0.0:1746144859.676436:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.679840:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.687889:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.692413:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.696329:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.700566:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.700608:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.703536:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.704377:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.708033:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.713656:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.718021:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.724787:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.730088:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.737367:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.737451:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.741470:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.742182:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.750300:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.754189:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.758952:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.762276:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.770003:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.770047:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.773329:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.780592:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.784290:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.799196:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.800728:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.803984:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.804072:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.806964:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.806991:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.807235:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.809817:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.813103:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.816203:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.823635:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.826107:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.828585:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.841813:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.846309:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.847792:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.851147:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.851172:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.851198:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.851222:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174008448 00000100:00100000:0.0:1746144859.851228:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174008448 00000100:00100000:0.0:1746144859.851273:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3496 00000100:00100000:0.0:1746144859.851278:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+137:30934:x1830965174008448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144859.851290:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144859.851302:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0200/0x4076af672751183b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91347 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.851319:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144859.851323:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091708c00/0x4076af6727511834 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91340 expref: 138 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.851329:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144859.851331:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0200/0x4076af672751183b lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91347 expref: 138 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.851356:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091708c00/0x4076af6727511834 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91340 expref: 138 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.851367:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0200/0x4076af672751183b lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91347 expref: 138 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.851375:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d0200, rc 0) 00000100:00100000:0.0:1746144859.851401:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+138:30934:x1830965174008448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 122us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144859.851406:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3496 00000100:00100000:0.0:1746144859.855657:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.862202:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.864243:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.871502:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.883024:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.884414:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.893798:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.894302:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965171952896:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144859.894324:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727511849 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91355 expref: 140 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.894337:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091709400, rc 0) 00000100:00100000:0.0:1746144859.894563:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+140:30931:x1830965174009600:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 8984us (11545us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144859.894569:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3498 00000100:00100000:0.0:1746144859.895417:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.900534:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.903683:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174010496 00000100:00100000:0.0:1746144859.903690:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174010496 00000100:00100000:0.0:1746144859.903722:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3499 00000100:00100000:0.0:1746144859.903728:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965174010496:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144859.903742:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144859.903756:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0400/0x4076af6727511850 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9135c expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.903795:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727511849 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91355 expref: 138 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.903801:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144859.903803:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144859.903806:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0400/0x4076af6727511850 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9135c expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.903825:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727511849 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91355 expref: 138 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144859.903835:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727511849 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91355 expref: 138 pid: 10401 timeout: 554 lvb_type: 0 00000100:00100000:0.0:1746144859.903844:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093254e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965171953152:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144859.904398:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144859.907473:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.917599:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.922133:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.929732:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.931310:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.933593:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.945702:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.947848:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.950181:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.955510:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.960707:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.965396:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.975224:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.978394:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.985116:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144859.992280:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.001735:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.001890:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.010550:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.011382:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.029972:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093254700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965171954432:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144860.029998:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d327000/0x4076af672751187a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91386 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.030014:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d327000, rc 0) 00000100:00100000:0.0:1746144860.030050:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965174014464:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 15190us (15663us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144860.030057:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3505 00000100:00100000:0.0:1746144860.032208:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.034718:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.049612:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.049658:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.053354:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.055319:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.058393:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174016256 00000100:00100000:0.0:1746144860.058397:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174016256 00010000:00010000:0.0:1746144860.058417:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b763000/0x4076af6727511881 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9138d expref: 145 pid: 20722 timeout: 554 lvb_type: 0 00000100:00100000:0.0:1746144860.058437:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8927 00000100:00100000:0.0:1746144860.058442:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+145:1985:x1830965174016256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144860.058453:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144860.058469:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b763000/0x4076af6727511881 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9138d expref: 145 pid: 20722 timeout: 554 lvb_type: 0 00010000:00010000:0.0:1746144860.058479:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b763000/0x4076af6727511881 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9138d expref: 145 pid: 20722 timeout: 554 lvb_type: 0 00010000:00010000:0.0:1746144860.058496:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b763000/0x4076af6727511881 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9138d expref: 145 pid: 20722 timeout: 554 lvb_type: 0 00010000:00010000:0.0:1746144860.058513:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144860.058514:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144860.058520:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093f06000/0x4076af6727511888 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91394 expref: 144 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.058526:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093f06000/0x4076af6727511888 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91394 expref: 144 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.058552:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093f06000/0x4076af6727511888 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91394 expref: 144 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144860.058562:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965171954944:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144860.058626:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144860.061867:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.069270:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.078010:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.083323:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.089675:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.090226:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.093555:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.103327:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.109294:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.112451:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.117213:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.118531:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.124304:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.124366:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.124390:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.131479:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174019840 00000100:00100000:0.0:1746144860.131486:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174019840 00002000:00100000:0.0:1746144860.131512:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff880093f45c00 x1830965174019840/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:501/0 lens 496/0 e 0 to 0 dl 1746144871 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144860.131520:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f45c00 with x1830965174019840 ext(0->7) 00010000:00010000:0.0:1746144860.131526:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af67275118ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af913b7 expref: 148 pid: 8430 timeout: 554 lvb_type: 0 00010000:00010000:0.0:1746144860.131536:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af67275118ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af913b7 expref: 148 pid: 8430 timeout: 554 lvb_type: 0 00002000:00010000:0.0:1746144860.131543:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f45c00 00000100:00100000:0.0:1746144860.131565:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 554 00000100:00100000:0.0:1746144860.131572:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+148:1985:x1830965174019840:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144860.131828:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+150:1985:x1830965174019840:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 Request processed in 256us (502us total) trans 4294968204 rc 0/0 00000100:00100000:0.0:1746144860.131834:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 554 00002000:00100000:0.0:1746144860.131840:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff880093f45c00 x1830965174019840/t4294968204(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:501/0 lens 496/448 e 0 to 0 dl 1746144871 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144860.131846:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f45c00 with x1830965174019840 ext(0->7) 00010000:00010000:0.0:1746144860.131851:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af67275118ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af913b7 expref: 150 pid: 8430 timeout: 554 lvb_type: 0 00010000:00010000:0.0:1746144860.131859:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af67275118ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af913b7 expref: 150 pid: 8430 timeout: 554 lvb_type: 0 00002000:00010000:0.0:1746144860.131864:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093f45c00 00000100:00100000:0.0:1746144860.140917:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.147855:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.149188:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.153861:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.157128:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.171216:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.181179:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.184598:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.188794:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.197056:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.199782:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.199848:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.203932:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.208098:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.210056:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.213646:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.216543:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.219674:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.223126:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.223694:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.227527:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.229553:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.231143:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.231583:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.237480:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.239739:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.241979:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.244582:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.248186:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.251870:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.257675:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.257710:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.261301:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.264751:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.267160:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.269006:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.271244:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.272738:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.283584:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.290885:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174027648 00000100:00100000:0.0:1746144860.290888:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174027648 00002000:00100000:0.0:1746144860.290909:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093443100 x1830965174027648/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:501/0 lens 488/0 e 0 to 0 dl 1746144871 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144860.290917:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093443100 with x1830965174027648 ext(0->4095) 00010000:00010000:0.0:1746144860.290922:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af67275118ff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9140b expref: 160 pid: 8430 timeout: 554 lvb_type: 0 00010000:00010000:0.0:1746144860.290930:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af67275118ff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9140b expref: 160 pid: 8430 timeout: 554 lvb_type: 0 00002000:00010000:0.0:1746144860.290935:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093443100 00000100:00100000:0.0:1746144860.290947:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 561 00000100:00100000:0.0:1746144860.290951:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+160:1982:x1830965174027648:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144860.291068:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+160:1982:x1830965174027648:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 115us (591us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144860.291073:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 561 00002000:00100000:0.0:1746144860.291079:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093443100 x1830965174027648/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:501/0 lens 488/4536 e 0 to 0 dl 1746144871 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144860.291084:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093443100 with x1830965174027648 ext(0->4095) 00010000:00010000:0.0:1746144860.291088:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af67275118ff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9140b expref: 160 pid: 8430 timeout: 554 lvb_type: 0 00010000:00010000:0.0:1746144860.291101:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af67275118ff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9140b expref: 160 pid: 8430 timeout: 554 lvb_type: 0 00002000:00010000:0.0:1746144860.291477:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093443100 00000100:00100000:0.0:1746144860.297169:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.297212:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.299193:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.305921:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.309071:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.315950:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.323284:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.329723:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.331397:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.335931:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.335972:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.341821:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.341856:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.341891:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.360336:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.366634:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.381523:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.390068:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.394052:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.400016:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.406893:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.413998:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.414021:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.414042:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174032000 00000100:00100000:0.0:1746144860.414049:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174032000 00000100:00100000:0.0:1746144860.414093:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3532 00000100:00100000:0.0:1746144860.414100:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+164:30934:x1830965174032000:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144860.414114:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144860.414127:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0d1a00/0x4076af6727511937 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91443 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.414147:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144860.414152:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727511930 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9143c expref: 165 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.414157:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144860.414160:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d1a00/0x4076af6727511937 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91443 expref: 165 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.414188:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727511930 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9143c expref: 165 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.414197:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0d1a00/0x4076af6727511937 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91443 expref: 165 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.414206:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d1a00, rc 0) 00000100:00100000:0.0:1746144860.415713:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+165:30934:x1830965174032000:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1171us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144860.415720:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3532 00000100:00100000:0.0:1746144860.415745:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174032128 00000100:00100000:0.0:1746144860.415748:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174032128 00010000:00010000:0.0:1746144860.415761:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727511922 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9142e expref: 6 pid: 20722 timeout: 554 lvb_type: 0 00000100:00100000:0.0:1746144860.415795:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8951 00000100:00100000:0.0:1746144860.415800:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174032128:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144860.415808:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144860.415818:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727511922 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9142e expref: 6 pid: 20722 timeout: 554 lvb_type: 0 00010000:00010000:0.0:1746144860.415828:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727511922 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9142e expref: 6 pid: 20722 timeout: 554 lvb_type: 0 00010000:00010000:0.0:1746144860.415840:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727511922 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9142e expref: 6 pid: 20722 timeout: 554 lvb_type: 0 00010000:00010000:0.0:1746144860.415852:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144860.415853:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144860.415858:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727511930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9143c expref: 162 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.415865:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727511930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9143c expref: 162 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.415887:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727511930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9143c expref: 162 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.415896:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727511930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9143c expref: 162 pid: 8430 timeout: 554 lvb_type: 0 00000100:00100000:0.0:1746144860.415906:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915e0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965171960448:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144860.415942:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144860.439568:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.447290:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801358ed500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965171960576:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144860.447307:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144860.447349:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+164:1983:x1830965174032768:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4718us (4823us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144860.447357:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8952 00000100:00100000:0.0:1746144860.448689:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.455635:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.455679:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.459299:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.459738:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.463988:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.466477:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.475615:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.479726:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.489463:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.489517:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.494970:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.496920:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.499144:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.504043:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.509320:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.511879:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.523398:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.526469:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.529566:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.529602:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.531372:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.544145:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.549238:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.553867:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174037632 00000100:00100000:0.0:1746144860.553872:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174037632 00002000:00100000:0.0:1746144860.553903:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880135ea5c00 x1830965174037632/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:501/0 lens 488/0 e 0 to 0 dl 1746144871 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144860.553910:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5c00 with x1830965174037632 ext(0->4095) 00002000:00010000:0.0:1746144860.553913:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ea5c00 00000100:00100000:0.0:1746144860.553926:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2968 00000100:00100000:0.0:1746144860.553932:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+170:1984:x1830965174037632:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144860.557521:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.557567:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.561669:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.571207:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.575392:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.585728:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.591921:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.594616:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.596161:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.598521:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.599669:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.599704:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.602533:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.605315:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.605359:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174040320 00000100:00100000:0.0:1746144860.605363:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174040320 00002000:00100000:0.0:1746144860.605387:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff880087547800 x1830965174040320/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:501/0 lens 496/0 e 0 to 0 dl 1746144871 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144860.605395:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087547800 with x1830965174040320 ext(0->7) 00010000:00010000:0.0:1746144860.605400:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af672751198b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91497 expref: 172 pid: 10401 timeout: 554 lvb_type: 0 00010000:00010000:0.0:1746144860.605409:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af672751198b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91497 expref: 172 pid: 10401 timeout: 554 lvb_type: 0 00002000:00010000:0.0:1746144860.605415:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880087547800 00000100:00100000:0.0:1746144860.605439:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 579 00000100:00100000:0.0:1746144860.605444:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+172:1983:x1830965174040320:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144860.605679:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+174:1983:x1830965174040320:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 Request processed in 234us (364us total) trans 4294968216 rc 0/0 00000100:00100000:0.0:1746144860.605684:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 579 00002000:00100000:0.0:1746144860.605689:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff880087547800 x1830965174040320/t4294968216(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:501/0 lens 496/448 e 0 to 0 dl 1746144871 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144860.605695:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087547800 with x1830965174040320 ext(0->7) 00010000:00010000:0.0:1746144860.605699:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af672751198b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91497 expref: 174 pid: 10401 timeout: 554 lvb_type: 0 00010000:00010000:0.0:1746144860.605707:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af672751198b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91497 expref: 174 pid: 10401 timeout: 554 lvb_type: 0 00002000:00010000:0.0:1746144860.605712:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880087547800 00000100:00100000:0.0:1746144860.609503:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.614179:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.617675:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.624050:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.631188:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.632384:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.635571:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.635933:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.636490:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.636503:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174041856 00000100:00100000:0.0:1746144860.636506:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174041856 00010000:00010000:0.0:1746144860.636518:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727511992 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9149e expref: 6 pid: 10401 timeout: 554 lvb_type: 0 00000100:00100000:0.0:1746144860.636531:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8967 00000100:00100000:0.0:1746144860.636535:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174041856:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144860.636541:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144860.636548:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727511992 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9149e expref: 6 pid: 10401 timeout: 554 lvb_type: 0 00010000:00010000:0.0:1746144860.636556:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727511992 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9149e expref: 6 pid: 10401 timeout: 554 lvb_type: 0 00010000:00010000:0.0:1746144860.636567:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727511992 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9149e expref: 6 pid: 10401 timeout: 554 lvb_type: 0 00010000:00010000:0.0:1746144860.636577:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144860.636579:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144860.636584:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d326a00/0x4076af67275119a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af914ac expref: 174 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.636590:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d326a00/0x4076af67275119a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af914ac expref: 174 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.636613:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d326a00/0x4076af67275119a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af914ac expref: 174 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.636621:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d326a00/0x4076af67275119a0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af914ac expref: 174 pid: 8430 timeout: 554 lvb_type: 0 00000100:00100000:0.0:1746144860.636629:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915e0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965171964928:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144860.636666:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144860.639717:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.642075:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.649468:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.652078:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.658317:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.661798:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.663197:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.665309:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.665805:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.665856:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.671471:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.674198:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.676397:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.694173:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.703224:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.703462:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.709564:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965171966080:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144860.709577:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144860.709623:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+179:1984:x1830965174044928:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5397us (6161us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144860.709630:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8972 00000100:00100000:0.0:1746144860.715917:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.721665:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.730171:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.732649:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.735823:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.750486:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.751997:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.758116:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.763350:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.763385:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.763419:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.763445:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174047232 00000100:00100000:0.0:1746144860.763451:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174047232 00000100:00100000:0.0:1746144860.763494:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3556 00000100:00100000:0.0:1746144860.763501:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+181:30934:x1830965174047232:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144860.763515:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144860.763529:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935cc000/0x4076af67275119df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af914eb expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.763850:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144860.763856:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d327600/0x4076af67275119d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af914e4 expref: 182 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.763862:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144860.763865:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935cc000/0x4076af67275119df lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af914eb expref: 182 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.763889:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d327600/0x4076af67275119d8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af914e4 expref: 182 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.763899:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935cc000/0x4076af67275119df lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af914eb expref: 182 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.763907:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cc000, rc 0) 00000100:00100000:0.0:1746144860.763936:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+182:30934:x1830965174047232:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 435us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144860.763941:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3556 00000100:00100000:0.0:1746144860.764045:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8975 00000100:00100000:0.0:1746144860.764051:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174047104:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144860.764058:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144860.766393:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.770405:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.777153:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.786944:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.796316:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.798218:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.808239:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.812019:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.817835:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.822881:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.835831:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.857821:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.862029:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.862082:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.867820:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.876264:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.885533:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.892546:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.901639:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.908107:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.917277:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.917323:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.920386:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.921617:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.927012:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.940436:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.950682:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.953093:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.954583:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.959478:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.959519:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.962023:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.968013:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.972011:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.980474:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.985294:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.987711:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.990136:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.990384:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174054016 00000100:00100000:0.0:1746144860.990390:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174054016 00000100:00100000:0.0:1746144860.990422:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3567 00000100:00100000:0.0:1746144860.990427:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+189:30934:x1830965174054016:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144860.990442:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144860.990455:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099aff600/0x4076af6727511a2c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91538 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.990475:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144860.990476:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144860.990482:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099aff600/0x4076af6727511a2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91538 expref: 190 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.990492:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099aff600/0x4076af6727511a2c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91538 expref: 190 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.990500:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099aff600, rc 0) 00000100:00100000:0.0:1746144860.990527:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+190:30934:x1830965174054016:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 101us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144860.990533:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3567 00000100:00100000:0.0:1746144860.992760:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.992817:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.999628:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.999659:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.999707:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144860.999741:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174054784 00000100:00100000:0.0:1746144860.999747:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174054784 00000100:00100000:0.0:1746144860.999802:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3569 00000100:00100000:0.0:1746144860.999809:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+192:30934:x1830965174054784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144860.999824:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144860.999838:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099aff200/0x4076af6727511a3a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91546 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.999861:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144860.999866:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af6727511a33 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9153f expref: 193 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.999872:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144860.999875:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099aff200/0x4076af6727511a3a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91546 expref: 193 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.999904:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af6727511a33 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9153f expref: 193 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.999914:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099aff200/0x4076af6727511a3a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91546 expref: 193 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144860.999923:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099aff200, rc 0) 00000100:00100000:0.0:1746144860.999963:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+193:30934:x1830965174054784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 155us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144860.999969:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3569 00000100:00100000:0.0:1746144861.005787:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.023334:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.029332:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.030050:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.046315:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.052443:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.052618:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.055901:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.056088:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174056320 00000100:00100000:0.0:1746144861.056094:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174056320 00002000:00100000:0.0:1746144861.056127:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88008ee4aa00 x1830965174056320/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:502/0 lens 488/0 e 0 to 0 dl 1746144872 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144861.056136:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee4aa00 with x1830965174056320 ext(0->4095) 00010000:00010000:0.0:1746144861.056143:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727511a41 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9154d expref: 193 pid: 20722 timeout: 555 lvb_type: 0 00010000:00010000:0.0:1746144861.056154:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727511a41 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9154d expref: 193 pid: 20722 timeout: 555 lvb_type: 0 00002000:00010000:0.0:1746144861.056160:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ee4aa00 00000100:00100000:0.0:1746144861.056177:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 602 00000100:00100000:0.0:1746144861.056183:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+193:1985:x1830965174056320:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144861.056877:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+193:1985:x1830965174056320:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 693us (980us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144861.056884:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 602 00002000:00100000:0.0:1746144861.056889:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88008ee4aa00 x1830965174056320/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:502/0 lens 488/4536 e 0 to 0 dl 1746144872 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144861.056896:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee4aa00 with x1830965174056320 ext(0->4095) 00010000:00010000:0.0:1746144861.056900:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727511a41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9154d expref: 193 pid: 20722 timeout: 555 lvb_type: 0 00010000:00010000:0.0:1746144861.056908:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727511a41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9154d expref: 192 pid: 20722 timeout: 555 lvb_type: 0 00002000:00010000:0.0:1746144861.057063:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ee4aa00 00000100:00100000:0.0:1746144861.058895:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.063921:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.071599:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.074356:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.081160:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.086412:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.093934:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.094251:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.094269:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174057856 00000100:00100000:0.0:1746144861.094274:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174057856 00010000:00010000:0.0:1746144861.094296:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727511a4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9155b expref: 195 pid: 20722 timeout: 555 lvb_type: 0 00000100:00100000:0.0:1746144861.094312:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174057984 00000100:00100000:0.0:1746144861.094314:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174057984 00010000:00010000:0.0:1746144861.094323:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af6727511a48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91554 expref: 6 pid: 20722 timeout: 555 lvb_type: 0 00000100:00100000:0.0:1746144861.094335:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8992 00000100:00100000:0.0:1746144861.094340:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+195:1984:x1830965174057856:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144861.094349:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144861.094366:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727511a4f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9155b expref: 195 pid: 20722 timeout: 555 lvb_type: 0 00010000:00010000:0.0:1746144861.094376:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727511a4f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9155b expref: 195 pid: 20722 timeout: 555 lvb_type: 0 00010000:00010000:0.0:1746144861.094396:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727511a4f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9155b expref: 195 pid: 20722 timeout: 555 lvb_type: 0 00010000:00010000:0.0:1746144861.094408:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144861.094427:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+194:1984:x1830965174057856:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 86us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144861.094432:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8992 00000100:00100000:0.0:1746144861.094443:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8993 00000100:00100000:0.0:1746144861.094448:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee48a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174057984:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144861.094454:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144861.094461:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af6727511a48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91554 expref: 6 pid: 20722 timeout: 555 lvb_type: 0 00010000:00010000:0.0:1746144861.094469:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af6727511a48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91554 expref: 6 pid: 20722 timeout: 555 lvb_type: 0 00010000:00010000:0.0:1746144861.094480:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af6727511a48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91554 expref: 6 pid: 20722 timeout: 555 lvb_type: 0 00010000:00010000:0.0:1746144861.094487:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144861.094489:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144861.094495:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727511a56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91562 expref: 193 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.094501:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727511a56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91562 expref: 193 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.094525:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727511a56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91562 expref: 193 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144861.094534:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee49c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965171970688:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144861.094578:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144861.097688:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.098443:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.098471:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174058368 00000100:00100000:0.0:1746144861.098476:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174058368 00002000:00100000:0.0:1746144861.098505:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800915f0000 x1830965174058368/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:502/0 lens 488/0 e 0 to 0 dl 1746144872 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144861.098514:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915f0000 with x1830965174058368 ext(0->4095) 00002000:00010000:0.0:1746144861.098518:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800915f0000 00000100:00100000:0.0:1746144861.107514:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174058624 00000100:00100000:0.0:1746144861.107522:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174058624 00002000:00100000:0.0:1746144861.107555:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff88008ee49c00 x1830965174058624/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:502/0 lens 496/0 e 0 to 0 dl 1746144872 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144861.107564:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee49c00 with x1830965174058624 ext(0->7) 00010000:00010000:0.0:1746144861.107572:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727511a56 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91562 expref: 196 pid: 10401 timeout: 555 lvb_type: 0 00010000:00010000:0.0:1746144861.107590:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727511a56 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91562 expref: 196 pid: 10401 timeout: 555 lvb_type: 0 00002000:00010000:0.0:1746144861.107596:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ee49c00 00000100:00100000:0.0:1746144861.107619:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 605 00000100:00100000:0.0:1746144861.107624:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+196:1984:x1830965174058624:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144861.107883:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+198:1984:x1830965174058624:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 Request processed in 258us (431us total) trans 4294968227 rc 0/0 00000100:00100000:0.0:1746144861.107889:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 605 00002000:00100000:0.0:1746144861.107894:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff88008ee49c00 x1830965174058624/t4294968227(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:502/0 lens 496/448 e 0 to 0 dl 1746144872 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144861.107901:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee49c00 with x1830965174058624 ext(0->7) 00010000:00010000:0.0:1746144861.107905:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727511a56 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91562 expref: 198 pid: 10401 timeout: 555 lvb_type: 0 00010000:00010000:0.0:1746144861.107913:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727511a56 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91562 expref: 198 pid: 10401 timeout: 555 lvb_type: 0 00002000:00010000:0.0:1746144861.107919:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ee49c00 00000100:00100000:0.0:1746144861.115695:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.117832:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.121696:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.138549:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.144296:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.145930:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.149133:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.151988:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.160846:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.164019:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.170117:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.177481:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.178918:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.180400:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.186229:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.186286:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.186323:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.194168:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.199790:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.201774:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.208330:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.211173:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.218337:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.219165:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.224174:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.224202:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.226727:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.228895:0:7099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087547b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965171972736:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144861.228908:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144861.228947:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008baf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965174063616:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2079us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144861.228954:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9002 00000100:00100000:0.0:1746144861.239119:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.242408:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.244512:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.248072:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.254039:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.259702:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.260339:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.262809:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.262838:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.262868:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.262887:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174065664 00000100:00100000:0.0:1746144861.262890:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174065664 00000100:00100000:0.0:1746144861.262917:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3586 00000100:00100000:0.0:1746144861.262923:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965174065664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144861.262935:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144861.262947:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727511ab1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af915bd expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.262967:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144861.262972:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2400/0x4076af6727511aaa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af915b6 expref: 203 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.262976:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144861.262978:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727511ab1 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af915bd expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.263004:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b2400/0x4076af6727511aaa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af915b6 expref: 203 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.263017:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727511ab1 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af915bd expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.263025:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d0000, rc 0) 00000100:00100000:0.0:1746144861.263055:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:30934:x1830965174065664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 132us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144861.263060:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3586 00000100:00100000:0.0:1746144861.267646:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.274424:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.278331:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.281305:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.288876:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.290375:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.295190:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.295998:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.299874:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.299922:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.303673:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.312280:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.316993:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.319913:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.324262:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.326175:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.329084:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.329994:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.331577:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.332387:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.335091:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.341595:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.346391:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.351109:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174070400 00000100:00100000:0.0:1746144861.351117:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174070400 00002000:00100000:0.0:1746144861.351156:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880087546680 x1830965174070400/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:502/0 lens 488/0 e 0 to 0 dl 1746144872 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144861.351170:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087546680 with x1830965174070400 ext(0->4095) 00002000:00010000:0.0:1746144861.351174:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087546680 00000100:00100000:0.0:1746144861.351195:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3001 00000100:00100000:0.0:1746144861.351201:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+209:1985:x1830965174070400:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144861.351623:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+208:1985:x1830965174070400:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 421us (922us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144861.351629:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3001 00002000:00100000:0.0:1746144861.351634:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880087546680 x1830965174070400/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:502/0 lens 488/4536 e 0 to 0 dl 1746144872 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144861.351640:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087546680 with x1830965174070400 ext(0->4095) 00002000:00010000:0.0:1746144861.351643:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087546680 00000100:00100000:0.0:1746144861.355041:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.357362:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.361336:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.361379:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.364502:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.364538:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.365355:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.368498:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.371039:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.375265:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.378178:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.382581:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.385928:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.385981:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.389644:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.397111:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.401102:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.405673:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.411254:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.414170:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.418862:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.423943:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.426565:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.427930:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.434950:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.435352:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.439708:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.443022:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.455549:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.458540:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.464583:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.468612:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.469782:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.475461:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.475534:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.477428:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.481606:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.487861:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.490878:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.512363:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.512402:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.517647:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.518816:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.522617:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.529661:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.534268:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.540502:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.545223:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.550145:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.555445:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.555524:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.560318:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.566485:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.581363:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174080768 00000100:00100000:0.0:1746144861.581370:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174080768 00000100:00100000:0.0:1746144861.581411:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3610 00000100:00100000:0.0:1746144861.581417:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+219:30931:x1830965174080768:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144861.581431:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144861.581445:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4fe6800/0x4076af6727511b59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91665 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.581466:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144861.581471:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727511b52 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9165e expref: 220 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.581477:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746144861.581480:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4fe6800/0x4076af6727511b59 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91665 expref: 220 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.581508:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727511b52 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9165e expref: 220 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.581517:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4fe6800/0x4076af6727511b59 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91665 expref: 220 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.581525:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4fe6800, rc 0) 00000100:00100000:0.0:1746144861.581557:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+220:30931:x1830965174080768:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 140us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144861.581562:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3610 00000100:00100000:0.0:1746144861.586396:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.589350:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.597487:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.597538:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.604555:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.608259:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.612595:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.619160:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.621835:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.623415:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.649088:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.649128:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.661136:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.661665:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.666467:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.670385:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.676093:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.679944:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.684617:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.689923:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.689995:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.694605:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.694639:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.697072:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.700521:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.705449:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.708991:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.716353:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.722365:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.724816:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.727810:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.727884:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.730982:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.732671:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.736388:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.740033:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.745498:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.749803:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.763304:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174088320 00000100:00100000:0.0:1746144861.763309:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174088320 00002000:00100000:0.0:1746144861.763331:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88008ee4b100 x1830965174088320/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:502/0 lens 488/0 e 0 to 0 dl 1746144872 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144861.763338:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee4b100 with x1830965174088320 ext(0->4095) 00010000:00010000:0.0:1746144861.763344:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d326c00/0x4076af6727511b98 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af916a4 expref: 230 pid: 8430 timeout: 555 lvb_type: 0 00010000:00010000:0.0:1746144861.763352:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d326c00/0x4076af6727511b98 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af916a4 expref: 230 pid: 8430 timeout: 555 lvb_type: 0 00002000:00010000:0.0:1746144861.763357:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ee4b100 00000100:00100000:0.0:1746144861.763370:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 643 00000100:00100000:0.0:1746144861.763375:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+230:1983:x1830965174088320:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144861.763494:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+230:1983:x1830965174088320:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 118us (823us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144861.763499:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 643 00002000:00100000:0.0:1746144861.763504:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88008ee4b100 x1830965174088320/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:502/0 lens 488/4536 e 0 to 0 dl 1746144872 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144861.763510:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee4b100 with x1830965174088320 ext(0->4095) 00010000:00010000:0.0:1746144861.763514:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012d326c00/0x4076af6727511b98 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af916a4 expref: 230 pid: 8430 timeout: 555 lvb_type: 0 00010000:00010000:0.0:1746144861.763520:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012d326c00/0x4076af6727511b98 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af916a4 expref: 230 pid: 8430 timeout: 555 lvb_type: 0 00002000:00010000:0.0:1746144861.763524:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008ee4b100 00000100:00100000:0.0:1746144861.776107:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.779463:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.785735:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.795830:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.795878:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.798305:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.801312:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.804398:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.804441:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.808030:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.814336:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.821337:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.827625:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.838459:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.838823:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.844490:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.847587:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.850910:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.852044:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.857153:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.865909:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.869413:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.875440:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.878790:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.880200:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.887150:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.891043:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.898152:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.900852:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.906509:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.907878:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.910055:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174094976 00000100:00100000:0.0:1746144861.910060:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174094976 00002000:00100000:0.0:1746144861.910092:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009b460380 x1830965174094976/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:502/0 lens 488/0 e 0 to 0 dl 1746144872 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144861.910101:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460380 with x1830965174094976 ext(0->4095) 00010000:00010000:0.0:1746144861.910107:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727511bec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af916f8 expref: 6 pid: 8430 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144861.910117:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727511bec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af916f8 expref: 6 pid: 8430 timeout: 556 lvb_type: 0 00002000:00010000:0.0:1746144861.910122:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b460380 00000100:00100000:0.0:1746144861.910329:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 654 00000100:00100000:0.0:1746144861.910335:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174094976:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144861.910572:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174094976:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 236us (595us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144861.910578:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 654 00002000:00100000:0.0:1746144861.910583:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009b460380 x1830965174094976/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:502/0 lens 488/4536 e 0 to 0 dl 1746144872 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144861.910590:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460380 with x1830965174094976 ext(0->4095) 00010000:00010000:0.0:1746144861.910594:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727511bec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af916f8 expref: 6 pid: 8430 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144861.910606:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727511bec lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af916f8 expref: 6 pid: 8430 timeout: 556 lvb_type: 0 00002000:00010000:0.0:1746144861.910610:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b460380 00000100:00100000:0.0:1746144861.912043:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.913191:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174095232 00000100:00100000:0.0:1746144861.913195:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174095232 00010000:00010000:0.0:1746144861.913209:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727511bec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af916f8 expref: 6 pid: 8430 timeout: 556 lvb_type: 0 00000100:00100000:0.0:1746144861.913266:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9052 00000100:00100000:0.0:1746144861.913272:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087544700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965174095232:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144861.913281:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144861.913291:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727511bec lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af916f8 expref: 6 pid: 8430 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144861.913298:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727511bec lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af916f8 expref: 6 pid: 8430 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144861.913310:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091709a00/0x4076af6727511bec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af916f8 expref: 6 pid: 8430 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144861.913330:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144861.913332:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144861.913337:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091708200/0x4076af6727511bf3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af916ff expref: 235 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.913348:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091708200/0x4076af6727511bf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af916ff expref: 235 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.913438:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091708200/0x4076af6727511bf3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af916ff expref: 235 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144861.913448:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965171983616:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144861.913639:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144861.915719:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.921325:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.936878:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.945581:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.948421:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.955199:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174096256 00000100:00100000:0.0:1746144861.955205:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174096256 00002000:00100000:0.0:1746144861.955246:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009b460700 x1830965174096256/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:502/0 lens 488/0 e 0 to 0 dl 1746144872 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144861.955255:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460700 with x1830965174096256 ext(0->4095) 00010000:00010000:0.0:1746144861.955262:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727511bfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91706 expref: 6 pid: 8430 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144861.955274:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727511bfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91706 expref: 6 pid: 8430 timeout: 556 lvb_type: 0 00002000:00010000:0.0:1746144861.955280:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b460700 00000100:00100000:0.0:1746144861.955306:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 656 00000100:00100000:0.0:1746144861.955312:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174096256:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144861.955432:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174096256:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 119us (639us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144861.955437:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 656 00002000:00100000:0.0:1746144861.955442:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009b460700 x1830965174096256/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:502/0 lens 488/4536 e 0 to 0 dl 1746144872 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144861.955449:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460700 with x1830965174096256 ext(0->4095) 00010000:00010000:0.0:1746144861.955454:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727511bfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91706 expref: 6 pid: 8430 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144861.955463:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727511bfa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91706 expref: 6 pid: 8430 timeout: 556 lvb_type: 0 00002000:00010000:0.0:1746144861.955468:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b460700 00000100:00100000:0.0:1746144861.957694:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.962169:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.966557:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174096768 00000100:00100000:0.0:1746144861.966565:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174096768 00000100:00100000:0.0:1746144861.966596:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3635 00000100:00100000:0.0:1746144861.966602:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009971f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965174096768:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144861.966615:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144861.966627:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a939000/0x4076af6727511c08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91714 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.966649:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af6727511c01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9170d expref: 237 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.966655:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144861.966657:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144861.966660:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a939000/0x4076af6727511c08 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91714 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.966683:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af6727511c01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9170d expref: 237 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144861.966693:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af6727511c01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9170d expref: 237 pid: 8430 timeout: 556 lvb_type: 0 00000100:00100000:0.0:1746144861.966703:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965171984256:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144861.966797:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144861.971835:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.976561:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.982150:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174097280 00000100:00100000:0.0:1746144861.982157:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174097280 00002000:00100000:0.0:1746144861.982189:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009b460a80 x1830965174097280/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:502/0 lens 488/0 e 0 to 0 dl 1746144872 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144861.982198:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460a80 with x1830965174097280 ext(0->4095) 00002000:00010000:0.0:1746144861.982201:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b460a80 00000100:00100000:0.0:1746144861.982228:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3029 00000100:00100000:0.0:1746144861.982242:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965174097280:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144861.982367:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965174097280:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 125us (1063us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144861.982375:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3029 00002000:00100000:0.0:1746144861.982380:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009b460a80 x1830965174097280/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:502/0 lens 488/4536 e 0 to 0 dl 1746144872 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144861.982385:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460a80 with x1830965174097280 ext(0->4095) 00002000:00010000:0.0:1746144861.982388:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b460a80 00000100:00100000:0.0:1746144861.988138:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.991404:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.993321:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144861.996477:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.007379:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.007840:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144862.009717:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144862.009758:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.012561:0:3308:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746144862.012576:0:3308:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1830965171985024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746144862.012624:0:3308:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144862.013551:0:3308:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087546300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1830965171985024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746144862.018606:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.021101:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.023841:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.027527:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.033126:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.035315:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.037506:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.045538:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.050672:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.051105:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.054498:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.059119:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.079631:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.082850:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.083382:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.086359:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.089317:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.091663:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.093846:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.095626:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.097497:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.099663:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.105689:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.107947:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.109935:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b461c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965171986432:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144862.109945:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b463100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965171986560:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144862.110017:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880093936000/0x4076af6727511c4e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9175a expref: 247 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.110031:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093936000, rc 0) 00000100:00100000:0.0:1746144862.110064:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+247:30931:x1830965174103680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1912us (2118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144862.110070:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3645 00000100:00100000:0.0:1746144862.111665:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.112258:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9065 00000100:00100000:0.0:1746144862.112265:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965174104320:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144862.112272:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144862.112285:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af6727511c40 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9174c expref: 6 pid: 20722 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.112294:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af6727511c40 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9174c expref: 6 pid: 20722 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.112308:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af6727511c40 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9174c expref: 6 pid: 20722 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.112332:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144862.112333:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144862.112339:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880093936000/0x4076af6727511c4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9175a expref: 246 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.112346:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093936000/0x4076af6727511c4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9175a expref: 246 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.112363:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880093936000/0x4076af6727511c4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9175a expref: 246 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.112372:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880093936000/0x4076af6727511c4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9175a expref: 246 pid: 10401 timeout: 556 lvb_type: 0 00000100:00100000:0.0:1746144862.112380:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb48700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965171986816:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144862.112431:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144862.114364:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174104576 00000100:00100000:0.0:1746144862.114368:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174104576 00002000:00100000:0.0:1746144862.114393:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009398ed80 x1830965174104576/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:503/0 lens 488/0 e 0 to 0 dl 1746144873 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144862.114401:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ed80 with x1830965174104576 ext(0->4095) 00010000:00010000:0.0:1746144862.114407:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093936000/0x4076af6727511c4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9175a expref: 247 pid: 10401 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.114416:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093936000/0x4076af6727511c4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9175a expref: 247 pid: 10401 timeout: 556 lvb_type: 0 00002000:00010000:0.0:1746144862.114421:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009398ed80 00000100:00100000:0.0:1746144862.114434:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 665 00000100:00100000:0.0:1746144862.114440:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+247:1984:x1830965174104576:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144862.114580:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+247:1984:x1830965174104576:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 139us (280us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144862.114586:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 665 00002000:00100000:0.0:1746144862.114591:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009398ed80 x1830965174104576/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:503/0 lens 488/4536 e 0 to 0 dl 1746144873 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144862.114597:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ed80 with x1830965174104576 ext(0->4095) 00010000:00010000:0.0:1746144862.114601:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880093936000/0x4076af6727511c4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9175a expref: 247 pid: 10401 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.114610:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880093936000/0x4076af6727511c4e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9175a expref: 247 pid: 10401 timeout: 556 lvb_type: 0 00002000:00010000:0.0:1746144862.114615:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009398ed80 00000100:00100000:0.0:1746144862.120814:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.123326:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.127048:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.129089:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.132412:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.134726:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.139101:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.139127:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.139162:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.139179:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174105856 00000100:00100000:0.0:1746144862.139183:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174105856 00010000:00010000:0.0:1746144862.139205:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af6727511c55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91761 expref: 249 pid: 10401 timeout: 556 lvb_type: 0 00000100:00100000:0.0:1746144862.139241:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174106112 00000100:00100000:0.0:1746144862.139243:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174106112 00010000:00010000:0.0:1746144862.139253:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511c5c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91768 expref: 6 pid: 10401 timeout: 556 lvb_type: 0 00000100:00100000:0.0:1746144862.139266:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9067 00000100:00100000:0.0:1746144862.139270:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+249:1984:x1830965174105856:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144862.139278:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144862.139295:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af6727511c55 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91761 expref: 249 pid: 10401 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.139307:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af6727511c55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91761 expref: 249 pid: 10401 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.139327:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af6727511c55 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91761 expref: 249 pid: 10401 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.139341:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144862.139357:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+248:1984:x1830965174105856:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 87us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144862.139362:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9067 00000100:00100000:0.0:1746144862.141669:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.143756:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.146832:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.152323:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.155752:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.158847:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.164130:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.167829:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174107776 00000100:00100000:0.0:1746144862.167837:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174107776 00000100:00100000:0.0:1746144862.167877:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3651 00000100:00100000:0.0:1746144862.167885:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+250:30931:x1830965174107776:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144862.167900:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144862.167913:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093937600/0x4076af6727511c78 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91784 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.167937:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727511c6a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91776 expref: 251 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.167944:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af6727511c71 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9177d expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.167949:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144862.167951:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144862.167953:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093937600/0x4076af6727511c78 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91784 expref: 251 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.167975:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af6727511c71 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9177d expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.167984:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af6727511c71 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9177d expref: 5 pid: 8430 timeout: 556 lvb_type: 0 00000100:00100000:0.0:1746144862.167993:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965171987712:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144862.168073:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727511c6a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91776 expref: 251 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.168081:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727511c6a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91776 expref: 251 pid: 8430 timeout: 556 lvb_type: 0 00000100:00100000:0.0:1746144862.168088:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965171987840:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144862.168107:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144862.175215:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.175251:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.175281:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.180956:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.191899:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.198448:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.200502:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.203181:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.207513:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.220538:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.223494:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.223521:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.223547:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.232320:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.238895:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.242480:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.244855:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.250709:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.255586:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.255639:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.259350:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.259383:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.259407:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.259445:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174112000 00000100:00100000:0.0:1746144862.259450:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174112000 00010000:00010000:0.0:1746144862.259476:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ce23e00/0x4076af6727511c9b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af917a7 expref: 256 pid: 10401 timeout: 556 lvb_type: 0 00000100:00100000:0.0:1746144862.259492:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174112256 00000100:00100000:0.0:1746144862.259494:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174112256 00010000:00010000:0.0:1746144862.259500:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af6727511c94 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af917a0 expref: 6 pid: 8430 timeout: 556 lvb_type: 0 00000100:00100000:0.0:1746144862.259511:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9076 00000100:00100000:0.0:1746144862.259516:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087db9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+256:1983:x1830965174112000:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144862.259524:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144862.259539:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ce23e00/0x4076af6727511c9b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af917a7 expref: 256 pid: 10401 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.259547:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ce23e00/0x4076af6727511c9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af917a7 expref: 256 pid: 10401 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.259564:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144862.259589:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087db9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+256:1983:x1830965174112000:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 73us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144862.259594:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9076 00000100:00100000:0.0:1746144862.259604:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9077 00000100:00100000:0.0:1746144862.259608:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087dbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174112256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144862.259612:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144862.259617:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af6727511c94 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af917a0 expref: 6 pid: 8430 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.259624:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af6727511c94 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af917a0 expref: 6 pid: 8430 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.259632:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144862.259633:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144862.259638:0:7099:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2400/0x4076af6727511ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af917ae expref: 255 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.259645:0:7099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b2400/0x4076af6727511ca2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af917ae expref: 255 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.259664:0:7099:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b2400/0x4076af6727511ca2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af917ae expref: 255 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144862.259672:0:7099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087db9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965171989248:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144862.259709:0:7099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144862.261711:0:7099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087db9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965171989248:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144862.261725:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144862.261780:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087dbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965174112256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2153us (2354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144862.262457:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9077 00000100:00100000:0.0:1746144862.263807:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.276752:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.281144:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.292028:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.294679:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.294758:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.297568:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.300537:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.307960:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.311601:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.316679:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.318915:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.323411:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.326128:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.327019:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.329147:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.330928:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.331119:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.334937:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087544380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965171990400:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144862.334948:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144862.334974:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965174115456:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3721us (4050us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144862.334982:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9082 00000100:00100000:0.0:1746144862.344444:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.347372:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.350453:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.353291:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.354913:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.356364:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.358414:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.359682:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.362823:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.365552:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.370803:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.374146:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.377726:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.382081:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.385159:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.388524:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.388565:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.391014:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.391449:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.393819:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.406977:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.417657:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.421184:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.425267:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.425933:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.429990:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.431957:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.434384:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.438305:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.441121:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.447097:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.451686:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.455086:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.458031:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.461080:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.461113:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.463812:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.464948:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.467631:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.471608:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.474191:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.480166:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.484612:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.486618:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.491472:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.491571:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.494483:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.494838:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.497710:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.508335:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.514826:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.517829:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.517981:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.519717:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.522053:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.528691:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.533941:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.536621:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.539173:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.540157:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.540180:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174127232 00000100:00100000:0.0:1746144862.540187:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174127232 00000100:00100000:0.0:1746144862.541211:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174127104 00000100:00100000:0.0:1746144862.541215:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174127104 00000100:00100000:0.0:1746144862.541741:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3681 00000100:00100000:0.0:1746144862.541747:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965174127104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144862.541754:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144862.541760:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a939800/0x4076af6727511d4a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9184f expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.541787:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144862.541791:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a5de00/0x4076af6727511d43 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91856 expref: 273 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.541798:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144862.541800:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a939800/0x4076af6727511d4a lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9184f expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.541821:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091a5de00/0x4076af6727511d43 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91856 expref: 273 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.541830:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a939800/0x4076af6727511d4a lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9184f expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.541840:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939800, rc 0) 00000100:00100000:0.0:1746144862.541863:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965174127104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 116us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144862.541868:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3681 00000100:00100000:0.0:1746144862.543838:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.546739:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.553141:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.557467:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.562021:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.568449:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.570296:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.574801:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.574836:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.574863:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174128896 00000100:00100000:0.0:1746144862.574873:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174128896 00002000:00100000:0.0:1746144862.574920:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88012d366a00 x1830965174128896/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:503/0 lens 488/0 e 0 to 0 dl 1746144873 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144862.574931:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d366a00 with x1830965174128896 ext(0->4095) 00010000:00010000:0.0:1746144862.574940:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091a5de00/0x4076af6727511d51 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9185d expref: 276 pid: 20722 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.574953:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091a5de00/0x4076af6727511d51 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9185d expref: 276 pid: 20722 timeout: 556 lvb_type: 0 00002000:00010000:0.0:1746144862.574961:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d366a00 00000100:00100000:0.0:1746144862.574982:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 696 00000100:00100000:0.0:1746144862.574989:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+276:1984:x1830965174128896:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144862.575126:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+276:1984:x1830965174128896:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 137us (289us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144862.576385:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 696 00002000:00100000:0.0:1746144862.576392:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88012d366a00 x1830965174128896/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:503/0 lens 488/4536 e 0 to 0 dl 1746144873 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144862.576400:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d366a00 with x1830965174128896 ext(0->4095) 00010000:00010000:0.0:1746144862.576405:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091a5de00/0x4076af6727511d51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9185d expref: 275 pid: 20722 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.576414:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091a5de00/0x4076af6727511d51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9185d expref: 275 pid: 20722 timeout: 556 lvb_type: 0 00002000:00010000:0.0:1746144862.576420:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012d366a00 00000100:00100000:0.0:1746144862.579276:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.579308:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174129024 00000100:00100000:0.0:1746144862.579315:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174129024 00010000:00010000:0.0:1746144862.579348:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5de00/0x4076af6727511d51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9185d expref: 275 pid: 20722 timeout: 556 lvb_type: 0 00000100:00100000:0.0:1746144862.579384:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9102 00000100:00100000:0.0:1746144862.579392:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174128768:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144862.579406:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144862.579429:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a939800/0x4076af6727511d4a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9184f expref: 6 pid: 10401 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.579441:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a939800/0x4076af6727511d4a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9184f expref: 6 pid: 10401 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.579465:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a939800/0x4076af6727511d4a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9184f expref: 6 pid: 10401 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.579488:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144862.579532:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965174128768:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 141us (4742us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144862.579538:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9102 00000100:00100000:0.0:1746144862.579555:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9103 00000100:00100000:0.0:1746144862.579560:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+275:1984:x1830965174129024:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144862.579566:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144862.579573:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091a5de00/0x4076af6727511d51 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9185d expref: 275 pid: 20722 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.579586:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091a5de00/0x4076af6727511d51 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9185d expref: 275 pid: 20722 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.579598:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a5de00/0x4076af6727511d51 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9185d expref: 275 pid: 20722 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.579607:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144862.579609:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144862.579616:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511d58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91864 expref: 274 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.579624:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511d58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91864 expref: 274 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.579657:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511d58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91864 expref: 274 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144862.579670:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d366d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965171995136:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144862.579718:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144862.579798:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.579819:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174129152 00000100:00100000:0.0:1746144862.579822:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174129152 00000100:00100000:0.0:1746144862.579843:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3684 00000100:00100000:0.0:1746144862.579848:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965174129152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144862.579862:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144862.579876:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880135fe5800/0x4076af6727511d5f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9186b expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.579893:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511d58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91864 expref: 274 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.579899:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144862.579900:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144862.579903:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880135fe5800/0x4076af6727511d5f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9186b expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.579920:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511d58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91864 expref: 274 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.579930:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511d58 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91864 expref: 274 pid: 8430 timeout: 556 lvb_type: 0 00000100:00100000:0.0:1746144862.579938:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092585f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965171995264:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144862.579961:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144862.582925:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092585f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965171995264:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144862.582954:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880135fe5800/0x4076af6727511d5f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9186b expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.582969:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135fe5800, rc 0) 00000100:00100000:0.0:1746144862.583005:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965174129152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3156us (3207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144862.583013:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3684 00000100:00100000:0.0:1746144862.583072:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d366d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965171995136:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144862.583088:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144862.583105:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+274:1984:x1830965174129024:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3546us (3840us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144862.583114:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9103 00000100:00100000:0.0:1746144862.583590:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.583627:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174129408 00000100:00100000:0.0:1746144862.583632:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174129408 00002000:00100000:0.0:1746144862.583663:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880092585f80 x1830965174129408/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:503/0 lens 488/0 e 0 to 0 dl 1746144873 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144862.583672:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092585f80 with x1830965174129408 ext(0->4095) 00010000:00010000:0.0:1746144862.583678:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511d58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91864 expref: 274 pid: 8430 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.583689:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511d58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91864 expref: 274 pid: 8430 timeout: 556 lvb_type: 0 00002000:00010000:0.0:1746144862.583695:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092585f80 00000100:00100000:0.0:1746144862.583711:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 697 00000100:00100000:0.0:1746144862.583717:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+274:1984:x1830965174129408:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144862.583868:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+274:1984:x1830965174129408:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 150us (278us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144862.583874:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 697 00002000:00100000:0.0:1746144862.583879:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880092585f80 x1830965174129408/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:503/0 lens 488/4536 e 0 to 0 dl 1746144873 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144862.583886:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092585f80 with x1830965174129408 ext(0->4095) 00010000:00010000:0.0:1746144862.583891:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511d58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91864 expref: 274 pid: 8430 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.583899:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511d58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91864 expref: 274 pid: 8430 timeout: 556 lvb_type: 0 00002000:00010000:0.0:1746144862.583904:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092585f80 00000100:00100000:0.0:1746144862.591443:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174129664 00000100:00100000:0.0:1746144862.591453:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174129664 00002000:00100000:0.0:1746144862.591498:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff880087545f80 x1830965174129664/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:503/0 lens 496/0 e 0 to 0 dl 1746144873 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144862.591508:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087545f80 with x1830965174129664 ext(0->7) 00010000:00010000:0.0:1746144862.591517:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511d58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91864 expref: 274 pid: 8430 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.591530:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511d58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91864 expref: 274 pid: 8430 timeout: 556 lvb_type: 0 00002000:00010000:0.0:1746144862.591535:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880087545f80 00000100:00100000:0.0:1746144862.591570:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 698 00000100:00100000:0.0:1746144862.591578:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+274:1982:x1830965174129664:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144862.591999:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+276:1982:x1830965174129664:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 Request processed in 421us (643us total) trans 4294968267 rc 0/0 00000100:00100000:0.0:1746144862.592005:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 698 00002000:00100000:0.0:1746144862.592011:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff880087545f80 x1830965174129664/t4294968267(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:503/0 lens 496/448 e 0 to 0 dl 1746144873 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144862.592022:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087545f80 with x1830965174129664 ext(0->7) 00010000:00010000:0.0:1746144862.592026:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511d58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91864 expref: 276 pid: 8430 timeout: 556 lvb_type: 0 00010000:00010000:0.0:1746144862.592033:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511d58 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91864 expref: 276 pid: 8430 timeout: 556 lvb_type: 0 00002000:00010000:0.0:1746144862.592038:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880087545f80 00000100:00100000:0.0:1746144862.597983:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.600827:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144862.607815:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.625207:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.627116:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174130304 00000100:00100000:0.0:1746144862.627121:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174130304 00000100:00100000:0.0:1746144862.629497:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.633755:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.635493:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.639881:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.646296:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.663792:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.668035:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.672642:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.685178:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.688849:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.693023:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.693645:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.700126:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.702321:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.705456:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.706160:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.711636:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.717972:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.729587:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.737286:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.752915:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.753377:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.756464:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.758015:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.761122:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.761266:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.768976:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.778916:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.781059:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.781096:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.781133:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.781156:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.781383:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.781474:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 285 00000100:00100000:0.0:1746144862.781481:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965174136192:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144862.781507:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b032680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965174136192:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144862.781512:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 285 00000100:00100000:0.0:1746144862.784023:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.786658:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.789096:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.791913:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.797297:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.800703:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.803312:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.811994:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.825914:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.832558:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.832639:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.835116:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3699 00000100:00100000:0.0:1746144862.835123:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+19:30934:x1830965174138880:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144862.835130:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144862.835136:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b466e00/0x4076af6727511dc8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af918d4 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.835146:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144862.835150:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099501a00/0x4076af6727511dc1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af918cd expref: 20 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.835155:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144862.835158:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b466e00/0x4076af6727511dc8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af918d4 expref: 20 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.835176:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099501a00/0x4076af6727511dc1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af918cd expref: 20 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.835185:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b466e00/0x4076af6727511dc8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af918d4 expref: 20 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.835199:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b466e00, rc 0) 00000100:00100000:0.0:1746144862.835221:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+20:30934:x1830965174138880:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 99us (2582us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144862.835238:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3699 00000100:00100000:0.0:1746144862.840983:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.854929:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.860622:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.866858:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.874656:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.878752:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.881553:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.890522:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.898567:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.902855:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.908737:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.914461:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.914500:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.917939:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.925443:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.933133:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.938929:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.941980:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174142720 00000100:00100000:0.0:1746144862.941984:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174142720 00000100:00100000:0.0:1746144862.942035:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3704 00000100:00100000:0.0:1746144862.942042:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965174142720:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144862.942059:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144862.942076:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727511df2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af918fe expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.942098:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144862.942099:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144862.942106:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727511df2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af918fe expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144862.942248:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727511df2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af918fe expref: 6 pid: 8430 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1746144862.942255:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727511df2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af918fe expref: 6 pid: 8430 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1746144862.942264:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b467c00, rc 0) 00000100:00100000:0.0:1746144862.942348:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965174142720:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 306us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144862.942354:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3704 00000100:00100000:0.0:1746144862.944314:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.944367:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.947061:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.950920:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.957427:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.959513:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.978754:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.981799:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174144128 00000100:00100000:0.0:1746144862.981809:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174144128 00002000:00100000:0.0:1746144862.981851:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880087544e00 x1830965174144128/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:503/0 lens 488/0 e 0 to 0 dl 1746144873 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144862.981860:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087544e00 with x1830965174144128 ext(0->4095) 00002000:00010000:0.0:1746144862.981865:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087544e00 00000100:00100000:0.0:1746144862.981888:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3077 00000100:00100000:0.0:1746144862.981894:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174144128:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144862.982071:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174144128:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 176us (999us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144862.982078:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3077 00002000:00100000:0.0:1746144862.982083:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880087544e00 x1830965174144128/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:503/0 lens 488/4536 e 0 to 0 dl 1746144873 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144862.982090:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087544e00 with x1830965174144128 ext(0->4095) 00002000:00010000:0.0:1746144862.982092:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087544e00 00000100:00100000:0.0:1746144862.984314:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.986445:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.992629:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144862.997024:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.001125:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.003578:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.011083:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.012884:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.015938:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.022539:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.030270:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.037074:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.037105:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.038514:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.054984:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.055065:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174146816 00000100:00100000:0.0:1746144863.055074:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174146816 00002000:00100000:0.0:1746144863.055115:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093442a00 x1830965174146816/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:504/0 lens 488/0 e 0 to 0 dl 1746144874 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144863.055124:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093442a00 with x1830965174146816 ext(0->4095) 00010000:00010000:0.0:1746144863.055132:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099501800/0x4076af6727511e15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91921 expref: 29 pid: 20722 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1746144863.055146:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099501800/0x4076af6727511e15 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91921 expref: 29 pid: 20722 timeout: 557 lvb_type: 0 00002000:00010000:0.0:1746144863.055152:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093442a00 00000100:00100000:0.0:1746144863.073896:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.080110:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.083445:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.090095:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.090197:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.094570:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.105309:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.108243:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.114742:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.119035:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.123757:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.129668:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.142347:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3715 00000100:00100000:0.0:1746144863.142357:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087547800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+33:30931:x1830965174149248:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144863.142368:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144863.142387:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b466e00/0x4076af6727511e38 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91944 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.142411:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099501800/0x4076af6727511e2a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9192f expref: 34 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.142419:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099313800/0x4076af6727511e31 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9193d expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.142425:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144863.142427:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144863.142431:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b466e00/0x4076af6727511e38 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91944 expref: 34 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144863.151930:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.154031:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.154079:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.159196:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.166164:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.176928:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.185622:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.189000:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.191427:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.194625:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.197572:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.200204:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.202245:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.204713:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.209814:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.213246:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.213292:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.219640:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.219678:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.219726:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.219790:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174153088 00000100:00100000:0.0:1746144863.219798:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174153088 00000100:00100000:0.0:1746144863.219842:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3721 00000100:00100000:0.0:1746144863.219850:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965174153088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144863.219868:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144863.219886:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727511e62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9196e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.219912:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144863.219918:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3400/0x4076af6727511e5b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91967 expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.219924:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144863.219927:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727511e62 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9196e expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.219967:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b3400/0x4076af6727511e5b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91967 expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.219983:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727511e62 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9196e expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.219996:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b467c00, rc 0) 00000100:00100000:0.0:1746144863.220038:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:30934:x1830965174153088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 188us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144863.220044:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3721 00000100:00100000:0.0:1746144863.228042:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.231024:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.239143:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.251066:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.251152:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.257370:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087547100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172004096:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144863.260252:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.260285:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.270638:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.279704:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.295758:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.307520:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.315561:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.332665:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.340135:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.351407:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.358264:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.375889:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.378950:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.391362:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.391424:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.401548:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.404689:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.415348:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.418665:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.432239:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.441549:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174158464 00000100:00100000:0.0:1746144863.441559:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174158464 00000100:00100000:0.0:1746144863.441605:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3730 00000100:00100000:0.0:1746144863.441613:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+44:30931:x1830965174158464:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144863.441631:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144863.441647:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727511ea1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af919ad expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.441675:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099313800/0x4076af6727511e93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9199f expref: 45 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.441683:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511e9a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919a6 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.441689:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144863.441691:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144863.441694:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727511ea1 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919ad expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.441721:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511e9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919a6 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.441732:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091708e00/0x4076af6727511e9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919a6 expref: 5 pid: 8430 timeout: 557 lvb_type: 0 00000100:00100000:0.0:1746144863.441746:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cf2c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172005760:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144863.441861:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099313800/0x4076af6727511e93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9199f expref: 45 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.441868:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099313800/0x4076af6727511e93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9199f expref: 45 pid: 10401 timeout: 557 lvb_type: 0 00000100:00100000:0.0:1746144863.441875:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cf2ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172005888:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144863.441891:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144863.463873:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.463909:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174158976 00000100:00100000:0.0:1746144863.463918:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174158976 00000100:00100000:0.0:1746144863.463959:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3731 00000100:00100000:0.0:1746144863.463967:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+44:30934:x1830965174158976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144863.463984:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144863.464000:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af6727511ea8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af919b4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.464025:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144863.464031:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727511ea1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919ad expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.464036:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144863.464040:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af6727511ea8 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919b4 expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.464078:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727511ea1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919ad expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.464090:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af6727511ea8 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919b4 expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.464100:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501200, rc 0) 00000100:00100000:0.0:1746144863.464139:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+45:30934:x1830965174158976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 174us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144863.464145:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3731 00000100:00100000:0.0:1746144863.471334:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.481695:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174159360 00000100:00100000:0.0:1746144863.481706:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174159360 00002000:00100000:0.0:1746144863.481755:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009b463100 x1830965174159360/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:504/0 lens 488/0 e 0 to 0 dl 1746144874 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144863.482657:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463100 with x1830965174159360 ext(0->4095) 00010000:00010000:0.0:1746144863.482669:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727511ea1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919ad expref: 45 pid: 8432 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1746144863.482685:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727511ea1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919ad expref: 45 pid: 8432 timeout: 557 lvb_type: 0 00002000:00010000:0.0:1746144863.482692:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b463100 00000100:00100000:0.0:1746144863.483668:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 741 00000100:00100000:0.0:1746144863.483681:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1985:x1830965174159360:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144863.485068:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1985:x1830965174159360:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 1385us (3509us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144863.485078:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 741 00002000:00100000:0.0:1746144863.485087:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009b463100 x1830965174159360/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:504/0 lens 488/4536 e 0 to 0 dl 1746144874 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144863.485097:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463100 with x1830965174159360 ext(0->4095) 00010000:00010000:0.0:1746144863.485107:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727511ea1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919ad expref: 45 pid: 8432 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1746144863.485121:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727511ea1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919ad expref: 45 pid: 8432 timeout: 557 lvb_type: 0 00002000:00010000:0.0:1746144863.485127:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b463100 00000100:00100000:0.0:1746144863.485184:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965172006144:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144863.485201:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144863.485242:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965174159104:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 13746us (13917us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144863.485250:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9150 00000100:00100000:0.0:1746144863.491101:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174159616 00000100:00100000:0.0:1746144863.491113:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174159616 00002000:00100000:0.0:1746144863.491163:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff88009b461c00 x1830965174159616/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:504/0 lens 496/0 e 0 to 0 dl 1746144874 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144863.491173:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b461c00 with x1830965174159616 ext(0->7) 00010000:00010000:0.0:1746144863.491183:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727511ea1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919ad expref: 45 pid: 8432 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1746144863.491201:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727511ea1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919ad expref: 45 pid: 8432 timeout: 557 lvb_type: 0 00002000:00010000:0.0:1746144863.491208:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b461c00 00000100:00100000:0.0:1746144863.491238:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 742 00000100:00100000:0.0:1746144863.491246:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1982:x1830965174159616:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144863.491595:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+47:1982:x1830965174159616:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 Request processed in 349us (1805us total) trans 4294968286 rc 0/0 00000100:00100000:0.0:1746144863.491602:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 742 00002000:00100000:0.0:1746144863.491609:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff88009b461c00 x1830965174159616/t4294968286(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:504/0 lens 496/448 e 0 to 0 dl 1746144874 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144863.491617:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b461c00 with x1830965174159616 ext(0->7) 00010000:00010000:0.0:1746144863.491621:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727511ea1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919ad expref: 47 pid: 8432 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1746144863.491630:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727511ea1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919ad expref: 47 pid: 8432 timeout: 557 lvb_type: 0 00002000:00010000:0.0:1746144863.491635:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b461c00 00000100:00100000:0.0:1746144863.497196:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174159744 00000100:00100000:0.0:1746144863.497205:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174159744 00010000:00010000:0.0:1746144863.497251:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727511ea1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919ad expref: 47 pid: 8432 timeout: 557 lvb_type: 0 00000100:00100000:0.0:1746144863.497277:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9151 00000100:00100000:0.0:1746144863.497284:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+47:1985:x1830965174159744:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144863.497296:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144863.497316:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727511ea1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919ad expref: 47 pid: 8432 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1746144863.497328:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727511ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919ad expref: 47 pid: 8432 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1746144863.497350:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727511ea1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919ad expref: 47 pid: 8432 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1746144863.497361:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144863.497363:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144863.497371:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af6727511ea8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919b4 expref: 46 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.497379:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af6727511ea8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919b4 expref: 46 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.497410:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af6727511ea8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919b4 expref: 46 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144863.497420:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cf2df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965172006272:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144863.497488:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144863.513429:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.518312:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.521022:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.522198:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.522345:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.527094:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174161152 00000100:00100000:0.0:1746144863.527100:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174161152 00002000:00100000:0.0:1746144863.527131:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880087547480 x1830965174161152/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:504/0 lens 488/0 e 0 to 0 dl 1746144874 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144863.527139:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087547480 with x1830965174161152 ext(0->4095) 00010000:00010000:0.0:1746144863.527145:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af6727511eb6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919bb expref: 48 pid: 8430 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1746144863.527156:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af6727511eb6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919bb expref: 48 pid: 8430 timeout: 557 lvb_type: 0 00002000:00010000:0.0:1746144863.527162:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880087547480 00000100:00100000:0.0:1746144863.527175:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 744 00000100:00100000:0.0:1746144863.527180:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+48:1985:x1830965174161152:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144863.527520:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087547480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+47:1985:x1830965174161152:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 339us (547us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144863.527526:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 744 00002000:00100000:0.0:1746144863.527531:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880087547480 x1830965174161152/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:504/0 lens 488/4536 e 0 to 0 dl 1746144874 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144863.527537:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087547480 with x1830965174161152 ext(0->4095) 00010000:00010000:0.0:1746144863.527541:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af6727511eb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919bb expref: 47 pid: 8430 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1746144863.527548:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af6727511eb6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af919bb expref: 47 pid: 8430 timeout: 557 lvb_type: 0 00002000:00010000:0.0:1746144863.527750:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880087547480 00000100:00100000:0.0:1746144863.535349:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.539238:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.542196:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.544616:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.555844:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.561320:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.563083:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.573912:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.576194:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.582415:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.596984:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.602042:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.604105:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.612354:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.621039:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.627010:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.633758:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.638849:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.639851:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.645190:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.647315:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.659670:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.680597:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.683368:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.689143:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.694077:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.697848:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.703268:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.731744:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174168064 00000100:00100000:0.0:1746144863.731753:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174168064 00010000:00010000:0.0:1746144863.731819:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099312800/0x4076af6727511efc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91a08 expref: 56 pid: 8432 timeout: 557 lvb_type: 0 00000100:00100000:0.0:1746144863.731855:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9164 00000100:00100000:0.0:1746144863.731862:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087546680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1982:x1830965174168064:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144863.731872:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746144863.731888:0:7098:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb atime from disk: 1746144863 -> 1746144864 00010000:00010000:0.0:1746144863.731894:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099312800/0x4076af6727511efc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91a08 expref: 56 pid: 8432 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1746144863.731904:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099312800/0x4076af6727511efc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91a08 expref: 56 pid: 8432 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1746144863.731922:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099312800/0x4076af6727511efc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91a08 expref: 56 pid: 8432 timeout: 557 lvb_type: 0 00010000:00010000:0.0:1746144863.731944:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144863.731946:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144863.731952:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092552a00/0x4076af6727511f03 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91a0f expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.731959:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092552a00/0x4076af6727511f03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91a0f expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.731988:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092552a00/0x4076af6727511f03 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91a0f expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144863.731997:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093368a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172009216:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144863.732072:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144863.735826:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.740934:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.747077:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.752007:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.752044:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.757486:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.757524:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.761527:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.765117:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.768130:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.773067:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174170368 00000100:00100000:0.0:1746144863.773073:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174170368 00002000:00100000:0.0:1746144863.773105:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880087dbb800 x1830965174170368/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:504/0 lens 488/0 e 0 to 0 dl 1746144874 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144863.773115:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087dbb800 with x1830965174170368 ext(0->4095) 00002000:00010000:0.0:1746144863.773119:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087dbb800 00000100:00100000:0.0:1746144863.773142:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3101 00000100:00100000:0.0:1746144863.773148:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087dbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1985:x1830965174170368:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144863.773720:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087dbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1985:x1830965174170368:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 570us (912us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144863.773727:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3101 00002000:00100000:0.0:1746144863.773733:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880087dbb800 x1830965174170368/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:504/0 lens 488/4536 e 0 to 0 dl 1746144874 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144863.773739:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087dbb800 with x1830965174170368 ext(0->4095) 00002000:00010000:0.0:1746144863.773742:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087dbb800 00000100:00100000:0.0:1746144863.776259:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.782808:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.784380:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.791846:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087546680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172009984:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144863.791856:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172010112:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144863.791881:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092553a00/0x4076af6727511f26 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91a32 expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.791894:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092553a00, rc 0) 00000100:00100000:0.0:1746144863.791946:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+60:30931:x1830965174170624:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7530us (9144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144863.791952:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3749 00000100:00100000:0.0:1746144863.793406:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.793445:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.798351:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.806059:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.823051:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.833452:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.834816:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.841591:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.841655:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.845687:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.849982:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.862523:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.881444:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.887389:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.887413:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174173568 00000100:00100000:0.0:1746144863.887419:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174173568 00000100:00100000:0.0:1746144863.887451:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3754 00000100:00100000:0.0:1746144863.887456:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+62:30931:x1830965174173568:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144863.887468:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144863.887481:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af6727511f49 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91a55 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.887501:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144863.887505:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099aff600/0x4076af6727511f42 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91a4e expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.887510:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746144863.887513:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af6727511f49 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91a55 expref: 63 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.887536:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099aff600/0x4076af6727511f42 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91a4e expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.887545:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af6727511f49 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91a55 expref: 63 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144863.887556:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500e00, rc 0) 00000100:00100000:0.0:1746144863.887580:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:30931:x1830965174173568:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 124us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144863.887584:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3754 00000100:00100000:0.0:1746144863.889429:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.892252:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.896082:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.899708:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.904539:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.907275:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.915099:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.919118:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.921044:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.924831:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.927273:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.930420:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.936458:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.938722:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.940650:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.943786:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.950131:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.964470:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.965533:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.982367:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.982399:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144863.984457:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087544380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965172012544:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144863.984471:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144863.984500:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1983:x1830965174177536:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1852us (2100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144863.984506:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9179 00000100:00100000:0.0:1746144864.002404:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.005735:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.011499:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.015513:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.018723:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.021162:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.028009:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.031084:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.031123:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.035820:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.035877:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.040399:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.044072:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.050461:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.052819:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.055005:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.072232:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.074519:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.080644:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.087570:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.087637:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.089923:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174181632 00000100:00100000:0.0:1746144864.089927:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174181632 00010000:00010000:0.0:1746144864.089943:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092552a00/0x4076af6727511f88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91a94 expref: 6 pid: 20722 timeout: 558 lvb_type: 0 00000100:00100000:0.0:1746144864.089967:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9185 00000100:00100000:0.0:1746144864.089973:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087544380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174181632:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144864.089980:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144864.089994:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092552a00/0x4076af6727511f88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91a94 expref: 6 pid: 20722 timeout: 558 lvb_type: 0 00010000:00010000:0.0:1746144864.090003:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092552a00/0x4076af6727511f88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91a94 expref: 6 pid: 20722 timeout: 558 lvb_type: 0 00010000:00010000:0.0:1746144864.090016:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092552a00/0x4076af6727511f88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91a94 expref: 6 pid: 20722 timeout: 558 lvb_type: 0 00010000:00010000:0.0:1746144864.090037:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144864.090039:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144864.090044:0:7099:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880092552600/0x4076af6727511f96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91aa2 expref: 70 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144864.090051:0:7099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092552600/0x4076af6727511f96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91aa2 expref: 70 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144864.090069:0:7099:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880092552600/0x4076af6727511f96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91aa2 expref: 70 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144864.090078:0:7099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880092552600/0x4076af6727511f96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91aa2 expref: 70 pid: 10401 timeout: 558 lvb_type: 0 00000100:00100000:0.0:1746144864.090092:0:7099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013619aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965172013952:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144864.090144:0:7099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144864.092642:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.095326:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.113106:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.113145:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.121741:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.127465:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.130736:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.145756:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.148650:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.151735:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.168841:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.168874:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.172236:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.175159:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.185960:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.192836:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.204307:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.212497:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.219095:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.220899:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.226105:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.230917:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.237855:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.252685:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.259289:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.263967:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.266934:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.270476:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.287425:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.298340:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.306975:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.311722:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.320748:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.328958:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.330928:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.341549:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.343994:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.347176:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.358133:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.360271:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.366083:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.366104:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.371431:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.377619:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.379638:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.381518:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.385052:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.389735:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.390870:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174191744 00000100:00100000:0.0:1746144864.390873:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174191744 00002000:00100000:0.0:1746144864.390896:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880087db9c00 x1830965174191744/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:505/0 lens 488/0 e 0 to 0 dl 1746144875 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144864.390904:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087db9c00 with x1830965174191744 ext(0->4095) 00010000:00010000:0.0:1746144864.390909:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092553c00/0x4076af6727511fff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91b0b expref: 86 pid: 8430 timeout: 558 lvb_type: 0 00010000:00010000:0.0:1746144864.390916:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092553c00/0x4076af6727511fff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91b0b expref: 86 pid: 8430 timeout: 558 lvb_type: 0 00002000:00010000:0.0:1746144864.390921:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880087db9c00 00000100:00100000:0.0:1746144864.390943:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 785 00000100:00100000:0.0:1746144864.390949:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1982:x1830965174191744:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144864.392029:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087db9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1982:x1830965174191744:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 1078us (1271us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144864.392036:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 785 00002000:00100000:0.0:1746144864.392043:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880087db9c00 x1830965174191744/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:505/0 lens 488/4536 e 0 to 0 dl 1746144875 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144864.392049:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087db9c00 with x1830965174191744 ext(0->4095) 00010000:00010000:0.0:1746144864.392054:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092553c00/0x4076af6727511fff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91b0b expref: 86 pid: 8430 timeout: 558 lvb_type: 0 00010000:00010000:0.0:1746144864.392062:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092553c00/0x4076af6727511fff lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91b0b expref: 86 pid: 8430 timeout: 558 lvb_type: 0 00002000:00010000:0.0:1746144864.392067:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880087db9c00 00000100:00100000:0.0:1746144864.393588:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.395315:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.395345:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.397971:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.404327:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.409090:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.414417:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.418277:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.418537:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.421253:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.436489:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.439063:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.445824:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.452301:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.455032:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.455076:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.457749:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.460869:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.468357:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.473234:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.483403:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.483454:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.490613:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.491671:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.496259:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.496328:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.500269:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.520614:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.533949:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.534521:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.538559:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.543035:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.547560:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.560367:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.568339:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.575987:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.586001:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.586041:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.597998:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.602757:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.610823:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.613876:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.618057:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.619491:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.633160:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.633217:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.633467:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.633489:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174201088 00000100:00100000:0.0:1746144864.633494:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174201088 00000100:00100000:0.0:1746144864.633530:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3797 00000100:00100000:0.0:1746144864.633538:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+99:30934:x1830965174201088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144864.633557:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144864.633573:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af6727512076 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91b82 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144864.634478:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144864.634486:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3400/0x4076af672751206f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91b7b expref: 100 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144864.634495:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144864.634499:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af6727512076 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91b82 expref: 100 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144864.634544:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b3400/0x4076af672751206f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 7 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91b7b expref: 100 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144864.634571:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af6727512076 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91b82 expref: 100 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144864.634597:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500e00, rc 0) 00000100:00100000:0.0:1746144864.634629:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+99:30934:x1830965174201088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1092us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144864.634636:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3797 00000100:00100000:0.0:1746144864.647196:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.649125:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.652989:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.657463:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.662478:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.668067:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.675940:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.683200:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.683247:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.683286:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.685751:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.688690:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.694555:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.696745:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.699846:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.704327:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.710113:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.710167:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.715397:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.715462:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.715491:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.719061:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.726847:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.731963:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.743002:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.745964:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.747844:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.749198:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.752480:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.753924:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.758660:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174207232 00000100:00100000:0.0:1746144864.758668:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174207232 00002000:00100000:0.0:1746144864.758713:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880091021180 x1830965174207232/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:505/0 lens 488/0 e 0 to 0 dl 1746144875 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144864.758722:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091021180 with x1830965174207232 ext(0->4095) 00010000:00010000:0.0:1746144864.758736:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135fe5800/0x4076af67275120ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91bba expref: 103 pid: 10401 timeout: 558 lvb_type: 0 00010000:00010000:0.0:1746144864.758750:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135fe5800/0x4076af67275120ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91bba expref: 103 pid: 10401 timeout: 558 lvb_type: 0 00002000:00010000:0.0:1746144864.758919:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091021180 00000100:00100000:0.0:1746144864.758951:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 808 00000100:00100000:0.0:1746144864.758958:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+103:1985:x1830965174207232:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144864.759135:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091021180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+103:1985:x1830965174207232:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 176us (737us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144864.759140:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 808 00002000:00100000:0.0:1746144864.759146:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880091021180 x1830965174207232/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:505/0 lens 488/4536 e 0 to 0 dl 1746144875 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144864.759151:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091021180 with x1830965174207232 ext(0->4095) 00010000:00010000:0.0:1746144864.759155:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880135fe5800/0x4076af67275120ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91bba expref: 103 pid: 10401 timeout: 558 lvb_type: 0 00010000:00010000:0.0:1746144864.759163:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880135fe5800/0x4076af67275120ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91bba expref: 103 pid: 10401 timeout: 558 lvb_type: 0 00002000:00010000:0.0:1746144864.759168:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091021180 00000100:00100000:0.0:1746144864.763756:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.768180:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.772850:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.776039:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.776083:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.779070:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.779114:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.783894:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.786984:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.801576:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.807917:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.814239:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.819622:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.823074:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.825586:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.838231:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.839988:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.840906:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.850165:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.854401:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.863169:0:7099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965172024576:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144864.863186:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144864.863232:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+108:1983:x1830965174211328:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6817us (8836us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144864.863242:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9232 00000100:00100000:0.0:1746144864.865591:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.867234:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.886146:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.901399:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.902739:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174212608 00000100:00100000:0.0:1746144864.902743:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174212608 00002000:00100000:0.0:1746144864.902778:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880099e85c00 x1830965174212608/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:505/0 lens 488/0 e 0 to 0 dl 1746144875 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144864.902787:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e85c00 with x1830965174212608 ext(0->4095) 00002000:00010000:0.0:1746144864.902791:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e85c00 00000100:00100000:0.0:1746144864.903157:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 814 00000100:00100000:0.0:1746144864.903163:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174212608:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144864.903291:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174212608:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 127us (603us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144864.903297:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 814 00002000:00100000:0.0:1746144864.903301:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880099e85c00 x1830965174212608/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:505/0 lens 488/4536 e 0 to 0 dl 1746144875 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144864.903307:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e85c00 with x1830965174212608 ext(0->4095) 00010000:00010000:0.0:1746144864.903311:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2600/0x4076af67275120e6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91bf2 expref: 6 pid: 10401 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144864.903319:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b2600/0x4076af67275120e6 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91bf2 expref: 6 pid: 10401 timeout: 559 lvb_type: 0 00002000:00010000:0.0:1746144864.903324:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099e85c00 00000100:00100000:0.0:1746144864.907121:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.907154:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.907334:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.909598:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.911067:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.913818:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.916604:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.919032:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.920657:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.923683:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.925905:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.926225:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.928923:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.928959:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.931603:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.933617:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.935516:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.938039:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.938501:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3153 00000100:00100000:0.0:1746144864.938508:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+113:1983:x1830965174216192:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144864.939069:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+112:1983:x1830965174216192:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 561us (1032us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144864.939075:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3153 00002000:00100000:0.0:1746144864.939079:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800925ab480 x1830965174216192/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:505/0 lens 488/4536 e 0 to 0 dl 1746144875 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144864.939085:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab480 with x1830965174216192 ext(0->4095) 00002000:00010000:0.0:1746144864.939088:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800925ab480 00000100:00100000:0.0:1746144864.940969:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.942712:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.945016:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.951475:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.955403:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.955432:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.955480:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.955516:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174217344 00000100:00100000:0.0:1746144864.955523:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174217344 00000100:00100000:0.0:1746144864.955564:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3821 00000100:00100000:0.0:1746144864.955572:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+114:30934:x1830965174217344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144864.955589:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144864.955604:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099501800/0x4076af672751211e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91c2a expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144864.955627:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144864.955633:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727512117 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c23 expref: 115 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144864.955638:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144864.955641:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099501800/0x4076af672751211e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c2a expref: 115 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144864.955673:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727512117 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c23 expref: 115 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144864.955683:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099501800/0x4076af672751211e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c2a expref: 115 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144864.955692:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501800, rc 0) 00000100:00100000:0.0:1746144864.955728:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+115:30934:x1830965174217344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 157us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144864.955734:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3821 00000100:00100000:0.0:1746144864.960499:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.967323:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.977269:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.983350:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.988433:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.993901:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.994719:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144864.998128:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.007336:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.009384:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.017224:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.022585:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.024608:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.028923:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.032644:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.039463:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.042104:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.048046:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.054522:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.061009:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.061051:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.066299:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.067901:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.068245:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.071683:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087545c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965172028032:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144865.071697:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144865.071729:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+119:1982:x1830965174221568:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3248us (3483us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144865.071738:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9247 00000100:00100000:0.0:1746144865.075377:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.081166:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.084667:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.088583:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.093074:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.102503:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.105359:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.105407:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.108979:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.110189:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.110219:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174223744 00000100:00100000:0.0:1746144865.110223:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174223744 00010000:00010000:0.0:1746144865.110250:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099312e00/0x4076af6727512156 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c62 expref: 6 pid: 10401 timeout: 559 lvb_type: 0 00000100:00100000:0.0:1746144865.110269:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174223872 00000100:00100000:0.0:1746144865.110272:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174223872 00010000:00010000:0.0:1746144865.110280:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099313800/0x4076af672751214f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c5b expref: 122 pid: 10401 timeout: 559 lvb_type: 0 00000100:00100000:0.0:1746144865.111803:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9249 00000100:00100000:0.0:1746144865.111816:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174223744:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144865.111830:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144865.111854:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099312e00/0x4076af6727512156 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c62 expref: 6 pid: 10401 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.111864:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099312e00/0x4076af6727512156 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c62 expref: 6 pid: 10401 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.111881:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099312e00/0x4076af6727512156 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c62 expref: 6 pid: 10401 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.111906:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144865.111947:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965174223744:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 135us (2973us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144865.111952:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9249 00000100:00100000:0.0:1746144865.111969:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9250 00000100:00100000:0.0:1746144865.111974:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+122:1983:x1830965174223872:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144865.111979:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144865.111986:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099313800/0x4076af672751214f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c5b expref: 122 pid: 10401 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.111993:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099313800/0x4076af672751214f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c5b expref: 122 pid: 10401 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.112003:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144865.112004:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144865.112009:0:7099:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099313e00/0x4076af672751215d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c69 expref: 122 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.112015:0:7099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099313e00/0x4076af672751215d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c69 expref: 122 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.112039:0:7099:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099313e00/0x4076af672751215d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c69 expref: 122 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144865.112050:0:7099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a417fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965172028544:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144865.112091:0:7099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144865.112141:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.122517:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.129197:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.136425:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.147348:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.150280:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.150310:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174225024 00000100:00100000:0.0:1746144865.150316:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174225024 00000100:00100000:0.0:1746144865.150362:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3832 00000100:00100000:0.0:1746144865.150369:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+121:30931:x1830965174225024:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144865.150419:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144865.150435:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af672751216b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91c77 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.150458:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a91d000/0x4076af6727512164 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c70 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.150465:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144865.150467:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144865.150470:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af672751216b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c77 expref: 122 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.150492:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a91d000/0x4076af6727512164 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c70 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.150502:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a91d000/0x4076af6727512164 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c70 expref: 5 pid: 10401 timeout: 559 lvb_type: 0 00000100:00100000:0.0:1746144865.150518:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a417fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172028928:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144865.150590:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144865.155190:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.155860:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.160979:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.167169:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.172607:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.186939:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.187257:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.187311:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3835 00000100:00100000:0.0:1746144865.187316:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965174226432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144865.187325:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144865.187339:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af6727512179 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91c8c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.187358:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144865.187360:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144865.187366:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af6727512179 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c8c expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.187401:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af6727512179 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c8c expref: 6 pid: 8430 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.187407:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af6727512179 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c8c expref: 6 pid: 8430 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.187431:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500c00, rc 0) 00000100:00100000:0.0:1746144865.187473:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965174226432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 156us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144865.187479:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3835 00000100:00100000:0.0:1746144865.189921:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.189965:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.190300:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174226816 00000100:00100000:0.0:1746144865.190305:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174226816 00002000:00100000:0.0:1746144865.190331:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8801358eea00 x1830965174226816/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:506/0 lens 488/0 e 0 to 0 dl 1746144876 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144865.190340:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358eea00 with x1830965174226816 ext(0->4095) 00010000:00010000:0.0:1746144865.190345:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af6727512179 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c8c expref: 6 pid: 8430 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.190354:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af6727512179 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c8c expref: 6 pid: 8430 timeout: 559 lvb_type: 0 00002000:00010000:0.0:1746144865.190360:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801358eea00 00000100:00100000:0.0:1746144865.190374:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 833 00000100:00100000:0.0:1746144865.190379:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174226816:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144865.190488:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174226816:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 109us (522us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144865.190494:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 833 00002000:00100000:0.0:1746144865.190498:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8801358eea00 x1830965174226816/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:506/0 lens 488/4536 e 0 to 0 dl 1746144876 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144865.190505:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358eea00 with x1830965174226816 ext(0->4095) 00010000:00010000:0.0:1746144865.190510:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af6727512179 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c8c expref: 6 pid: 8430 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.190518:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af6727512179 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91c8c expref: 6 pid: 8430 timeout: 559 lvb_type: 0 00002000:00010000:0.0:1746144865.190523:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801358eea00 00000100:00100000:0.0:1746144865.194386:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.200033:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174227200 00000100:00100000:0.0:1746144865.200039:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174227200 00002000:00100000:0.0:1746144865.200071:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880087545c00 x1830965174227200/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:506/0 lens 488/0 e 0 to 0 dl 1746144876 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144865.200079:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087545c00 with x1830965174227200 ext(0->4095) 00002000:00010000:0.0:1746144865.200083:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087545c00 00000100:00100000:0.0:1746144865.200106:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3164 00000100:00100000:0.0:1746144865.200111:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+124:1984:x1830965174227200:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144865.200826:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+124:1984:x1830965174227200:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 714us (846us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144865.200832:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3164 00002000:00100000:0.0:1746144865.200837:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880087545c00 x1830965174227200/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:506/0 lens 488/4536 e 0 to 0 dl 1746144876 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144865.200844:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087545c00 with x1830965174227200 ext(0->4095) 00002000:00010000:0.0:1746144865.200846:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087545c00 00000100:00100000:0.0:1746144865.208656:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.210838:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.212860:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.215622:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.218718:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.222282:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.235887:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.238716:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.242867:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.245145:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.247589:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.248840:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.254573:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.266190:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.271019:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.273924:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.281151:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.286570:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.289547:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.293063:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.308653:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.313195:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.320056:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.332724:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.332795:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.336754:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.336802:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.342377:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.345717:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.351593:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.368183:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.368232:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.376329:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.379097:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.383988:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.388033:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.390857:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.393038:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.400714:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.406018:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.414131:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.424253:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174235136 00000100:00100000:0.0:1746144865.424261:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174235136 00000100:00100000:0.0:1746144865.424544:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3848 00000100:00100000:0.0:1746144865.424551:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+134:30931:x1830965174235136:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144865.424565:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144865.424579:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af67275121db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91ce7 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.424603:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099312a00/0x4076af67275121cd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91cd9 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.424610:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a91d200/0x4076af67275121d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ce0 expref: 135 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.424615:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144865.424617:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144865.424619:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af67275121db lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ce7 expref: 135 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.424641:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a91d200/0x4076af67275121d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ce0 expref: 135 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.424650:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a91d200/0x4076af67275121d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ce0 expref: 135 pid: 8430 timeout: 559 lvb_type: 0 00000100:00100000:0.0:1746144865.424660:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093855500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172032384:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144865.426087:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.426112:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174235392 00000100:00100000:0.0:1746144865.426117:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174235392 00002000:00100000:0.0:1746144865.426145:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093856d80 x1830965174235392/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:506/0 lens 488/0 e 0 to 0 dl 1746144876 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144865.426153:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093856d80 with x1830965174235392 ext(0->4095) 00010000:00010000:0.0:1746144865.426159:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099312a00/0x4076af67275121cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91cd9 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.426167:0:8438:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: ffff880099312a00/0x4076af67275121cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91cd9 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144865.426172:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093856d80 00000100:00100000:0.0:1746144865.426208:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 845 00000100:00100000:0.0:1746144865.426214:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174235392:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144865.426333:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174235392:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 119us (251us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144865.426339:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 845 00002000:00100000:0.0:1746144865.426344:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093856d80 x1830965174235392/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:506/0 lens 488/4536 e 0 to 0 dl 1746144876 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144865.426350:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093856d80 with x1830965174235392 ext(0->4095) 00010000:00010000:0.0:1746144865.426354:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099312a00/0x4076af67275121cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91cd9 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.426360:0:8438:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: ffff880099312a00/0x4076af67275121cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91cd9 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144865.426365:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093856d80 00000100:00100000:0.0:1746144865.429592:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.432651:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.433635:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009181c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172032512:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144865.433658:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af67275121db lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ce7 expref: 134 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.433671:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500c00, rc 0) 00000100:00100000:0.0:1746144865.433702:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+134:30931:x1830965174235136:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 9152us (9522us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144865.433708:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3848 00000100:00100000:0.0:1746144865.433728:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174235648 00000100:00100000:0.0:1746144865.433732:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174235648 00000100:00100000:0.0:1746144865.433757:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3849 00000100:00100000:0.0:1746144865.433777:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+134:30934:x1830965174235648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144865.433788:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144865.433799:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af67275121e2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91cee expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.433813:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144865.433816:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af67275121db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ce7 expref: 135 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.433821:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144865.433823:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af67275121e2 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91cee expref: 135 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.433844:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af67275121db lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ce7 expref: 135 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.433852:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af67275121e2 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91cee expref: 135 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.433858:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501200, rc 0) 00000100:00100000:0.0:1746144865.433875:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+135:30934:x1830965174235648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 113us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144865.433880:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3849 00000100:00100000:0.0:1746144865.459090:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.468212:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174236672 00000100:00100000:0.0:1746144865.468219:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174236672 00002000:00100000:0.0:1746144865.468255:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009181fb80 x1830965174236672/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:506/0 lens 488/0 e 0 to 0 dl 1746144876 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144865.468269:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181fb80 with x1830965174236672 ext(0->4095) 00002000:00010000:0.0:1746144865.468273:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009181fb80 00000100:00100000:0.0:1746144865.468902:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3174 00000100:00100000:0.0:1746144865.468908:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+136:1982:x1830965174236672:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144865.469023:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+136:1982:x1830965174236672:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 115us (937us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144865.469029:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3174 00002000:00100000:0.0:1746144865.469034:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009181fb80 x1830965174236672/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:506/0 lens 488/4536 e 0 to 0 dl 1746144876 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144865.469040:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181fb80 with x1830965174236672 ext(0->4095) 00002000:00010000:0.0:1746144865.469043:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009181fb80 00000100:00100000:0.0:1746144865.470387:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.471957:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.475912:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.480246:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174237312 00000100:00100000:0.0:1746144865.480253:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174237312 00002000:00100000:0.0:1746144865.480281:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8801391d3480 x1830965174237312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:506/0 lens 488/0 e 0 to 0 dl 1746144876 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144865.480289:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d3480 with x1830965174237312 ext(0->4095) 00010000:00010000:0.0:1746144865.480295:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bf1b600/0x4076af67275121e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91cf5 expref: 136 pid: 10401 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.480306:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bf1b600/0x4076af67275121e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91cf5 expref: 136 pid: 10401 timeout: 559 lvb_type: 0 00002000:00010000:0.0:1746144865.480316:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801391d3480 00000100:00100000:0.0:1746144865.480338:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 848 00000100:00100000:0.0:1746144865.480344:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+136:1983:x1830965174237312:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144865.481135:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+136:1983:x1830965174237312:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 789us (1119us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144865.481140:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 848 00002000:00100000:0.0:1746144865.481146:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8801391d3480 x1830965174237312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:506/0 lens 488/4536 e 0 to 0 dl 1746144876 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144865.481152:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d3480 with x1830965174237312 ext(0->4095) 00010000:00010000:0.0:1746144865.481157:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bf1b600/0x4076af67275121e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91cf5 expref: 136 pid: 10401 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.481166:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bf1b600/0x4076af67275121e9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91cf5 expref: 136 pid: 10401 timeout: 559 lvb_type: 0 00002000:00010000:0.0:1746144865.481171:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801391d3480 00000100:00100000:0.0:1746144865.483344:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.485629:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.489920:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.492755:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.496500:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.511531:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.511612:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.516581:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.517703:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.518632:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.518691:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174238848 00000100:00100000:0.0:1746144865.518695:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174238848 00010000:00010000:0.0:1746144865.518710:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091708400/0x4076af67275121f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91cfc expref: 7 pid: 8430 timeout: 559 lvb_type: 0 00000100:00100000:0.0:1746144865.519067:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9272 00000100:00100000:0.0:1746144865.519072:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1984:x1830965174238848:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144865.519079:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144865.519093:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091708400/0x4076af67275121f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91cfc expref: 7 pid: 8430 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.519102:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091708400/0x4076af67275121f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91cfc expref: 7 pid: 8430 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.519114:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091708400/0x4076af67275121f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91cfc expref: 7 pid: 8430 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.519455:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144865.519477:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174238848:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 404us (2902us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144865.519482:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9272 00000100:00100000:0.0:1746144865.519493:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9273 00000100:00100000:0.0:1746144865.519497:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+139:1984:x1830965174239104:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144865.519503:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144865.519511:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bf1ac00/0x4076af67275121f7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d03 expref: 139 pid: 10401 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.519519:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bf1ac00/0x4076af67275121f7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d03 expref: 139 pid: 10401 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.519531:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf1ac00/0x4076af67275121f7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d03 expref: 139 pid: 10401 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.519538:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144865.519540:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144865.519544:0:7099:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf1b600/0x4076af67275121fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d0a expref: 138 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.519551:0:7099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf1b600/0x4076af67275121fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d0a expref: 138 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.519572:0:7099:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf1b600/0x4076af67275121fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d0a expref: 138 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.519581:0:7099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf1b600/0x4076af67275121fe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d0a expref: 138 pid: 10401 timeout: 559 lvb_type: 0 00000100:00100000:0.0:1746144865.519591:0:7099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092587100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965172034816:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144865.519635:0:7099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144865.523527:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.527009:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.530831:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.540317:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.547255:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.553969:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.557256:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.557294:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.562718:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.562792:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.563501:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.570875:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.576309:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.590926:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.592474:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.592488:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174242304 00000100:00100000:0.0:1746144865.592490:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174242304 00000100:00100000:0.0:1746144865.592519:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3859 00000100:00100000:0.0:1746144865.592523:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+142:30931:x1830965174242304:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144865.592529:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144865.592533:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099501800/0x4076af6727512228 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91d34 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.592547:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af672751221a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d26 expref: 143 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.592554:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727512221 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d2d expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.592558:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144865.592559:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144865.592562:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099501800/0x4076af6727512228 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d34 expref: 143 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.592684:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727512221 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d2d expref: 6 pid: 8430 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.592692:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727512221 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d2d expref: 6 pid: 8430 timeout: 559 lvb_type: 0 00000100:00100000:0.0:1746144865.592701:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092588a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172035712:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144865.592777:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af672751221a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d26 expref: 143 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.592784:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091709200/0x4076af672751221a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d26 expref: 143 pid: 8430 timeout: 559 lvb_type: 0 00000100:00100000:0.0:1746144865.592792:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172035840:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144865.592823:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144865.595914:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.595954:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.599304:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.604345:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.611905:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.623247:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.624952:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.629419:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174243840 00000100:00100000:0.0:1746144865.629425:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174243840 00002000:00100000:0.0:1746144865.629457:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009398dc00 x1830965174243840/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:506/0 lens 488/0 e 0 to 0 dl 1746144876 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144865.629465:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398dc00 with x1830965174243840 ext(0->4095) 00010000:00010000:0.0:1746144865.629473:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af672751222f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d3b expref: 6 pid: 8432 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.629483:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af672751222f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d3b expref: 6 pid: 8432 timeout: 559 lvb_type: 0 00002000:00010000:0.0:1746144865.629488:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009398dc00 00000100:00100000:0.0:1746144865.629500:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 857 00000100:00100000:0.0:1746144865.629505:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174243840:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144865.630111:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174243840:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 604us (1062us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144865.630117:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 857 00002000:00100000:0.0:1746144865.630122:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009398dc00 x1830965174243840/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:506/0 lens 488/4536 e 0 to 0 dl 1746144876 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144865.630129:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398dc00 with x1830965174243840 ext(0->4095) 00010000:00010000:0.0:1746144865.630133:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af672751222f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d3b expref: 6 pid: 8432 timeout: 559 lvb_type: 0 00010000:00010000:0.0:1746144865.630141:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af672751222f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d3b expref: 6 pid: 8432 timeout: 559 lvb_type: 0 00002000:00010000:0.0:1746144865.630146:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009398dc00 00000100:00100000:0.0:1746144865.636694:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.640687:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.643892:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.656091:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.657051:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.660121:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093369c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172036864:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144865.660137:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144865.660156:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+146:1982:x1830965174244736:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2981us (3106us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144865.660163:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9282 00000100:00100000:0.0:1746144865.662737:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.663915:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.669610:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.677213:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.686494:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.691294:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.697856:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.700410:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174246400 00000100:00100000:0.0:1746144865.700414:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174246400 00000100:00100000:0.0:1746144865.700433:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3866 00000100:00100000:0.0:1746144865.700439:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965174246400:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144865.700445:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144865.700451:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099501800/0x4076af6727512259 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91d65 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.700461:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144865.700465:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3400/0x4076af6727512252 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d5e expref: 149 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.700474:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144865.700476:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099501800/0x4076af6727512259 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d65 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.700495:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b3400/0x4076af6727512252 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d5e expref: 149 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.700505:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099501800/0x4076af6727512259 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91d65 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144865.700513:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501800, rc 0) 00000100:00100000:0.0:1746144865.700534:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965174246400:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 95us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144865.700540:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3866 00000100:00100000:0.0:1746144865.708073:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.716628:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.718656:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.728586:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.744556:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.744609:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.749134:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.749860:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.756306:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.756348:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.762723:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.769689:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.771713:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.774288:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.797595:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.800206:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.802100:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.817052:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.825398:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.831293:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.831794:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.835472:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.841825:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.843823:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.845657:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.847525:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.848621:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.855815:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.858303:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.858351:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.860558:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.860588:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.860775:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.862756:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.869499:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.877152:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.879967:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.883573:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.885151:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.887543:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.889891:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.891169:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.891221:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.895031:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.898461:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.905036:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.912389:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174255872 00000100:00100000:0.0:1746144865.912395:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174255872 00002000:00100000:0.0:1746144865.912424:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800a417d880 x1830965174255872/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:506/0 lens 488/0 e 0 to 0 dl 1746144876 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144865.912432:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417d880 with x1830965174255872 ext(0->4095) 00002000:00010000:0.0:1746144865.912436:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a417d880 00000100:00100000:0.0:1746144865.912458:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3194 00000100:00100000:0.0:1746144865.912464:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+158:1983:x1830965174255872:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144865.912583:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+158:1983:x1830965174255872:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 118us (547us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144865.912588:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3194 00002000:00100000:0.0:1746144865.912593:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800a417d880 x1830965174255872/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:506/0 lens 488/4536 e 0 to 0 dl 1746144876 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144865.912600:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417d880 with x1830965174255872 ext(0->4095) 00002000:00010000:0.0:1746144865.912603:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a417d880 00000100:00100000:0.0:1746144865.919829:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.932109:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.932139:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.935047:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.937158:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.944890:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.964327:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.975157:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.976668:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.981855:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144865.995225:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.001513:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144866.002653:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144866.008912:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.012959:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144866.013256:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144866.014143:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.016043:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.019256:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.023009:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.027694:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.029376:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.031753:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.037526:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.041950:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.057473:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.061259:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.063022:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.065710:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.068125:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.068176:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.072757:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.095306:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.095346:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.121348:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.125165:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.132296:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.133837:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.138605:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.145679:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.148334:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.150307:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.152671:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.171247:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174264064 00000100:00100000:0.0:1746144866.171255:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174264064 00002000:00100000:0.0:1746144866.171294:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093369c00 x1830965174264064/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:507/0 lens 488/0 e 0 to 0 dl 1746144877 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144866.171302:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369c00 with x1830965174264064 ext(0->4095) 00002000:00010000:0.0:1746144866.171306:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093369c00 00000100:00100000:0.0:1746144866.171332:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3203 00000100:00100000:0.0:1746144866.171339:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+168:1985:x1830965174264064:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144866.172547:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+168:1985:x1830965174264064:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 1206us (1384us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144866.172554:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3203 00002000:00100000:0.0:1746144866.172560:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093369c00 x1830965174264064/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:507/0 lens 488/4536 e 0 to 0 dl 1746144877 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144866.172566:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369c00 with x1830965174264064 ext(0->4095) 00002000:00010000:0.0:1746144866.172570:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093369c00 00000100:00100000:0.0:1746144866.177598:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.178584:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.187010:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.192384:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.201713:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.212158:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.220425:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.227062:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174265856 00000100:00100000:0.0:1746144866.227067:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174265856 00002000:00100000:0.0:1746144866.227098:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8801358edc00 x1830965174265856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:507/0 lens 488/0 e 0 to 0 dl 1746144877 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144866.227106:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358edc00 with x1830965174265856 ext(0->4095) 00010000:00010000:0.0:1746144866.227113:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2600/0x4076af6727512316 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e22 expref: 171 pid: 8432 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1746144866.227125:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b2600/0x4076af6727512316 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e22 expref: 171 pid: 8432 timeout: 560 lvb_type: 0 00002000:00010000:0.0:1746144866.227131:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801358edc00 00000100:00100000:0.0:1746144866.227143:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 888 00000100:00100000:0.0:1746144866.227149:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+171:1985:x1830965174265856:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144866.227292:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+171:1985:x1830965174265856:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 142us (410us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144866.227298:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 888 00002000:00100000:0.0:1746144866.227303:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8801358edc00 x1830965174265856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:507/0 lens 488/4536 e 0 to 0 dl 1746144877 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144866.227310:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358edc00 with x1830965174265856 ext(0->4095) 00010000:00010000:0.0:1746144866.227314:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2600/0x4076af6727512316 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e22 expref: 171 pid: 8432 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1746144866.227322:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b2600/0x4076af6727512316 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e22 expref: 171 pid: 8432 timeout: 560 lvb_type: 0 00002000:00010000:0.0:1746144866.227328:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801358edc00 00000100:00100000:0.0:1746144866.235309:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.235361:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.245167:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.253552:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.270588:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.278508:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.283501:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.292033:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.296891:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.306827:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.306891:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.306909:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174268032 00000100:00100000:0.0:1746144866.306914:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174268032 00010000:00010000:0.0:1746144866.306937:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727512324 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e30 expref: 6 pid: 8432 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1746144866.306966:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174267904 00000100:00100000:0.0:1746144866.306969:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174267904 00010000:00010000:0.0:1746144866.306978:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af672751232b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e37 expref: 173 pid: 8432 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1746144866.306993:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9316 00000100:00100000:0.0:1746144866.306998:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801349cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174268032:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144866.307008:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144866.307025:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727512324 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e30 expref: 6 pid: 8432 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1746144866.307034:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727512324 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e30 expref: 6 pid: 8432 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1746144866.307056:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727512324 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e30 expref: 6 pid: 8432 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1746144866.307232:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144866.307267:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801349cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965174268032:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 268us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144866.307272:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9316 00000100:00100000:0.0:1746144866.313007:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.317751:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.321860:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.333047:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.337482:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.338617:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.341472:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.342368:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.361375:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.376541:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.383607:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.392064:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.399482:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.399516:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.405975:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.406012:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.411167:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174271360 00000100:00100000:0.0:1746144866.411174:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174271360 00000100:00100000:0.0:1746144866.411234:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3903 00000100:00100000:0.0:1746144866.411840:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965174271360:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144866.411852:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144866.411861:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af672751235c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91e68 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144866.411875:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf1ac00/0x4076af6727512355 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e61 expref: 176 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144866.411880:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144866.411881:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144866.411883:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af672751235c lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e68 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144866.411906:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf1ac00/0x4076af6727512355 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e61 expref: 176 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144866.411915:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf1ac00/0x4076af6727512355 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e61 expref: 176 pid: 20722 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1746144866.411928:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880133929c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172045952:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144866.412568:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144866.416592:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.428988:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.439131:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.439947:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.439972:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174272256 00000100:00100000:0.0:1746144866.439975:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174272256 00000100:00100000:0.0:1746144866.443693:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.446408:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.448645:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.450062:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.455372:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.457814:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.463122:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.467096:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.470496:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.474929:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.475586:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.480574:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.480629:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.483719:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.489979:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.492999:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.500629:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.507260:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.508212:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.509754:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.529024:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.535021:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174276736 00000100:00100000:0.0:1746144866.535032:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174276736 00002000:00100000:0.0:1746144866.535074:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff88008e832a00 x1830965174276736/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:507/0 lens 496/0 e 0 to 0 dl 1746144877 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144866.535085:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e832a00 with x1830965174276736 ext(0->7) 00010000:00010000:0.0:1746144866.535093:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af672751238d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e99 expref: 182 pid: 8432 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1746144866.535105:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af672751238d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e99 expref: 182 pid: 8432 timeout: 560 lvb_type: 0 00002000:00010000:0.0:1746144866.535112:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e832a00 00000100:00100000:0.0:1746144866.535137:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 907 00000100:00100000:0.0:1746144866.535144:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+182:1983:x1830965174276736:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144866.535474:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+184:1983:x1830965174276736:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 Request processed in 330us (583us total) trans 4294968355 rc 0/0 00000100:00100000:0.0:1746144866.535481:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 907 00002000:00100000:0.0:1746144866.535486:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff88008e832a00 x1830965174276736/t4294968355(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:507/0 lens 496/448 e 0 to 0 dl 1746144877 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144866.535493:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e832a00 with x1830965174276736 ext(0->7) 00010000:00010000:0.0:1746144866.535497:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af672751238d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e99 expref: 184 pid: 8432 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1746144866.535510:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af672751238d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91e99 expref: 184 pid: 8432 timeout: 560 lvb_type: 0 00002000:00010000:0.0:1746144866.535515:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e832a00 00000100:00100000:0.0:1746144866.549129:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.552999:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.555268:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.555300:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174277248 00000100:00100000:0.0:1746144866.555305:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174277248 00002000:00100000:0.0:1746144866.555346:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88013289b480 x1830965174277248/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:507/0 lens 488/0 e 0 to 0 dl 1746144877 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144866.555356:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013289b480 with x1830965174277248 ext(0->4095) 00010000:00010000:0.0:1746144866.555364:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727512394 lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ea0 expref: 6 pid: 20722 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1746144866.555376:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727512394 lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ea0 expref: 6 pid: 20722 timeout: 560 lvb_type: 0 00002000:00010000:0.0:1746144866.555382:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013289b480 00000100:00100000:0.0:1746144866.555402:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 908 00000100:00100000:0.0:1746144866.555408:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013289b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174277248:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144866.558150:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013289b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174277248:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 2732us (2880us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144866.558160:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 908 00002000:00100000:0.0:1746144866.558173:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88013289b480 x1830965174277248/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:507/0 lens 488/4536 e 0 to 0 dl 1746144877 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144866.558183:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013289b480 with x1830965174277248 ext(0->4095) 00010000:00010000:0.0:1746144866.558202:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727512394 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ea0 expref: 6 pid: 20722 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1746144866.558214:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727512394 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ea0 expref: 6 pid: 20722 timeout: 560 lvb_type: 0 00002000:00010000:0.0:1746144866.558221:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013289b480 00000100:00100000:0.0:1746144866.560377:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.564117:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.571213:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.575712:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.578738:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.582315:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.585598:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.585688:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.587817:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.589067:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.589979:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.590442:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.593299:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.597227:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.600359:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.608057:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.612945:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.616547:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.619751:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.622405:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.623258:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174280832 00000100:00100000:0.0:1746144866.623262:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174280832 00000100:00100000:0.0:1746144866.623283:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3919 00000100:00100000:0.0:1746144866.623288:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965174280832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144866.623300:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144866.623311:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af67275123cc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91ed8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144866.623327:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144866.623332:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af67275123c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ed1 expref: 188 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144866.623337:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144866.623340:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af67275123cc lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ed8 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144866.623371:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af67275123c5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ed1 expref: 189 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144866.623381:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af67275123cc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ed8 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144866.623389:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501200, rc 0) 00000100:00100000:0.0:1746144866.623409:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801362ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965174280832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 121us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144866.623418:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3919 00000100:00100000:0.0:1746144866.625056:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.628479:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.630602:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.633098:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.635893:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.637909:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.642636:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.642983:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.648546:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.648574:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.648604:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.652102:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.659932:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.665713:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.674049:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.677880:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.687683:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.698468:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.705993:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.719829:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.726330:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.735937:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.741993:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.747585:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.760238:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.774524:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.783644:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.788010:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.788059:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.791311:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.797652:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.802961:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.810119:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.813314:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.816123:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.819261:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.824640:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.831811:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.832898:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.832952:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.832964:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174288768 00000100:00100000:0.0:1746144866.832967:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174288768 00010000:00010000:0.0:1746144866.832984:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af672751240b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91f17 expref: 200 pid: 8430 timeout: 560 lvb_type: 0 00000100:00100000:0.0:1746144866.832998:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9350 00000100:00100000:0.0:1746144866.833002:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135c69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+200:1985:x1830965174288768:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144866.833010:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144866.833020:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af672751240b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91f17 expref: 200 pid: 8430 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1746144866.833029:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af672751240b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91f17 expref: 200 pid: 8430 timeout: 560 lvb_type: 0 00010000:00010000:0.0:1746144866.833048:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144866.833051:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144866.833057:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af6727512419 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91f25 expref: 200 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144866.833065:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af6727512419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91f25 expref: 200 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144866.833096:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af6727512419 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91f25 expref: 200 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144866.833106:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb4ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965172052224:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144866.833173:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144866.835638:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb4ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965172052224:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144866.835652:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144866.836419:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135c69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+198:1985:x1830965174288768:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3413us (3463us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144866.836429:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9350 00000100:00100000:0.0:1746144866.837476:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965172052352:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144866.837497:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727512420 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91f2c expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144866.837511:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091751200, rc 0) 00000100:00100000:0.0:1746144866.837531:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135c6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965174288640:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4228us (4635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144866.837541:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3931 00000100:00100000:0.0:1746144866.846558:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.856451:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.861996:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.870176:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.876213:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.881459:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.887481:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.893548:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.900551:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.907196:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.907244:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.912522:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.913923:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.918833:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.928204:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.932892:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.937434:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.937546:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.942994:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.943261:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.945819:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.950077:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.954312:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.958364:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.960862:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.963712:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.969720:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.969800:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.973594:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.973645:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.973669:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144866.977713:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.000533:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.004023:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.009700:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.017523:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.020547:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172054912 00000100:00100000:0.0:1746144867.020553:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172054912 00000100:00100000:0.0:1746144867.022313:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1746144867.022325:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1830965172054912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746144867.022362:0:8434:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 624623616 pending 0 free 3855613952 avail 3853516800 00000100:00100000:0.0:1746144867.022414:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1830965172054912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144867.022420:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:0.0:1746144867.022442:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144867.022493:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.022566:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.025413:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.030055:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.033144:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.039282:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.048280:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.056466:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.056583:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.060545:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.061018:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.062586:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174297600 00000100:00100000:0.0:1746144867.062591:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174297600 00010000:00010000:0.0:1746144867.062610:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091708200/0x4076af672751246d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91f79 expref: 6 pid: 10401 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1746144867.063644:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9364 00000100:00100000:0.0:1746144867.063654:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174297600:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144867.063665:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144867.063681:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091708200/0x4076af672751246d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91f79 expref: 6 pid: 10401 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.063691:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091708200/0x4076af672751246d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91f79 expref: 6 pid: 10401 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.063707:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091708200/0x4076af672751246d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91f79 expref: 6 pid: 10401 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.063733:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144867.063735:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144867.063742:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af672751247b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91f87 expref: 210 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.063748:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af672751247b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91f87 expref: 210 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.063789:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af672751247b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91f87 expref: 210 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.063801:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091709600/0x4076af672751247b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91f87 expref: 210 pid: 10401 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1746144867.063810:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172055808:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144867.065011:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144867.068208:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.072115:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.077022:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.080556:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.083985:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.088243:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.092620:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.092703:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.103889:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.103913:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.103935:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.103978:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174299648 00000100:00100000:0.0:1746144867.103986:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174299648 00010000:00010000:0.0:1746144867.104015:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880092553a00/0x4076af6727512482 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91f8e expref: 214 pid: 10401 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1746144867.110234:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.114292:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.121868:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.125807:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.129125:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.134306:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.140115:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.140207:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.142942:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174301056 00000100:00100000:0.0:1746144867.142950:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174301056 00000100:00100000:0.0:1746144867.142999:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3950 00000100:00100000:0.0:1746144867.143006:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801360b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+214:30931:x1830965174301056:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144867.143018:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144867.143031:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af67275124a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af91fb1 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.143057:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727512497 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91fa3 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.143064:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af672751249e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91faa expref: 215 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.143070:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144867.143072:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144867.143075:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af67275124a5 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91fb1 expref: 215 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.143099:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af672751249e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91faa expref: 215 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.143109:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091709e00/0x4076af672751249e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91faa expref: 215 pid: 10401 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1746144867.143125:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801360b9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172056704:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144867.147168:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727512497 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91fa3 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.147198:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727512497 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91fa3 expref: 5 pid: 8432 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1746144867.147211:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801360b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172056832:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144867.147298:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144867.149711:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.152085:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.159639:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.160514:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.160726:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174301952 00000100:00100000:0.0:1746144867.160730:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174301952 00002000:00100000:0.0:1746144867.160752:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8801360baa00 x1830965174301952/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/0 e 0 to 0 dl 1746144878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.160783:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801360baa00 with x1830965174301952 ext(0->4095) 00010000:00010000:0.0:1746144867.160790:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af67275124a5 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91fb1 expref: 216 pid: 10401 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.160799:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af67275124a5 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91fb1 expref: 216 pid: 10401 timeout: 561 lvb_type: 0 00002000:00010000:0.0:1746144867.160804:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801360baa00 00000100:00100000:0.0:1746144867.167792:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.173997:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.177082:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.180698:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.184121:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.198154:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.209736:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.209837:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.216738:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.223175:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.225796:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.244293:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.249597:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.256119:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.257727:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965172057984:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144867.257745:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091751400/0x4076af67275124c8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91fd4 expref: 218 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.257756:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091751400, rc 0) 00000100:00100000:0.0:1746144867.257794:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+218:30931:x1830965174304256:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7247us (8202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144867.257800:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3955 00000100:00100000:0.0:1746144867.263317:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.270028:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.275604:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.282591:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.288701:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.290380:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.296992:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.310590:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.326130:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.337722:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.345071:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.357068:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.375792:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.378427:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.379702:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.386229:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.394447:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174308224 00000100:00100000:0.0:1746144867.394455:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174308224 00002000:00100000:0.0:1746144867.394492:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880135eaa300 x1830965174308224/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/0 e 0 to 0 dl 1746144878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.394501:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135eaa300 with x1830965174308224 ext(0->4095) 00010000:00010000:0.0:1746144867.394508:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092552a00/0x4076af67275124eb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ff7 expref: 223 pid: 20722 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.394520:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092552a00/0x4076af67275124eb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ff7 expref: 223 pid: 20722 timeout: 561 lvb_type: 0 00002000:00010000:0.0:1746144867.394527:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135eaa300 00000100:00100000:0.0:1746144867.394556:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 956 00000100:00100000:0.0:1746144867.394563:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+223:1985:x1830965174308224:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144867.394705:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+223:1985:x1830965174308224:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 142us (353us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144867.394714:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 956 00002000:00100000:0.0:1746144867.394719:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880135eaa300 x1830965174308224/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/4536 e 0 to 0 dl 1746144878 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.394726:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135eaa300 with x1830965174308224 ext(0->4095) 00010000:00010000:0.0:1746144867.394730:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092552a00/0x4076af67275124eb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ff7 expref: 223 pid: 20722 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.394739:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092552a00/0x4076af67275124eb lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af91ff7 expref: 223 pid: 20722 timeout: 561 lvb_type: 0 00002000:00010000:0.0:1746144867.394744:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135eaa300 00000100:00100000:0.0:1746144867.414527:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.424614:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.425919:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.436131:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.442938:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.450978:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.456370:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.460619:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.465094:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.471912:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.476503:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.477818:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.483810:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.483872:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.492933:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.495759:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.499571:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.503132:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.507446:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.507470:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174311936 00000100:00100000:0.0:1746144867.507476:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174311936 00002000:00100000:0.0:1746144867.507507:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880135227800 x1830965174311936/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:508/0 lens 488/0 e 0 to 0 dl 1746144878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.507517:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135227800 with x1830965174311936 ext(0->4095) 00002000:00010000:0.0:1746144867.507521:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135227800 00000100:00100000:0.0:1746144867.507551:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3243 00000100:00100000:0.0:1746144867.507558:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965174311936:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144867.507695:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965174311936:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 137us (254us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144867.507701:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3243 00002000:00100000:0.0:1746144867.507706:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880135227800 x1830965174311936/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:508/0 lens 488/4536 e 0 to 0 dl 1746144878 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.507713:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135227800 with x1830965174311936 ext(0->4095) 00002000:00010000:0.0:1746144867.507715:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135227800 00000100:00100000:0.0:1746144867.509948:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.512419:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.521567:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.526979:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.534661:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:0.0:1746144867.537440:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144867.539684:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.539707:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.539732:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.544827:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.551262:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.557433:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.559897:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.571643:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.574993:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174315008 00000100:00100000:0.0:1746144867.574996:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174315008 00000100:00100000:0.0:1746144867.575016:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3972 00000100:00100000:0.0:1746144867.575021:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+232:30934:x1830965174315008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144867.575030:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144867.575038:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af672751253f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9204b expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.575052:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727512538 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92044 expref: 233 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.575057:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144867.575058:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144867.575061:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af672751253f lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9204b expref: 233 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.575075:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727512538 lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92044 expref: 233 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.575084:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727512538 lrc: 7/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92044 expref: 233 pid: 8430 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1746144867.575092:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172061824:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144867.575839:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144867.579717:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172061824:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144867.579739:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af672751253f lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9204b expref: 231 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.579753:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500c00, rc 0) 00000100:00100000:0.0:1746144867.579794:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+231:30934:x1830965174315008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4773us (5554us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144867.579801:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3972 00000100:00100000:0.0:1746144867.579869:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.603975:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.604001:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174315776 00000100:00100000:0.0:1746144867.604007:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174315776 00010000:00010000:0.0:1746144867.604035:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727512538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92044 expref: 233 pid: 8430 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1746144867.604057:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9392 00000100:00100000:0.0:1746144867.604064:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092588a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+233:1985:x1830965174315776:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144867.604075:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746144867.604090:0:7099:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb mtime from disk: 1746144867 -> 1746144868 00002000:00010000:0.0:1746144867.604093:0:7099:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb ctime from disk: 1746144867 -> 1746144868 00010000:00010000:0.0:1746144867.604098:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727512538 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92044 expref: 233 pid: 8430 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.604113:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727512538 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92044 expref: 233 pid: 8430 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.604131:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af6727512538 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92044 expref: 233 pid: 8430 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.604146:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144867.604147:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144867.604153:0:7099:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af672751253f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9204b expref: 232 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.604159:0:7099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af672751253f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9204b expref: 232 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.604195:0:7099:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af672751253f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9204b expref: 232 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144867.604206:0:7099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965172061952:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144867.604262:0:7099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144867.605847:0:7099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965172061952:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144867.605858:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144867.605928:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092588a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+232:1985:x1830965174315776:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1863us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144867.605936:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9392 00000100:00100000:0.0:1746144867.606004:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.606041:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174316032 00000100:00100000:0.0:1746144867.606045:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174316032 00002000:00100000:0.0:1746144867.606068:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009258b800 x1830965174316032/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/0 e 0 to 0 dl 1746144878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.606075:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258b800 with x1830965174316032 ext(0->4095) 00002000:00010000:0.0:1746144867.606079:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009258b800 00000100:00100000:0.0:1746144867.606092:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3248 00000100:00100000:0.0:1746144867.606098:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+232:1984:x1830965174316032:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144867.606213:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+232:1984:x1830965174316032:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 114us (208us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144867.606218:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3248 00002000:00100000:0.0:1746144867.606223:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009258b800 x1830965174316032/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/4536 e 0 to 0 dl 1746144878 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.606229:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258b800 with x1830965174316032 ext(0->4095) 00002000:00010000:0.0:1746144867.606232:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009258b800 00000100:00100000:0.0:1746144867.609084:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.609145:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.609165:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174316160 00000100:00100000:0.0:1746144867.609170:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174316160 00000100:00100000:0.0:1746144867.609200:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174316288 00000100:00100000:0.0:1746144867.609202:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174316288 00000100:00100000:0.0:1746144867.609213:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3973 00000100:00100000:0.0:1746144867.609218:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965174316160:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144867.609229:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144867.609241:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af6727512546 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92052 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.609259:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144867.609261:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144867.609267:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af6727512546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92052 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.609279:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af6727512546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92052 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.609288:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500e00, rc 0) 00000100:00100000:0.0:1746144867.609318:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965174316160:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 99us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144867.609323:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3973 00000100:00100000:0.0:1746144867.609335:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3974 00000100:00100000:0.0:1746144867.609339:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+232:30931:x1830965174316288:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144867.609344:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144867.609348:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099500400/0x4076af672751254d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92059 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.609358:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af672751253f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9204b expref: 233 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.609365:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af6727512546 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92052 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.609369:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144867.609371:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144867.609373:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099500400/0x4076af672751254d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92059 expref: 233 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.609393:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af6727512546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92052 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.609403:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af6727512546 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92052 expref: 5 pid: 8430 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1746144867.609413:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b030700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172062080:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144867.609461:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af672751253f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9204b expref: 233 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.609468:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af672751253f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9204b expref: 233 pid: 10401 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1746144867.609474:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b032d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172062208:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144867.609488:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144867.611377:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.611406:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.611425:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174316544 00000100:00100000:0.0:1746144867.611428:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174316544 00010000:00010000:0.0:1746144867.611449:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af672751253f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9204b expref: 234 pid: 10401 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1746144867.611469:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9393 00000100:00100000:0.0:1746144867.611474:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+234:1984:x1830965174316544:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144867.611485:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144867.611503:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af672751253f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9204b expref: 234 pid: 10401 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.611510:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af672751253f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9204b expref: 234 pid: 10401 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.611526:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144867.611549:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+234:1984:x1830965174316544:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 74us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144867.611555:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9393 00000100:00100000:0.0:1746144867.611570:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174316672 00000100:00100000:0.0:1746144867.611573:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174316672 00002000:00100000:0.0:1746144867.611590:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009b030a80 x1830965174316672/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:508/0 lens 488/0 e 0 to 0 dl 1746144878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.611597:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b030a80 with x1830965174316672 ext(0->4095) 00010000:00010000:0.0:1746144867.611602:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af6727512546 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92052 expref: 6 pid: 8430 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.611610:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af6727512546 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92052 expref: 6 pid: 8430 timeout: 561 lvb_type: 0 00002000:00010000:0.0:1746144867.611615:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b030a80 00000100:00100000:0.0:1746144867.611625:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 968 00000100:00100000:0.0:1746144867.611630:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174316672:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144867.611730:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174316672:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 99us (322us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144867.611736:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 968 00002000:00100000:0.0:1746144867.611740:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009b030a80 x1830965174316672/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:508/0 lens 488/4536 e 0 to 0 dl 1746144878 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.611745:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b030a80 with x1830965174316672 ext(0->4095) 00010000:00010000:0.0:1746144867.611749:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af6727512546 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92052 expref: 6 pid: 8430 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.611757:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af6727512546 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92052 expref: 6 pid: 8430 timeout: 561 lvb_type: 0 00002000:00010000:0.0:1746144867.611775:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b030a80 00000100:00100000:0.0:1746144867.611859:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b030700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172062080:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144867.611867:0:8430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af672751253f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9204b expref: 233 pid: 10401 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1746144867.611875:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b032d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172062208:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144867.611890:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099500400/0x4076af672751254d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92059 expref: 232 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.611897:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500400, rc 0) 00000100:00100000:0.0:1746144867.611914:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+232:30931:x1830965174316288:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2574us (2769us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144867.611919:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3974 00000100:00100000:0.0:1746144867.619688:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.619726:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801362ad180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965172062336:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144867.619742:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144867.619788:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965174316800:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5614us (5729us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144867.619797:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9394 00000100:00100000:0.0:1746144867.619825:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174317056 00000100:00100000:0.0:1746144867.619829:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174317056 00002000:00100000:0.0:1746144867.619856:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009b032d80 x1830965174317056/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/0 e 0 to 0 dl 1746144878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.619865:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b032d80 with x1830965174317056 ext(0->4095) 00002000:00010000:0.0:1746144867.619868:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b032d80 00000100:00100000:0.0:1746144867.619882:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3249 00000100:00100000:0.0:1746144867.619887:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+232:1983:x1830965174317056:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144867.620003:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+232:1983:x1830965174317056:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 115us (321us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144867.620009:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3249 00002000:00100000:0.0:1746144867.620014:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009b032d80 x1830965174317056/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/4536 e 0 to 0 dl 1746144878 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.620020:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b032d80 with x1830965174317056 ext(0->4095) 00002000:00010000:0.0:1746144867.620022:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b032d80 00000100:00100000:0.0:1746144867.624137:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174317184 00000100:00100000:0.0:1746144867.624144:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174317184 00000100:00100000:0.0:1746144867.624218:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3975 00000100:00100000:0.0:1746144867.624225:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965174317184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144867.624241:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144867.624253:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ba7d200/0x4076af6727512554 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92060 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.624276:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099500400/0x4076af672751254d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92059 expref: 231 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.624282:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144867.624283:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144867.624286:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba7d200/0x4076af6727512554 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92060 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.624308:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099500400/0x4076af672751254d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92059 expref: 231 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.624316:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099500400/0x4076af672751254d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92059 expref: 231 pid: 8430 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1746144867.624326:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b030700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172062464:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144867.624380:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144867.635935:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174317440 00000100:00100000:0.0:1746144867.635943:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174317440 00010000:00010000:0.0:1746144867.635973:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099500400/0x4076af672751254d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92059 expref: 10 pid: 8430 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1746144867.636006:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9395 00000100:00100000:0.0:1746144867.636012:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965174317440:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144867.636025:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746144867.636039:0:7097:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x18:0x0] updating lvb atime from disk: 1746144867 -> 1746144868 00010000:00010000:0.0:1746144867.636044:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099500400/0x4076af672751254d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92059 expref: 10 pid: 8430 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.636055:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099500400/0x4076af672751254d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92059 expref: 10 pid: 8430 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.636077:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099500400/0x4076af672751254d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92059 expref: 10 pid: 8430 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.636089:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144867.636090:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144867.636096:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7d200/0x4076af6727512554 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92060 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.636103:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba7d200/0x4076af6727512554 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92060 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.636131:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ba7d200/0x4076af6727512554 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92060 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144867.636141:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b032a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965172062592:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144867.636236:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144867.639295:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.639986:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.641031:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.642093:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.644024:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.648163:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.650048:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.653432:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.658207:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.659839:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.671860:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174319616 00000100:00100000:0.0:1746144867.671868:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174319616 00002000:00100000:0.0:1746144867.671904:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8801362adc00 x1830965174319616/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/0 e 0 to 0 dl 1746144878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.671912:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801362adc00 with x1830965174319616 ext(0->4095) 00002000:00010000:0.0:1746144867.671916:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801362adc00 00000100:00100000:0.0:1746144867.671940:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3253 00000100:00100000:0.0:1746144867.671945:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1984:x1830965174319616:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144867.672079:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801362adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1984:x1830965174319616:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 133us (1446us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144867.672084:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3253 00002000:00100000:0.0:1746144867.672089:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8801362adc00 x1830965174319616/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/4536 e 0 to 0 dl 1746144878 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.672095:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801362adc00 with x1830965174319616 ext(0->4095) 00002000:00010000:0.0:1746144867.672098:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801362adc00 00000100:00100000:0.0:1746144867.677735:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.684654:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.694475:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.701097:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.709016:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.714436:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.718629:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.719852:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.720837:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3982 00000100:00100000:0.0:1746144867.720843:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+14:30931:x1830965174321280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144867.720848:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144867.720867:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094377600/0x4076af6727512585 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92091 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.720894:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af6727512577 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92083 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.720901:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144867.720903:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144867.720906:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094377600/0x4076af6727512585 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92091 expref: 16 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.721749:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af6727512577 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92083 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.721774:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af6727512577 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92083 expref: 5 pid: 10401 timeout: 561 lvb_type: 0 00000100:00100000:0.0:1746144867.721786:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cf2f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172063872:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144867.725587:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.731006:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.738433:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.740594:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.743610:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.748543:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.751249:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.751291:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.762439:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.762492:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.766662:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.773024:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.775862:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.782802:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.785479:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.788133:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.788887:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.789268:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144867.789884:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746144867.789887:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144867.792809:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174325632 00000100:00100000:0.0:1746144867.792816:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174325632 00002000:00100000:0.0:1746144867.792849:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009398ea00 x1830965174325632/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/0 e 0 to 0 dl 1746144878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.792858:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ea00 with x1830965174325632 ext(0->4095) 00010000:00010000:0.0:1746144867.792865:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ab5c00/0x4076af67275125a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920ad expref: 19 pid: 8432 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.792878:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ab5c00/0x4076af67275125a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920ad expref: 19 pid: 8432 timeout: 561 lvb_type: 0 00002000:00010000:0.0:1746144867.792884:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009398ea00 00000100:00100000:0.0:1746144867.792899:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 979 00000100:00100000:0.0:1746144867.792905:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965174325632:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144867.793047:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965174325632:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 141us (373us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144867.793053:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 979 00002000:00100000:0.0:1746144867.793057:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009398ea00 x1830965174325632/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/4536 e 0 to 0 dl 1746144878 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.793064:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ea00 with x1830965174325632 ext(0->4095) 00010000:00010000:0.0:1746144867.793068:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ab5c00/0x4076af67275125a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920ad expref: 19 pid: 8432 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.793076:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ab5c00/0x4076af67275125a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920ad expref: 19 pid: 8432 timeout: 561 lvb_type: 0 00002000:00010000:0.0:1746144867.793081:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009398ea00 00000100:00100000:0.0:1746144867.795296:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174325888 00000100:00100000:0.0:1746144867.795304:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174325888 00002000:00100000:0.0:1746144867.795332:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff8801362ae300 x1830965174325888/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 496/0 e 0 to 0 dl 1746144878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.795340:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801362ae300 with x1830965174325888 ext(0->7) 00010000:00010000:0.0:1746144867.795347:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ab5c00/0x4076af67275125a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920ad expref: 19 pid: 8432 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.795362:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ab5c00/0x4076af67275125a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920ad expref: 19 pid: 8432 timeout: 561 lvb_type: 0 00002000:00010000:0.0:1746144867.795372:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801362ae300 00000100:00100000:0.0:1746144867.795387:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 980 00000100:00100000:0.0:1746144867.795393:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1982:x1830965174325888:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144867.797237:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801362ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1982:x1830965174325888:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 Request processed in 1837us (2018us total) trans 4294968385 rc 0/0 00000100:00100000:0.0:1746144867.797245:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 980 00002000:00100000:0.0:1746144867.797254:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff8801362ae300 x1830965174325888/t4294968385(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 496/448 e 0 to 0 dl 1746144878 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.797261:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801362ae300 with x1830965174325888 ext(0->7) 00010000:00010000:0.0:1746144867.797267:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a4ab5c00/0x4076af67275125a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920ad expref: 21 pid: 8432 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.797278:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a4ab5c00/0x4076af67275125a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920ad expref: 21 pid: 8432 timeout: 561 lvb_type: 0 00002000:00010000:0.0:1746144867.797283:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801362ae300 00000100:00100000:0.0:1746144867.799527:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.807940:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.819059:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.819146:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.823505:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.828424:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.831244:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.838910:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.843374:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.845189:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.853051:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.853827:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174328192 00000100:00100000:0.0:1746144867.853833:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174328192 00002000:00100000:0.0:1746144867.853857:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800a417ed80 x1830965174328192/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/0 e 0 to 0 dl 1746144878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.853864:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417ed80 with x1830965174328192 ext(0->4095) 00010000:00010000:0.0:1746144867.853870:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2000/0x4076af67275125bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920c9 expref: 23 pid: 20722 timeout: 561 lvb_type: 0 00010000:00010000:0.0:1746144867.853879:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b2000/0x4076af67275125bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920c9 expref: 23 pid: 20722 timeout: 562 lvb_type: 0 00002000:00010000:0.0:1746144867.853884:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a417ed80 00000100:00100000:0.0:1746144867.853927:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 983 00000100:00100000:0.0:1746144867.853932:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1983:x1830965174328192:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144867.854055:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1983:x1830965174328192:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 123us (1010us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144867.854060:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 983 00002000:00100000:0.0:1746144867.854065:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800a417ed80 x1830965174328192/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/4536 e 0 to 0 dl 1746144878 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.854072:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417ed80 with x1830965174328192 ext(0->4095) 00010000:00010000:0.0:1746144867.854076:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2000/0x4076af67275125bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920c9 expref: 23 pid: 20722 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144867.854085:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b2000/0x4076af67275125bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920c9 expref: 23 pid: 20722 timeout: 562 lvb_type: 0 00002000:00010000:0.0:1746144867.854090:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a417ed80 00000100:00100000:0.0:1746144867.859455:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.864303:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.880306:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.883065:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.883100:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.887288:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.891288:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.891322:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.904337:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.908265:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.917271:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.925229:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.925649:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.925670:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174330624 00000100:00100000:0.0:1746144867.925675:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174330624 00000100:00100000:0.0:1746144867.925699:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3995 00000100:00100000:0.0:1746144867.925704:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+25:30931:x1830965174330624:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144867.925717:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144867.925728:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094377400/0x4076af67275125e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af920ec expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.925754:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091750400/0x4076af67275125d9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920e5 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.925760:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144867.925774:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144867.925778:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094377400/0x4076af67275125e0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920ec expref: 26 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.925801:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091750400/0x4076af67275125d9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920e5 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.925812:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091750400/0x4076af67275125d9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920e5 expref: 5 pid: 8432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1746144867.925821:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009181e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172067200:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144867.925866:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144867.929795:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009181e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172067200:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144867.929819:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094377400/0x4076af67275125e0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920ec expref: 26 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.929833:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377400, rc 0) 00000100:00100000:0.0:1746144867.929878:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+26:30931:x1830965174330624:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4173us (4229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144867.929885:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3995 00000100:00100000:0.0:1746144867.930625:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174330752 00000100:00100000:0.0:1746144867.930629:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174330752 00000100:00100000:0.0:1746144867.930645:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3996 00000100:00100000:0.0:1746144867.930649:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+26:30934:x1830965174330752:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144867.930659:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144867.930667:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af67275125e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af920f3 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.930681:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094377400/0x4076af67275125e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920ec expref: 27 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.930686:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144867.930687:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144867.930690:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af67275125e7 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920f3 expref: 27 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.930703:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094377400/0x4076af67275125e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920ec expref: 27 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144867.930712:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094377400/0x4076af67275125e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af920ec expref: 27 pid: 8432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1746144867.930720:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009181e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172067456:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144867.930753:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144867.934168:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.946978:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.952824:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174331776 00000100:00100000:0.0:1746144867.952829:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174331776 00002000:00100000:0.0:1746144867.952865:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093fa0000 x1830965174331776/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/0 e 0 to 0 dl 1746144878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.952874:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0000 with x1830965174331776 ext(0->4095) 00002000:00010000:0.0:1746144867.952877:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093fa0000 00000100:00100000:0.0:1746144867.952934:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3262 00000100:00100000:0.0:1746144867.952941:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1984:x1830965174331776:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144867.953456:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1984:x1830965174331776:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 514us (719us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144867.953462:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3262 00002000:00100000:0.0:1746144867.953468:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093fa0000 x1830965174331776/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/4536 e 0 to 0 dl 1746144878 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.953474:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0000 with x1830965174331776 ext(0->4095) 00002000:00010000:0.0:1746144867.953477:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093fa0000 00000100:00100000:0.0:1746144867.955676:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.955712:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.957432:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.960979:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.969408:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.985606:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.985729:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.985783:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174333184 00000100:00100000:0.0:1746144867.985790:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174333184 00002000:00100000:0.0:1746144867.985826:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009181fb80 x1830965174333184/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:508/0 lens 488/0 e 0 to 0 dl 1746144878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.985834:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181fb80 with x1830965174333184 ext(0->4095) 00002000:00010000:0.0:1746144867.985839:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009181fb80 00000100:00100000:0.0:1746144867.985861:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3263 00000100:00100000:0.0:1746144867.985866:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174333184:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144867.986008:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174333184:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 140us (278us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144867.986013:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3263 00002000:00100000:0.0:1746144867.986018:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009181fb80 x1830965174333184/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:508/0 lens 488/4536 e 0 to 0 dl 1746144878 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.986024:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181fb80 with x1830965174333184 ext(0->4095) 00002000:00010000:0.0:1746144867.986027:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009181fb80 00000100:00100000:0.0:1746144867.989363:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.990759:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.994473:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144867.994498:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174333696 00000100:00100000:0.0:1746144867.994503:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174333696 00002000:00100000:0.0:1746144867.994536:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009181f480 x1830965174333696/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/0 e 0 to 0 dl 1746144878 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.994545:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181f480 with x1830965174333696 ext(0->4095) 00010000:00010000:0.0:1746144867.994551:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091750400/0x4076af67275125fc lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92108 expref: 32 pid: 8432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144867.994562:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091750400/0x4076af67275125fc lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92108 expref: 32 pid: 8432 timeout: 562 lvb_type: 0 00002000:00010000:0.0:1746144867.994568:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009181f480 00000100:00100000:0.0:1746144867.994583:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 992 00000100:00100000:0.0:1746144867.994589:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1983:x1830965174333696:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144867.994743:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1983:x1830965174333696:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 153us (274us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144867.994750:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 992 00002000:00100000:0.0:1746144867.994754:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009181f480 x1830965174333696/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:508/0 lens 488/4536 e 0 to 0 dl 1746144878 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144867.994785:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181f480 with x1830965174333696 ext(0->4095) 00010000:00010000:0.0:1746144867.994790:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091750400/0x4076af67275125fc lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92108 expref: 32 pid: 8432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144867.994798:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091750400/0x4076af67275125fc lrc: 6/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92108 expref: 32 pid: 8432 timeout: 562 lvb_type: 0 00002000:00010000:0.0:1746144867.994803:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009181f480 00000100:00100000:0.0:1746144868.001293:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144868.002804:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144868.006149:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.011020:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172068608:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144868.011039:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144868.011086:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093255180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1985:x1830965174334080:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3931us (4943us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144868.011095:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9420 00000100:00100000:0.0:1746144868.014135:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.014199:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.014652:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4002 00000100:00100000:0.0:1746144868.014659:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+32:30931:x1830965174334592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144868.014666:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144868.014672:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094377600/0x4076af6727512611 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9211d expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.014685:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af6727512603 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9210f expref: 33 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.014692:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091750400/0x4076af672751260a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92116 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.014697:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144868.014698:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144868.014701:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094377600/0x4076af6727512611 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9211d expref: 33 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.014724:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091750400/0x4076af672751260a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92116 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.014734:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091750400/0x4076af672751260a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92116 expref: 5 pid: 8430 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1746144868.014744:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093256300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172068736:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144868.014820:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af6727512603 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9210f expref: 33 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.014828:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af6727512603 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9210f expref: 33 pid: 8432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1746144868.014840:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093256680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172068864:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144868.014858:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3c00 going to sleep for 11 seconds 00000100:00080000:0.0:1746144868.014872:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144868.017091:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.017348:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.017609:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174334976 00000100:00100000:0.0:1746144868.017613:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174334976 00010000:00010000:0.0:1746144868.017629:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af6727512603 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9210f expref: 33 pid: 8432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1746144868.017656:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9421 00000100:00100000:0.0:1746144868.017661:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1982:x1830965174334976:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144868.017669:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144868.017680:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af6727512603 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9210f expref: 33 pid: 8432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.017688:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af6727512603 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9210f expref: 33 pid: 8432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.017708:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af6727512603 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9210f expref: 33 pid: 8432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.017721:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144868.019709:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.024823:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.029020:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.036834:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.040419:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.043820:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.045415:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.048895:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.051005:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.056394:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.059546:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.064450:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.071988:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.075184:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.080275:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.080327:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.083974:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.084006:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.084031:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.084073:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174338176 00000100:00100000:0.0:1746144868.084079:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174338176 00010000:00010000:0.0:1746144868.084104:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad30e00/0x4076af672751262d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92139 expref: 6 pid: 10401 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1746144868.084125:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174337920 00000100:00100000:0.0:1746144868.084127:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174337920 00010000:00010000:0.0:1746144868.084135:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727512626 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92132 expref: 38 pid: 8432 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1746144868.084147:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9426 00000100:00100000:0.0:1746144868.084152:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174338176:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144868.084161:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144868.084187:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad30e00/0x4076af672751262d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92139 expref: 6 pid: 10401 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.084196:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad30e00/0x4076af672751262d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92139 expref: 6 pid: 10401 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.084214:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144868.084241:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087dbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174338176:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 89us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144868.084246:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9426 00000100:00100000:0.0:1746144868.084256:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9427 00000100:00100000:0.0:1746144868.084259:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087db9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1982:x1830965174337920:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144868.084265:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144868.084270:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727512626 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92132 expref: 38 pid: 8432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.084277:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727512626 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92132 expref: 38 pid: 8432 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.084285:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144868.084286:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144868.084291:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad30200/0x4076af6727512634 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92140 expref: 38 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.084298:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad30200/0x4076af6727512634 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92140 expref: 38 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.084326:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad30200/0x4076af6727512634 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92140 expref: 38 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144868.084337:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087db8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965172070144:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144868.084384:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144868.089843:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.094066:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.106951:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.111258:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.117036:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.117119:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.121617:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.123212:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.127197:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.130498:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.135057:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.139263:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.141655:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.146066:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.150739:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.150976:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.154094:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.164110:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.173735:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.173806:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.180648:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.180941:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.184260:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.189813:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.195816:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.199287:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174343296 00000100:00100000:0.0:1746144868.199292:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174343296 00002000:00100000:0.0:1746144868.199318:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009398d880 x1830965174343296/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:509/0 lens 488/0 e 0 to 0 dl 1746144879 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144868.199326:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398d880 with x1830965174343296 ext(0->4095) 00002000:00010000:0.0:1746144868.199330:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009398d880 00000100:00100000:0.0:1746144868.199513:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3271 00000100:00100000:0.0:1746144868.199519:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174343296:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144868.199654:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174343296:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 135us (566us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144868.199659:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3271 00002000:00100000:0.0:1746144868.199664:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009398d880 x1830965174343296/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:509/0 lens 488/4536 e 0 to 0 dl 1746144879 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144868.199670:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398d880 with x1830965174343296 ext(0->4095) 00002000:00010000:0.0:1746144868.199672:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009398d880 00000100:00100000:0.0:1746144868.201259:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.202844:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.205655:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.205732:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.207666:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.207723:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.208970:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174344448 00000100:00100000:0.0:1746144868.208973:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174344448 00000100:00100000:0.0:1746144868.208998:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4018 00000100:00100000:0.0:1746144868.209003:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+45:30934:x1830965174344448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144868.209013:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144868.209022:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727512681 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9218d expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.209036:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af672751267a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92186 expref: 46 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.209041:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144868.209042:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144868.209045:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727512681 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9218d expref: 46 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.209060:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af672751267a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92186 expref: 46 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.209069:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af672751267a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92186 expref: 46 pid: 20722 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1746144868.209077:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092586300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965172072576:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144868.209126:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144868.211257:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.213150:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.214785:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.217651:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.219865:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.222269:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.230964:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.233488:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.236681:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.236709:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.236744:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.243600:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.246386:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.256560:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.269075:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093fa3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965172073344:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144868.269089:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144868.269122:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+49:1985:x1830965174347136:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 8006us (12571us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144868.269131:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9441 00000100:00100000:0.0:1746144868.278671:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.287817:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.292125:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.300431:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.306513:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.310708:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.314378:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.319429:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.322816:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.326240:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.332003:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.334945:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.334988:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.341909:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.345488:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.347523:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.350829:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.352940:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+54:1984:x1830965174352000:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 1312us (2112us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144868.352950:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3278 00002000:00100000:0.0:1746144868.352958:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093440380 x1830965174352000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:509/0 lens 488/4536 e 0 to 0 dl 1746144879 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144868.352967:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093440380 with x1830965174352000 ext(0->4095) 00002000:00010000:0.0:1746144868.352970:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093440380 00000100:00100000:0.0:1746144868.360047:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.364183:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.368686:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.368721:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.368741:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174352768 00000100:00100000:0.0:1746144868.368747:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174352768 00002000:00100000:0.0:1746144868.368788:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800924d8000 x1830965174352768/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:509/0 lens 488/0 e 0 to 0 dl 1746144879 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144868.368796:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d8000 with x1830965174352768 ext(0->4095) 00002000:00010000:0.0:1746144868.368799:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d8000 00000100:00100000:0.0:1746144868.368812:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3280 00000100:00100000:0.0:1746144868.368818:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+54:1984:x1830965174352768:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144868.368928:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+54:1984:x1830965174352768:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 110us (206us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144868.368934:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3280 00002000:00100000:0.0:1746144868.368939:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800924d8000 x1830965174352768/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:509/0 lens 488/4536 e 0 to 0 dl 1746144879 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144868.368947:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d8000 with x1830965174352768 ext(0->4095) 00002000:00010000:0.0:1746144868.368949:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d8000 00000100:00100000:0.0:1746144868.371829:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.371867:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.373163:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.375956:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.379638:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.402621:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.416232:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.423087:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.423123:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.440894:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.443469:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.450854:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.453581:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.463502:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.476555:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.486652:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.490857:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.494859:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.494900:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.502894:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.502986:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174356736 00000100:00100000:0.0:1746144868.502993:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174356736 00002000:00100000:0.0:1746144868.503031:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880135ea6300 x1830965174356736/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:509/0 lens 488/0 e 0 to 0 dl 1746144879 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144868.503040:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea6300 with x1830965174356736 ext(0->4095) 00010000:00010000:0.0:1746144868.503049:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2200/0x4076af67275126f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92204 expref: 58 pid: 10401 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.503061:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b2200/0x4076af67275126f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92204 expref: 58 pid: 10401 timeout: 562 lvb_type: 0 00002000:00010000:0.0:1746144868.503067:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135ea6300 00000100:00100000:0.0:1746144868.503085:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1028 00000100:00100000:0.0:1746144868.503092:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965174356736:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144868.503269:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965174356736:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 177us (374us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144868.503275:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1028 00002000:00100000:0.0:1746144868.503281:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880135ea6300 x1830965174356736/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:509/0 lens 488/4536 e 0 to 0 dl 1746144879 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144868.503288:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea6300 with x1830965174356736 ext(0->4095) 00010000:00010000:0.0:1746144868.503292:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2200/0x4076af67275126f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92204 expref: 58 pid: 10401 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.503300:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b2200/0x4076af67275126f8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92204 expref: 58 pid: 10401 timeout: 562 lvb_type: 0 00002000:00010000:0.0:1746144868.503306:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135ea6300 00000100:00100000:0.0:1746144868.509161:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.524472:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.529233:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.533228:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.538262:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.540480:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.540535:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.544086:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.544128:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.544750:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.547833:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.552657:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.555035:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.560505:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.563668:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.567402:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.571590:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.574254:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.577500:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174360576 00000100:00100000:0.0:1746144868.577503:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174360576 00010000:00010000:0.0:1746144868.577519:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba7dc00/0x4076af6727512714 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92220 expref: 63 pid: 10401 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1746144868.577536:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9461 00000100:00100000:0.0:1746144868.577540:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1985:x1830965174360576:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144868.577548:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144868.577560:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ba7dc00/0x4076af6727512714 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92220 expref: 63 pid: 10401 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.577575:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ba7dc00/0x4076af6727512714 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92220 expref: 63 pid: 10401 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.577589:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7dc00/0x4076af6727512714 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92220 expref: 63 pid: 10401 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.577602:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144868.577603:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144868.577609:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727512722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9222e expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.577617:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727512722 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9222e expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.577635:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727512722 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9222e expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.577645:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727512722 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9222e expref: 62 pid: 20722 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1746144868.577656:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f70e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172077952:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144868.577706:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144868.580662:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.612660:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.617249:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.619334:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.626589:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.640991:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.656647:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.656695:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.663731:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.665087:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174362880 00000100:00100000:0.0:1746144868.665090:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174362880 00010000:00010000:0.0:1746144868.665102:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091751c00/0x4076af6727512729 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92235 expref: 6 pid: 20722 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1746144868.665113:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9464 00000100:00100000:0.0:1746144868.665116:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174362880:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144868.665121:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144868.665127:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091751c00/0x4076af6727512729 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92235 expref: 6 pid: 20722 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.665132:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091751c00/0x4076af6727512729 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92235 expref: 6 pid: 20722 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.665140:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091751c00/0x4076af6727512729 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92235 expref: 6 pid: 20722 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.665147:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144868.665148:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144868.665152:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ba7d400/0x4076af6727512737 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92243 expref: 66 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.665156:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ba7d400/0x4076af6727512737 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92243 expref: 66 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.665181:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ba7d400/0x4076af6727512737 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92243 expref: 66 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.665189:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ba7d400/0x4076af6727512737 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92243 expref: 66 pid: 20722 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1746144868.665197:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172078592:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144868.665235:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144868.668882:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.676417:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.678844:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.684671:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.686691:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.687929:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.701818:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.706623:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.706666:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.720362:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174364928 00000100:00100000:0.0:1746144868.720369:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174364928 00002000:00100000:0.0:1746144868.720399:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093fa0380 x1830965174364928/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:509/0 lens 488/0 e 0 to 0 dl 1746144879 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144868.720407:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0380 with x1830965174364928 ext(0->4095) 00010000:00010000:0.0:1746144868.720414:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af672751274c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92258 expref: 66 pid: 10401 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.720429:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af672751274c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92258 expref: 66 pid: 10401 timeout: 562 lvb_type: 0 00002000:00010000:0.0:1746144868.720435:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093fa0380 00000100:00100000:0.0:1746144868.760922:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.760967:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.766915:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.772901:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.783141:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.786719:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.791380:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.794261:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.798139:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.805043:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.808846:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.816840:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.817279:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.824486:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.824520:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.824554:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.827303:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.835716:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.848756:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174368512 00000100:00100000:0.0:1746144868.848780:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174368512 00010000:00010000:0.0:1746144868.848813:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad31a00/0x4076af672751276f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9227b expref: 73 pid: 10401 timeout: 562 lvb_type: 0 00000100:00100000:0.0:1746144868.848841:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9473 00000100:00100000:0.0:1746144868.848848:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+73:1982:x1830965174368512:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144868.848859:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144868.848876:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad31a00/0x4076af672751276f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9227b expref: 73 pid: 10401 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.848885:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad31a00/0x4076af672751276f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9227b expref: 73 pid: 10401 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.848905:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad31a00/0x4076af672751276f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9227b expref: 73 pid: 10401 timeout: 562 lvb_type: 0 00010000:00010000:0.0:1746144868.848930:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144868.848932:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144868.848938:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2a00/0x4076af6727512776 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92282 expref: 72 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.848945:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b2a00/0x4076af6727512776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92282 expref: 72 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.848973:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b2a00/0x4076af6727512776 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92282 expref: 72 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144868.848983:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bae1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172080512:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144868.851346:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.854904:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144868.854930:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bae1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172080512:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144868.854944:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144868.855933:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1982:x1830965174368512:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7083us (7333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144868.855941:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9473 00000100:00100000:0.0:1746144868.866619:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.897489:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.920932:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.920979:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.929322:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.938046:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.946586:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.957219:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.961866:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.963859:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.963919:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.966998:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.971928:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.972237:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.976617:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801362ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965172081664:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144868.976630:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092552600/0x4076af67275127a0 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af922ac expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144868.976645:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092552600, rc 0) 00000100:00100000:0.0:1746144868.976751:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965174371328:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4249us (4830us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144868.976760:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4059 00000100:00100000:0.0:1746144868.979583:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.984909:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.989929:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144868.997491:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.005910:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.014894:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.014942:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.024432:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.030069:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.043722:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.059926:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174373888 00000100:00100000:0.0:1746144869.059932:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174373888 00002000:00100000:0.0:1746144869.059959:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff88009398fb80 x1830965174373888/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:510/0 lens 496/0 e 0 to 0 dl 1746144880 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144869.059967:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398fb80 with x1830965174373888 ext(0->7) 00010000:00010000:0.0:1746144869.059972:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092552e00/0x4076af67275127ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af922ba expref: 76 pid: 20722 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1746144869.059983:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092552e00/0x4076af67275127ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af922ba expref: 76 pid: 20722 timeout: 563 lvb_type: 0 00002000:00010000:0.0:1746144869.059988:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009398fb80 00000100:00100000:0.0:1746144869.059999:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1051 00000100:00100000:0.0:1746144869.060003:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1985:x1830965174373888:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144869.060241:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1985:x1830965174373888:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 Request processed in 237us (624us total) trans 4294968414 rc 0/0 00000100:00100000:0.0:1746144869.060247:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1051 00002000:00100000:0.0:1746144869.060251:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff88009398fb80 x1830965174373888/t4294968414(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:510/0 lens 496/448 e 0 to 0 dl 1746144880 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144869.060258:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398fb80 with x1830965174373888 ext(0->7) 00010000:00010000:0.0:1746144869.060262:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092552e00/0x4076af67275127ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af922ba expref: 78 pid: 20722 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1746144869.060269:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092552e00/0x4076af67275127ae lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af922ba expref: 78 pid: 20722 timeout: 563 lvb_type: 0 00002000:00010000:0.0:1746144869.060274:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009398fb80 00000100:00100000:0.0:1746144869.064118:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.068984:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.074516:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.087836:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.087928:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.095096:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.097429:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.099081:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.104451:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.109917:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.112706:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.135576:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.143075:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.146105:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.149004:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.153950:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174376960 00000100:00100000:0.0:1746144869.153956:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174376960 00010000:00010000:0.0:1746144869.153985:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b2200/0x4076af67275127ca lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af922d6 expref: 82 pid: 10401 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1746144869.154021:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9486 00000100:00100000:0.0:1746144869.154027:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1984:x1830965174376960:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144869.154038:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144869.154056:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931b2200/0x4076af67275127ca lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af922d6 expref: 82 pid: 10401 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1746144869.154064:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931b2200/0x4076af67275127ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af922d6 expref: 82 pid: 10401 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1746144869.154085:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144869.154118:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1984:x1830965174376960:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 91us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144869.154123:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9486 00000100:00100000:0.0:1746144869.157201:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.161122:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.169405:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.189797:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.189833:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.197596:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.202928:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.206144:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.207991:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.212856:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.229757:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.245069:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.245118:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.250213:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.253366:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.257698:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.264534:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.266439:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.268667:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.275611:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.292902:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4074 00000100:00100000:0.0:1746144869.292908:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:30931:x1830965174380800:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144869.292914:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144869.292919:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727512809 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92315 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.292938:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2000/0x4076af67275127fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92307 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.292944:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af6727512802 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9230e expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.292952:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144869.292953:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144869.292955:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727512809 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92315 expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.293027:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af6727512802 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9230e expref: 88 pid: 20722 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1746144869.293035:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af6727512802 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9230e expref: 88 pid: 20722 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1746144869.293044:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012a2b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172084864:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144869.293314:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b2000/0x4076af67275127fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92307 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.293321:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931b2000/0x4076af67275127fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92307 expref: 5 pid: 20722 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1746144869.293329:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012a2b0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172084992:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144869.293544:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144869.295051:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.295333:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.298313:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.298385:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.301327:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.304652:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.307695:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.314361:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.318564:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.323237:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.331479:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.331563:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.331594:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174383104 00000100:00100000:0.0:1746144869.331602:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174383104 00000100:00100000:0.0:1746144869.331651:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4077 00000100:00100000:0.0:1746144869.331658:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:30931:x1830965174383104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144869.331673:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144869.331694:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094377400/0x4076af672751281e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9232a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.331718:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130df4200/0x4076af6727512810 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9231c expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.331726:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2a00/0x4076af6727512817 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92323 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.331731:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144869.331733:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144869.331735:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094377400/0x4076af672751281e lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9232a expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.331759:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b2a00/0x4076af6727512817 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92323 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.331787:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931b2a00/0x4076af6727512817 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92323 expref: 89 pid: 8432 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1746144869.331798:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e83480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172085504:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144869.333515:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130df4200/0x4076af6727512810 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9231c expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.333529:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130df4200/0x4076af6727512810 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9231c expref: 5 pid: 8430 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1746144869.333539:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e80700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172085632:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144869.334447:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144869.337596:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.342479:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.343019:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.346749:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.354213:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.357754:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.362059:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.372224:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.373919:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.375153:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.382110:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.382477:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.383848:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.389014:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.394007:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.402570:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.413215:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.419053:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.419216:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.421260:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.429228:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.435512:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.440575:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.442995:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.446878:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.450295:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.457404:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.457488:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.462562:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.467256:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.477288:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.484509:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.486141:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.491537:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.494968:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.498515:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.502817:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.509585:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.515545:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.527413:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.527464:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.534473:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.537965:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.543287:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.552593:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.572588:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.590501:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.599225:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.606806:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.608199:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.608741:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.614050:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.626905:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.629746:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.633562:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.647343:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.652579:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.663215:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.665256:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.670050:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.678845:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.681175:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.689784:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.699700:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.704838:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.705288:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174396032 00000100:00100000:0.0:1746144869.705292:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174396032 00002000:00100000:0.0:1746144869.705315:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093fa3480 x1830965174396032/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:510/0 lens 488/0 e 0 to 0 dl 1746144880 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144869.705324:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa3480 with x1830965174396032 ext(0->4095) 00010000:00010000:0.0:1746144869.705329:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af67275128aa lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923b6 expref: 6 pid: 8432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1746144869.705338:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af67275128aa lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923b6 expref: 6 pid: 8432 timeout: 563 lvb_type: 0 00002000:00010000:0.0:1746144869.705343:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093fa3480 00000100:00100000:0.0:1746144869.705356:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1086 00000100:00100000:0.0:1746144869.705362:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174396032:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144869.705493:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174396032:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 131us (567us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144869.705500:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1086 00002000:00100000:0.0:1746144869.705505:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093fa3480 x1830965174396032/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:510/0 lens 488/4536 e 0 to 0 dl 1746144880 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144869.705511:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa3480 with x1830965174396032 ext(0->4095) 00010000:00010000:0.0:1746144869.705516:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af67275128aa lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923b6 expref: 6 pid: 8432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1746144869.705524:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af67275128aa lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923b6 expref: 6 pid: 8432 timeout: 563 lvb_type: 0 00002000:00010000:0.0:1746144869.705528:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093fa3480 00000100:00100000:0.0:1746144869.708750:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.708841:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.713128:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.717342:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.730207:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.736470:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.747841:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.751057:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174397440 00000100:00100000:0.0:1746144869.751064:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174397440 00000100:00100000:0.0:1746144869.751176:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4101 00000100:00100000:0.0:1746144869.751186:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+106:30931:x1830965174397440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144869.751199:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144869.751213:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af67275128c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af923d2 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.751236:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af67275128b8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923c4 expref: 107 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.751244:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af67275128bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923cb expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.751249:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144869.751250:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144869.751253:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af67275128c6 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923d2 expref: 107 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.751277:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af67275128bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923cb expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.751288:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099500e00/0x4076af67275128bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923cb expref: 5 pid: 20722 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1746144869.751299:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965172090880:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144869.751364:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af67275128b8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923c4 expref: 107 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.751371:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af67275128b8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923c4 expref: 107 pid: 8430 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1746144869.751383:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965172091008:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144869.751404:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144869.751654:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174397696 00000100:00100000:0.0:1746144869.751658:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174397696 00000100:00100000:0.0:1746144869.759996:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.767744:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.786654:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.793841:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.794263:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.799906:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174399104 00000100:00100000:0.0:1746144869.799913:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174399104 00002000:00100000:0.0:1746144869.799947:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093fa2d80 x1830965174399104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:510/0 lens 488/0 e 0 to 0 dl 1746144880 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144869.799955:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa2d80 with x1830965174399104 ext(0->4095) 00010000:00010000:0.0:1746144869.799963:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af67275128cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923d9 expref: 109 pid: 8432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1746144869.799975:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af67275128cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923d9 expref: 109 pid: 8432 timeout: 563 lvb_type: 0 00002000:00010000:0.0:1746144869.799981:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093fa2d80 00000100:00100000:0.0:1746144869.800185:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1092 00000100:00100000:0.0:1746144869.800192:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+109:1985:x1830965174399104:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144869.800331:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+109:1985:x1830965174399104:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 139us (499us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144869.800339:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1092 00002000:00100000:0.0:1746144869.800344:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093fa2d80 x1830965174399104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:510/0 lens 488/4536 e 0 to 0 dl 1746144880 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144869.800350:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa2d80 with x1830965174399104 ext(0->4095) 00010000:00010000:0.0:1746144869.800354:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af67275128cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923d9 expref: 109 pid: 8432 timeout: 563 lvb_type: 0 00010000:00010000:0.0:1746144869.800362:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af67275128cd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923d9 expref: 109 pid: 8432 timeout: 563 lvb_type: 0 00002000:00010000:0.0:1746144869.800367:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093fa2d80 00000100:00100000:0.0:1746144869.806341:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.806753:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.810663:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801362ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965172091776:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144869.810679:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501a00, rc 0) 00000100:00100000:0.0:1746144869.811230:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965174399232:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4111us (4893us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144869.811237:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4104 00000100:00100000:0.0:1746144869.819915:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.837784:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.845805:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174400128 00000100:00100000:0.0:1746144869.845809:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174400128 00000100:00100000:0.0:1746144869.845830:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4105 00000100:00100000:0.0:1746144869.845834:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+109:30931:x1830965174400128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144869.845842:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144869.845854:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009419be00/0x4076af67275128e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af923ee expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.845873:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099501a00/0x4076af67275128db lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923e7 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.845880:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144869.845881:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144869.845884:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009419be00/0x4076af67275128e2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923ee expref: 110 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.845908:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099501a00/0x4076af67275128db lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923e7 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144869.845918:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099501a00/0x4076af67275128db lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923e7 expref: 5 pid: 20722 timeout: 563 lvb_type: 0 00000100:00100000:0.0:1746144869.845927:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087db8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965172092032:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144869.845965:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144869.851282:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.851506:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.857871:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174400896 00000100:00100000:0.0:1746144869.857877:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174400896 00002000:00100000:0.0:1746144869.857906:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093fa1880 x1830965174400896/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:510/0 lens 488/0 e 0 to 0 dl 1746144880 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144869.857915:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1880 with x1830965174400896 ext(0->4095) 00010000:00010000:0.0:1746144869.857921:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009419be00/0x4076af67275128e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923ee expref: 111 pid: 20722 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144869.857938:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009419be00/0x4076af67275128e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923ee expref: 111 pid: 20722 timeout: 564 lvb_type: 0 00002000:00010000:0.0:1746144869.857943:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093fa1880 00000100:00100000:0.0:1746144869.857967:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1095 00000100:00100000:0.0:1746144869.857974:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+111:1985:x1830965174400896:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144869.858098:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+111:1985:x1830965174400896:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 125us (461us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144869.858103:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1095 00002000:00100000:0.0:1746144869.858108:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093fa1880 x1830965174400896/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:510/0 lens 488/4536 e 0 to 0 dl 1746144880 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144869.858114:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1880 with x1830965174400896 ext(0->4095) 00010000:00010000:0.0:1746144869.858118:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009419be00/0x4076af67275128e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923ee expref: 111 pid: 20722 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144869.858127:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009419be00/0x4076af67275128e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af923ee expref: 111 pid: 20722 timeout: 564 lvb_type: 0 00002000:00010000:0.0:1746144869.858132:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093fa1880 00000100:00100000:0.0:1746144869.867395:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.870318:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.874580:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.884148:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.885817:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.901669:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.904687:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.906471:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.906505:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.909732:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.909801:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174402688 00000100:00100000:0.0:1746144869.909805:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174402688 00002000:00100000:0.0:1746144869.909829:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88013612ed80 x1830965174402688/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:510/0 lens 488/0 e 0 to 0 dl 1746144880 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144869.909838:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ed80 with x1830965174402688 ext(0->4095) 00010000:00010000:0.0:1746144869.909843:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af67275128f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92403 expref: 113 pid: 8430 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144869.909852:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af67275128f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92403 expref: 113 pid: 8430 timeout: 564 lvb_type: 0 00002000:00010000:0.0:1746144869.909858:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013612ed80 00000100:00100000:0.0:1746144869.910643:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1097 00000100:00100000:0.0:1746144869.910650:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+113:1984:x1830965174402688:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144869.910932:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+113:1984:x1830965174402688:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 281us (1199us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144869.910938:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1097 00002000:00100000:0.0:1746144869.910943:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88013612ed80 x1830965174402688/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:510/0 lens 488/4536 e 0 to 0 dl 1746144880 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144869.910949:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ed80 with x1830965174402688 ext(0->4095) 00010000:00010000:0.0:1746144869.910954:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af67275128f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92403 expref: 113 pid: 8430 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144869.910962:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af67275128f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92403 expref: 113 pid: 8430 timeout: 564 lvb_type: 0 00002000:00010000:0.0:1746144869.910967:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013612ed80 00000100:00100000:0.0:1746144869.919240:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.933298:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.936580:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.943732:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.945938:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.950209:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.952076:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.957356:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.957580:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.961513:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.989988:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.997095:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144869.999614:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.002647:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144870.004300:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144870.010672:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144870.015791:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144870.018247:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.025102:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.028793:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.031246:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.032950:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.038696:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.042039:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.045803:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.052693:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.060391:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.068172:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.068426:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.076878:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.076966:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.079147:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.079173:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174408704 00000100:00100000:0.0:1746144870.079177:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174408704 00010000:00010000:0.0:1746144870.079191:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b3400/0x4076af6727512936 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92442 expref: 6 pid: 20722 timeout: 564 lvb_type: 0 00000100:00100000:0.0:1746144870.079310:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9538 00000100:00100000:0.0:1746144870.079317:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174408704:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144870.079324:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144870.079336:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931b3400/0x4076af6727512936 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92442 expref: 6 pid: 20722 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.079345:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931b3400/0x4076af6727512936 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92442 expref: 6 pid: 20722 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.079356:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3400/0x4076af6727512936 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92442 expref: 6 pid: 20722 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.079367:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144870.079369:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144870.079373:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af672751293d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92449 expref: 120 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.079380:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af672751293d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92449 expref: 120 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.079394:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af672751293d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92449 expref: 120 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.079402:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af672751293d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92449 expref: 120 pid: 20722 timeout: 564 lvb_type: 0 00000100:00100000:0.0:1746144870.079410:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172095232:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144870.079450:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144870.085563:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.088226:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.091245:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.093485:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.097099:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.113090:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174410240 00000100:00100000:0.0:1746144870.113098:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174410240 00002000:00100000:0.0:1746144870.113136:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8801362ad880 x1830965174410240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:511/0 lens 488/0 e 0 to 0 dl 1746144881 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144870.113144:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801362ad880 with x1830965174410240 ext(0->4095) 00002000:00010000:0.0:1746144870.113149:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801362ad880 00000100:00100000:0.0:1746144870.113185:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3331 00000100:00100000:0.0:1746144870.113192:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+122:1983:x1830965174410240:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144870.113355:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801362ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+122:1983:x1830965174410240:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 163us (366us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144870.113361:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3331 00002000:00100000:0.0:1746144870.113366:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8801362ad880 x1830965174410240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:511/0 lens 488/4536 e 0 to 0 dl 1746144881 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144870.113372:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801362ad880 with x1830965174410240 ext(0->4095) 00002000:00010000:0.0:1746144870.113375:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801362ad880 00000100:00100000:0.0:1746144870.118446:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.118500:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.124255:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.124290:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.124326:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.135863:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.151210:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.156604:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.161274:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.164194:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.168649:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.172245:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.172506:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.177903:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.181208:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.187300:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.194075:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.198836:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.213236:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.213286:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.218748:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.228994:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.240192:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174414592 00000100:00100000:0.0:1746144870.240201:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174414592 00002000:00100000:0.0:1746144870.240234:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff8801362ace00 x1830965174414592/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:511/0 lens 496/0 e 0 to 0 dl 1746144881 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144870.240243:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801362ace00 with x1830965174414592 ext(0->7) 00010000:00010000:0.0:1746144870.240250:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099500200/0x4076af6727512975 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92481 expref: 127 pid: 20722 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.240263:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099500200/0x4076af6727512975 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92481 expref: 127 pid: 20722 timeout: 564 lvb_type: 0 00002000:00010000:0.0:1746144870.240268:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801362ace00 00000100:00100000:0.0:1746144870.240398:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1114 00000100:00100000:0.0:1746144870.240405:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+127:1984:x1830965174414592:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144870.241362:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801362ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+129:1984:x1830965174414592:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 Request processed in 955us (1249us total) trans 4294968439 rc 0/0 00000100:00100000:0.0:1746144870.241369:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1114 00002000:00100000:0.0:1746144870.241375:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff8801362ace00 x1830965174414592/t4294968439(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:511/0 lens 496/448 e 0 to 0 dl 1746144881 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144870.241383:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801362ace00 with x1830965174414592 ext(0->7) 00010000:00010000:0.0:1746144870.241388:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099500200/0x4076af6727512975 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92481 expref: 129 pid: 20722 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.241402:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099500200/0x4076af6727512975 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92481 expref: 129 pid: 20722 timeout: 564 lvb_type: 0 00002000:00010000:0.0:1746144870.241407:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801362ace00 00000100:00100000:0.0:1746144870.247420:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.253235:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174414976 00000100:00100000:0.0:1746144870.253242:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174414976 00002000:00100000:0.0:1746144870.253273:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800918ec000 x1830965174414976/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:511/0 lens 488/0 e 0 to 0 dl 1746144881 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144870.253281:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec000 with x1830965174414976 ext(0->4095) 00002000:00010000:0.0:1746144870.253285:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918ec000 00000100:00100000:0.0:1746144870.253310:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3336 00000100:00100000:0.0:1746144870.253316:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+128:1985:x1830965174414976:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144870.253437:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+128:1985:x1830965174414976:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 120us (561us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144870.253442:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3336 00002000:00100000:0.0:1746144870.253446:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800918ec000 x1830965174414976/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:511/0 lens 488/4536 e 0 to 0 dl 1746144881 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144870.253452:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec000 with x1830965174414976 ext(0->4095) 00002000:00010000:0.0:1746144870.253454:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918ec000 00000100:00100000:0.0:1746144870.255276:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.263705:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.263824:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.267968:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.268438:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.269440:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.272587:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.275209:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.279592:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.288741:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.290170:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.292198:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.293402:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.295923:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.296815:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.300273:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.303480:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.308596:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.324113:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.324513:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.328405:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.333702:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.335982:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.340518:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.345019:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.348705:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.359374:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.359473:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.363040:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.363092:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918ed880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172099072:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144870.363100:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918edf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172099200:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144870.363119:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf22000/0x4076af67275129c2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af924ce expref: 136 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.363136:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf22000, rc 0) 00000100:00100000:0.0:1746144870.363171:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+136:30931:x1830965174420608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2298us (3697us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144870.363177:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4137 00000100:00100000:0.0:1746144870.364561:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.365079:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.367290:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.378272:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.379933:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.383417:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965172099584:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144870.383431:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144870.383470:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+136:1983:x1830965174421632:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3429us (3538us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144870.383479:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9558 00000100:00100000:0.0:1746144870.385832:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.387370:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.395682:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.396304:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.400891:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.402414:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.404457:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174423040 00000100:00100000:0.0:1746144870.404462:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174423040 00010000:00010000:0.0:1746144870.404482:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af67275129c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af924d5 expref: 137 pid: 20722 timeout: 564 lvb_type: 0 00000100:00100000:0.0:1746144870.404512:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9560 00000100:00100000:0.0:1746144870.404517:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+137:1984:x1830965174423040:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144870.404526:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144870.404542:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af67275129c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af924d5 expref: 137 pid: 20722 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.404550:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af67275129c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af924d5 expref: 137 pid: 20722 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.404566:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af67275129c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af924d5 expref: 137 pid: 20722 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.404579:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144870.404580:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144870.404586:0:7099:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099500200/0x4076af67275129d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af924e3 expref: 136 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.404593:0:7099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099500200/0x4076af67275129d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af924e3 expref: 136 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.404613:0:7099:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099500200/0x4076af67275129d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af924e3 expref: 136 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.404622:0:7099:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099500200/0x4076af67275129d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af924e3 expref: 136 pid: 20722 timeout: 564 lvb_type: 0 00000100:00100000:0.0:1746144870.404636:0:7099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb49880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965172100096:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144870.404700:0:7099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144870.407588:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.426090:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.426176:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.432691:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.436983:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.439134:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.453833:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.456122:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.461929:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.462892:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.468437:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.471418:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.474501:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.476086:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801362ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2566f13b-362a-4e88-b0dd-c558bbe87895:3306:1830965172101120:0@lo:400:kworker.0 00000100:00100000:0.0:1746144870.476123:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144870.476149:0:3306:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746144870.476164:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801362ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1830965172101248:0@lo:400:kworker.0 00000100:00100000:0.0:1746144870.476183:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144870.476727:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1830965172101632:0@lo:400:kworker.0 00000100:00100000:0.0:1746144870.476747:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144870.476784:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801362ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1830965172101248:0@lo:400:kworker.0 00000100:00100000:0.0:1746144870.476794:0:3306:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746144870.476799:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965172101760:0@lo:400:kworker.0 00000100:00100000:0.0:1746144870.476815:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144870.477270:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093fa1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1830965172101632:0@lo:400:kworker.0 00000100:00100000:0.0:1746144870.477277:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801362ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2566f13b-362a-4e88-b0dd-c558bbe87895:3306:1830965172101120:0@lo:400:kworker.0 00000100:00080000:0.0:1746144870.477291:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746144870.477825:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144870.477840:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b4f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965172101760:0@lo:400:kworker.0 00000100:00080000:0.0:1746144870.478746:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144870.480283:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.483734:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.488572:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.493420:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.496387:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.501810:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.508365:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.512703:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.516868:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.523287:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.527666:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.527716:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.531403:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.533802:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.536205:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.538969:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.543522:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:0.0:1746144870.544536:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144870.547795:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.549350:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.551135:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.551184:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.555847:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.556241:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.556595:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.556603:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174429952 00000100:00100000:0.0:1746144870.556606:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174429952 00010000:00010000:0.0:1746144870.556617:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727512a1d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92529 expref: 148 pid: 20722 timeout: 564 lvb_type: 0 00000100:00100000:0.0:1746144870.556630:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9571 00000100:00100000:0.0:1746144870.556634:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+148:1985:x1830965174429952:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144870.556640:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144870.556647:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727512a1d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92529 expref: 148 pid: 20722 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.556655:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727512a1d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92529 expref: 148 pid: 20722 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.556667:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144870.556669:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144870.556675:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af6727512a24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92530 expref: 148 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.556682:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af6727512a24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92530 expref: 148 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.556708:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800931b2e00/0x4076af6727512a24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92530 expref: 148 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144870.556718:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b463480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965172103552:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144870.556785:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144870.560973:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.563021:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.565065:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.567101:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.568906:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.571272:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.581208:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.582585:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.586509:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.587341:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.587660:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.592391:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.599027:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.603185:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.612981:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.621132:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.621244:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.623513:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.627214:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.629170:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.632592:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.635093:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.637138:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174434304 00000100:00100000:0.0:1746144870.637143:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174434304 00000100:00100000:0.0:1746144870.637190:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4158 00000100:00100000:0.0:1746144870.637196:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+151:30934:x1830965174434304:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144870.637237:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144870.637252:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727512a55 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92561 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.637270:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144870.637271:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144870.637281:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727512a55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92561 expref: 152 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.637294:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727512a55 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92561 expref: 152 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.637302:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091751e00, rc 0) 00000100:00100000:0.0:1746144870.637341:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+152:30934:x1830965174434304:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 145us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144870.637346:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4158 00000100:00100000:0.0:1746144870.638416:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.645445:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.648048:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174435072 00000100:00100000:0.0:1746144870.648052:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174435072 00002000:00100000:0.0:1746144870.648077:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009b4f9500 x1830965174435072/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:511/0 lens 488/0 e 0 to 0 dl 1746144881 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144870.648084:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4f9500 with x1830965174435072 ext(0->4095) 00002000:00010000:0.0:1746144870.648088:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b4f9500 00000100:00100000:0.0:1746144870.648160:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3358 00000100:00100000:0.0:1746144870.648167:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174435072:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144870.648267:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174435072:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 100us (516us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144870.648272:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3358 00002000:00100000:0.0:1746144870.648277:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009b4f9500 x1830965174435072/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:511/0 lens 488/4536 e 0 to 0 dl 1746144881 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144870.648283:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4f9500 with x1830965174435072 ext(0->4095) 00010000:00010000:0.0:1746144870.648288:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727512a4e lrc: 6/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9255a expref: 6 pid: 20722 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.648297:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727512a4e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9255a expref: 6 pid: 20722 timeout: 564 lvb_type: 0 00002000:00010000:0.0:1746144870.648302:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009b4f9500 00000100:00100000:0.0:1746144870.650055:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.650091:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.651062:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.653355:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174435840 00000100:00100000:0.0:1746144870.653360:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174435840 00002000:00100000:0.0:1746144870.653388:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009398f100 x1830965174435840/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:511/0 lens 488/0 e 0 to 0 dl 1746144881 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144870.653397:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398f100 with x1830965174435840 ext(0->4095) 00010000:00010000:0.0:1746144870.653408:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800925b7c00/0x4076af6727512a5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92568 expref: 152 pid: 8430 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.653419:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800925b7c00/0x4076af6727512a5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92568 expref: 152 pid: 8430 timeout: 564 lvb_type: 0 00002000:00010000:0.0:1746144870.653425:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009398f100 00000100:00100000:0.0:1746144870.653439:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1142 00000100:00100000:0.0:1746144870.653444:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+152:1984:x1830965174435840:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144870.653841:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+152:1984:x1830965174435840:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 396us (619us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144870.653847:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1142 00002000:00100000:0.0:1746144870.653852:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009398f100 x1830965174435840/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:511/0 lens 488/4536 e 0 to 0 dl 1746144881 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144870.653859:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398f100 with x1830965174435840 ext(0->4095) 00010000:00010000:0.0:1746144870.653864:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800925b7c00/0x4076af6727512a5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92568 expref: 152 pid: 8430 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.653872:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800925b7c00/0x4076af6727512a5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92568 expref: 152 pid: 8430 timeout: 564 lvb_type: 0 00002000:00010000:0.0:1746144870.653877:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009398f100 00000100:00100000:0.0:1746144870.656788:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174436096 00000100:00100000:0.0:1746144870.656795:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174436096 00002000:00100000:0.0:1746144870.656824:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff8801391d3800 x1830965174436096/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:511/0 lens 496/0 e 0 to 0 dl 1746144881 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144870.656834:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d3800 with x1830965174436096 ext(0->7) 00010000:00010000:0.0:1746144870.656841:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800925b7c00/0x4076af6727512a5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92568 expref: 152 pid: 8430 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.656853:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800925b7c00/0x4076af6727512a5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92568 expref: 152 pid: 8430 timeout: 564 lvb_type: 0 00002000:00010000:0.0:1746144870.656859:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801391d3800 00000100:00100000:0.0:1746144870.656883:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1143 00000100:00100000:0.0:1746144870.656890:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+152:1982:x1830965174436096:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144870.657335:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+154:1982:x1830965174436096:12345-192.168.202.16@tcp:4:rw_seq_cst_vs_d.0 Request processed in 444us (626us total) trans 4294968452 rc 0/0 00000100:00100000:0.0:1746144870.657341:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1143 00002000:00100000:0.0:1746144870.657347:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->7) req@ffff8801391d3800 x1830965174436096/t4294968452(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:511/0 lens 496/448 e 0 to 0 dl 1746144881 ref 1 fl Complete:H/200/0 rc 0/0 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144870.657354:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d3800 with x1830965174436096 ext(0->7) 00010000:00010000:0.0:1746144870.657358:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800925b7c00/0x4076af6727512a5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92568 expref: 154 pid: 8430 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.657368:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800925b7c00/0x4076af6727512a5c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92568 expref: 154 pid: 8430 timeout: 564 lvb_type: 0 00002000:00010000:0.0:1746144870.657374:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8801391d3800 00000100:00100000:0.0:1746144870.660979:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.673955:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.678060:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.678115:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.696309:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.700239:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.705789:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.707581:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.708913:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.711165:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.712733:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.719706:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.723275:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.726088:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.729263:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.735059:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.737226:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.741216:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.741268:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.744159:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.744191:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.744226:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.744238:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174440576 00000100:00100000:0.0:1746144870.744241:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174440576 00010000:00010000:0.0:1746144870.744250:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b3200/0x4076af6727512a86 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92592 expref: 6 pid: 8430 timeout: 564 lvb_type: 0 00000100:00100000:0.0:1746144870.744261:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9586 00000100:00100000:0.0:1746144870.744266:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5139c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+160:1984:x1830965174440320:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144870.744276:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144870.744291:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931b2a00/0x4076af6727512a8d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92599 expref: 160 pid: 8430 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.744306:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931b2a00/0x4076af6727512a8d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92599 expref: 160 pid: 8430 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.744323:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144870.744349:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5139c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+160:1984:x1830965174440320:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144870.744355:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9586 00000100:00100000:0.0:1746144870.747378:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.752814:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.758609:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.764873:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.767173:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.769713:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.770582:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.773231:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.773545:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.773567:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.773584:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174442112 00000100:00100000:0.0:1746144870.773588:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174442112 00010000:00010000:0.0:1746144870.773607:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af6727512aa2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925ae expref: 6 pid: 8430 timeout: 564 lvb_type: 0 00000100:00100000:0.0:1746144870.773622:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174442368 00000100:00100000:0.0:1746144870.773624:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174442368 00010000:00010000:0.0:1746144870.773631:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b2000/0x4076af6727512a9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925a7 expref: 161 pid: 8430 timeout: 564 lvb_type: 0 00000100:00100000:0.0:1746144870.773653:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9589 00000100:00100000:0.0:1746144870.773658:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174442112:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144870.773672:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144870.773690:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af6727512aa2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925ae expref: 6 pid: 8430 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.773698:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af6727512aa2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925ae expref: 6 pid: 8430 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.773715:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931b3c00/0x4076af6727512aa2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925ae expref: 6 pid: 8430 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.773728:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144870.773745:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965174442112:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 87us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144870.773751:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9589 00000100:00100000:0.0:1746144870.779028:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174442624 00000100:00100000:0.0:1746144870.779035:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174442624 00002000:00100000:0.0:1746144870.779071:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800a417c380 x1830965174442624/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:511/0 lens 488/0 e 0 to 0 dl 1746144881 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144870.779079:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417c380 with x1830965174442624 ext(0->4095) 00010000:00010000:0.0:1746144870.779085:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800925b6000/0x4076af6727512aa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925b5 expref: 162 pid: 10401 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.779095:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800925b6000/0x4076af6727512aa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925b5 expref: 162 pid: 10401 timeout: 564 lvb_type: 0 00002000:00010000:0.0:1746144870.779102:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a417c380 00000100:00100000:0.0:1746144870.779119:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1150 00000100:00100000:0.0:1746144870.779125:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+161:1984:x1830965174442624:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144870.779287:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+161:1984:x1830965174442624:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 161us (380us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144870.779293:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1150 00002000:00100000:0.0:1746144870.779298:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800a417c380 x1830965174442624/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:511/0 lens 488/4536 e 0 to 0 dl 1746144881 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144870.779305:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417c380 with x1830965174442624 ext(0->4095) 00010000:00010000:0.0:1746144870.779310:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800925b6000/0x4076af6727512aa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925b5 expref: 161 pid: 10401 timeout: 564 lvb_type: 0 00010000:00010000:0.0:1746144870.779318:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800925b6000/0x4076af6727512aa9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925b5 expref: 161 pid: 10401 timeout: 564 lvb_type: 0 00002000:00010000:0.0:1746144870.779324:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a417c380 00000100:00100000:0.0:1746144870.787211:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.790524:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.794425:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.799286:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.803969:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.806830:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.810657:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.816498:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.827731:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.829309:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.833310:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.833360:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.836374:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801391d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172108928:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144870.836389:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800925b7e00/0x4076af6727512acc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925d8 expref: 165 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.836400:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925b7e00, rc 0) 00000100:00100000:0.0:1746144870.836419:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+165:30934:x1830965174444928:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2661us (3115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144870.836424:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4175 00000100:00100000:0.0:1746144870.852337:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.857843:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174445568 00000100:00100000:0.0:1746144870.857851:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174445568 00000100:00100000:0.0:1746144870.857887:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4176 00000100:00100000:0.0:1746144870.857893:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+167:30931:x1830965174445568:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144870.857905:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144870.857917:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727512ad3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af925df expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.857937:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144870.857941:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800925b7e00/0x4076af6727512acc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925d8 expref: 168 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.857946:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746144870.857949:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727512ad3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925df expref: 168 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.857974:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800925b7e00/0x4076af6727512acc lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925d8 expref: 168 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.857983:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727512ad3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925df expref: 168 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.857990:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091751200, rc 0) 00000100:00100000:0.0:1746144870.858018:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+168:30931:x1830965174445568:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 126us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144870.858023:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4176 00000100:00100000:0.0:1746144870.858484:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174445696 00000100:00100000:0.0:1746144870.858488:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174445696 00010000:00010000:0.0:1746144870.858501:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800925b7200/0x4076af6727512ac5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925d1 expref: 168 pid: 10401 timeout: 565 lvb_type: 0 00000100:00100000:0.0:1746144870.858525:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9595 00000100:00100000:0.0:1746144870.858530:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+168:1985:x1830965174445696:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144870.858536:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144870.858552:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800925b7200/0x4076af6727512ac5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925d1 expref: 168 pid: 10401 timeout: 565 lvb_type: 0 00010000:00010000:0.0:1746144870.858560:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800925b7200/0x4076af6727512ac5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925d1 expref: 168 pid: 10401 timeout: 565 lvb_type: 0 00010000:00010000:0.0:1746144870.858575:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800925b7200/0x4076af6727512ac5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925d1 expref: 168 pid: 10401 timeout: 565 lvb_type: 0 00010000:00010000:0.0:1746144870.858596:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144870.858597:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144870.858602:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800925b7e00/0x4076af6727512acc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925d8 expref: 167 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.858608:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800925b7e00/0x4076af6727512acc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925d8 expref: 167 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.858622:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800925b7e00/0x4076af6727512acc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925d8 expref: 167 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144870.858631:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800925b7e00/0x4076af6727512acc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af925d8 expref: 167 pid: 10401 timeout: 565 lvb_type: 0 00000100:00100000:0.0:1746144870.858640:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087c5fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172109184:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144870.858691:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144870.861330:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.864143:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.864226:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.867732:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.872316:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.878198:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.882341:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.886662:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.889380:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.901563:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.909457:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.909509:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.913594:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.914629:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.916616:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.919522:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.928286:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.943341:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.946306:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.949591:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.956048:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.961429:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.974035:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.976757:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.978417:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.980466:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.982548:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.984101:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.995197:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144870.999368:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.002312:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.005981:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.009425:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.014199:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.017267:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.037189:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.037239:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.040040:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.044010:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.047847:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.055493:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.059027:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.065667:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.067953:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.070091:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.071801:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.073701:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.079833:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.088239:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.106184:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.112925:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.114391:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.119919:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.123318:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.129409:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.131454:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.137348:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.138605:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9611 00000100:00100000:0.0:1746144871.138614:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+180:1982:x1830965174455808:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144871.138625:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144871.138642:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094377600/0x4076af6727512b35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92641 expref: 180 pid: 20722 timeout: 565 lvb_type: 0 00010000:00010000:0.0:1746144871.138652:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094377600/0x4076af6727512b35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92641 expref: 180 pid: 20722 timeout: 565 lvb_type: 0 00010000:00010000:0.0:1746144871.138674:0:7099:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094377600/0x4076af6727512b35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92641 expref: 180 pid: 20722 timeout: 565 lvb_type: 0 00010000:00010000:0.0:1746144871.138699:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144871.138701:0:7099:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144871.138707:0:7099:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af6727512b3c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92648 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144871.138713:0:7099:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af6727512b3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92648 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144871.138739:0:7099:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af6727512b3c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92648 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144871.138749:0:7099:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915a9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965172112896:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144871.138826:0:7099:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144871.140568:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.144422:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.147736:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.149854:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.149923:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.152913:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.152943:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.152971:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.155880:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.158734:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.163124:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.166803:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.169115:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.175028:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.175464:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.180853:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.180926:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.183023:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.187622:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.191784:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.199450:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.205794:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174459648 00000100:00100000:0.0:1746144871.205802:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174459648 00000100:00100000:0.0:1746144871.205841:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4198 00000100:00100000:0.0:1746144871.205848:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+184:30931:x1830965174459648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144871.205862:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144871.205875:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091751a00/0x4076af6727512b6d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92679 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144871.205899:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094377a00/0x4076af6727512b66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92672 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144871.205905:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144871.205907:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144871.205910:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091751a00/0x4076af6727512b6d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92679 expref: 185 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144871.205931:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094377a00/0x4076af6727512b66 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92672 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144871.205941:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094377a00/0x4076af6727512b66 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92672 expref: 5 pid: 20722 timeout: 565 lvb_type: 0 00000100:00100000:0.0:1746144871.205951:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965172114304:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144871.206026:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144871.212477:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.217441:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.221938:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.231561:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.240596:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.243391:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.248424:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.254589:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.258308:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.260516:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.263236:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.277728:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.282710:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.286045:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.293185:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.298210:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.298302:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.308589:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.314659:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.320987:0:7099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918edf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965172115712:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144871.321003:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144871.321035:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+189:1982:x1830965174463232:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6201us (6383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144871.321043:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9623 00000100:00100000:0.0:1746144871.326450:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.330566:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.342530:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.342579:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.348906:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.351486:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.351789:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.356693:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.362864:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.374743:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.385705:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.386967:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.393850:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.400664:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.407373:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.409743:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.415852:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.424107:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.426417:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.433499:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.440896:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.440944:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.451951:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174468224 00000100:00100000:0.0:1746144871.451957:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174468224 00010000:00010000:0.0:1746144871.451981:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800925b7e00/0x4076af6727512bb3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af926bf expref: 6 pid: 20722 timeout: 565 lvb_type: 0 00000100:00100000:0.0:1746144871.455483:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.461517:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.463920:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.466854:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.475286:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.478315:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.481190:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.484193:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.489742:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.493639:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.495690:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.498926:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.500696:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.503004:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.505683:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.508212:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.510969:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.511025:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.514057:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.514071:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.514095:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.516621:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.519371:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.522689:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.525871:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.530299:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174472960 00000100:00100000:0.0:1746144871.530307:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174472960 00000100:00100000:0.0:1746144871.530349:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4218 00000100:00100000:0.0:1746144871.530355:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965174472960:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144871.530369:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144871.530382:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091751a00/0x4076af6727512bf9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92705 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144871.530402:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144871.530403:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144871.530409:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091751a00/0x4076af6727512bf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92705 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144871.530420:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091751a00/0x4076af6727512bf9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92705 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144871.530428:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091751a00, rc 0) 00000100:00100000:0.0:1746144871.530461:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965174472960:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 105us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144871.530466:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4218 00000100:00100000:0.0:1746144871.534049:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.538097:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.544849:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.548721:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.548748:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.548800:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.551891:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.553113:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174474240 00000100:00100000:0.0:1746144871.553120:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174474240 00002000:00100000:0.0:1746144871.553371:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880093257b80 x1830965174474240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:512/0 lens 488/0 e 0 to 0 dl 1746144882 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144871.553379:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257b80 with x1830965174474240 ext(0->4095) 00010000:00010000:0.0:1746144871.553384:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800925b6000/0x4076af6727512c00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9270c expref: 201 pid: 8430 timeout: 565 lvb_type: 0 00010000:00010000:0.0:1746144871.553395:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800925b6000/0x4076af6727512c00 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9270c expref: 201 pid: 8430 timeout: 565 lvb_type: 0 00002000:00010000:0.0:1746144871.553400:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880093257b80 00000100:00100000:0.0:1746144871.553695:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1198 00000100:00100000:0.0:1746144871.553702:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+201:1984:x1830965174474240:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144871.557351:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.560843:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.575597:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.578057:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.581430:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174475392 00000100:00100000:0.0:1746144871.581437:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174475392 00002000:00100000:0.0:1746144871.581477:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009398df80 x1830965174475392/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:512/0 lens 488/0 e 0 to 0 dl 1746144882 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144871.581485:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398df80 with x1830965174475392 ext(0->4095) 00010000:00010000:0.0:1746144871.581490:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800925b7600/0x4076af6727512c0e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9271a expref: 6 pid: 8430 timeout: 565 lvb_type: 0 00010000:00010000:0.0:1746144871.581500:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800925b7600/0x4076af6727512c0e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9271a expref: 6 pid: 8430 timeout: 565 lvb_type: 0 00002000:00010000:0.0:1746144871.581505:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009398df80 00000100:00100000:0.0:1746144871.581531:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1200 00000100:00100000:0.0:1746144871.581538:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174475392:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144871.584816:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.586252:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.589738:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.593878:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.600614:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.603791:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.607485:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.610334:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.618437:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.627923:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.630801:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.630824:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.631800:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.639610:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.644797:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.649316:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.661082:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.661109:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.664930:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.665812:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.669971:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.675238:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.679378:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.684664:0:7099:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800918eea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7099:1830965172121344:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144871.684680:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144871.684728:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+207:1984:x1830965174480256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5190us (5353us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144871.684737:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9649 00000100:00100000:0.0:1746144871.685692:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174480512 00000100:00100000:0.0:1746144871.685698:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174480512 00002000:00100000:0.0:1746144871.685726:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800918eea00 x1830965174480512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:512/0 lens 488/0 e 0 to 0 dl 1746144882 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144871.685734:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eea00 with x1830965174480512 ext(0->4095) 00002000:00010000:0.0:1746144871.685738:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918eea00 00000100:00100000:0.0:1746144871.685774:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3402 00000100:00100000:0.0:1746144871.685781:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174480512:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144871.685907:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174480512:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 126us (317us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144871.685913:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3402 00002000:00100000:0.0:1746144871.685918:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800918eea00 x1830965174480512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:512/0 lens 488/4536 e 0 to 0 dl 1746144882 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144871.685925:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eea00 with x1830965174480512 ext(0->4095) 00002000:00010000:0.0:1746144871.685927:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918eea00 00000100:00100000:0.0:1746144871.693558:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.696868:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.699914:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.702987:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.705918:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.708878:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.712941:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.717505:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.719695:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.720266:0:7099:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174482688 00000100:00100000:0.0:1746144871.720270:0:7099:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174482688 00010000:00010000:0.0:1746144871.720285:0:7099:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099501800/0x4076af6727512c5b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92767 expref: 6 pid: 8430 timeout: 565 lvb_type: 0 00000100:00100000:0.0:1746144871.720301:0:7099:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9652 00000100:00100000:0.0:1746144871.720306:0:7099:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174482688:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144871.720314:0:7099:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144871.720324:0:7099:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099501800/0x4076af6727512c5b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92767 expref: 6 pid: 8430 timeout: 565 lvb_type: 0 00010000:00010000:0.0:1746144871.720333:0:7099:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099501800/0x4076af6727512c5b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92767 expref: 6 pid: 8430 timeout: 565 lvb_type: 0 00010000:00010000:0.0:1746144871.720351:0:7099:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144871.720376:0:7099:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174482688:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 69us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144871.720381:0:7099:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9652 00000100:00100000:0.0:1746144871.724417:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.724460:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.727820:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.731752:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.736275:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.741426:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.744630:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.747931:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.748085:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.751015:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.753189:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174484736 00000100:00100000:0.0:1746144871.753196:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174484736 00010000:00010000:0.0:1746144871.753216:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800925b7200/0x4076af6727512c70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9277c expref: 213 pid: 20722 timeout: 565 lvb_type: 0 00000100:00100000:0.0:1746144871.753244:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9656 00000100:00100000:0.0:1746144871.753249:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+213:1984:x1830965174484736:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144871.753258:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144871.753271:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800925b7200/0x4076af6727512c70 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9277c expref: 213 pid: 20722 timeout: 565 lvb_type: 0 00010000:00010000:0.0:1746144871.753280:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800925b7200/0x4076af6727512c70 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9277c expref: 213 pid: 20722 timeout: 565 lvb_type: 0 00010000:00010000:0.0:1746144871.753293:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800925b7200/0x4076af6727512c70 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9277c expref: 213 pid: 20722 timeout: 565 lvb_type: 0 00010000:00010000:0.0:1746144871.753315:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144871.753316:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144871.753322:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af6727512c77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92783 expref: 212 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144871.753329:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af6727512c77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92783 expref: 212 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144871.753353:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af6727512c77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92783 expref: 212 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144871.753363:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cf2e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965172122880:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144871.754106:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144871.754124:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174484608 00000100:00100000:0.0:1746144871.754127:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174484608 00000100:00100000:0.0:1746144871.754158:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4237 00000100:00100000:0.0:1746144871.754163:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965174484608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144871.754175:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144871.754185:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091751c00/0x4076af6727512c7e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9278a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144871.754201:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af6727512c77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92783 expref: 212 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144871.754207:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144871.754208:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144871.754211:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091751c00/0x4076af6727512c7e lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9278a expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144871.754227:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af6727512c77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92783 expref: 212 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144871.754236:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af6727512c77 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92783 expref: 212 pid: 8430 timeout: 565 lvb_type: 0 00000100:00100000:0.0:1746144871.754247:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172123008:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144871.754270:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144871.756933:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.762079:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.765183:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.772937:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.775433:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.778413:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.778749:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.781909:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.784936:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.795088:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.799009:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.805228:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.805721:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.810844:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.817041:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.827924:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.843412:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.844760:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.849526:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.850528:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.855558:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.859816:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.866839:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.877350:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.881581:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.881622:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.883452:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.884355:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.885962:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.886405:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.889017:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.892128:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.896669:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.905150:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.910685:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.918603:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.921399:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.926093:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.926138:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.929282:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.949099:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.949179:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.954421:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.957869:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.960134:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.960211:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.964085:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.966977:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.969831:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.978160:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.982433:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.982522:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.985486:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.985913:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.988642:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.988886:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144871.991190:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.001910:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144872.002415:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144872.005848:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.005873:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174496128 00000100:00100000:0.0:1746144872.005879:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174496128 00000100:00080000:0.0:1746144872.005899:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00100000:0.0:1746144872.005928:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009258f480 x1830965174496128/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:513/0 lens 488/0 e 0 to 0 dl 1746144883 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144872.005937:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258f480 with x1830965174496128 ext(0->4095) 00002000:00010000:0.0:1746144872.005942:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009258f480 00000100:00100000:0.0:1746144872.005974:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3412 00000100:00100000:0.0:1746144872.005980:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174496128:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144872.006131:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174496128:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 151us (291us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144872.006147:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3412 00002000:00100000:0.0:1746144872.006153:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009258f480 x1830965174496128/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:513/0 lens 488/4536 e 0 to 0 dl 1746144883 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144872.006160:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258f480 with x1830965174496128 ext(0->4095) 00002000:00010000:0.0:1746144872.006163:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009258f480 00000100:00100000:0.0:1746144872.009041:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.013522:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.020478:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.022885:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.026440:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144872.029045:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144872.030911:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.037626:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.037683:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.042687:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.043945:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174498176 00000100:00100000:0.0:1746144872.043950:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174498176 00010000:00010000:0.0:1746144872.043967:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af6727512d0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92816 expref: 6 pid: 20722 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.043984:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9678 00000100:00100000:0.0:1746144872.043989:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174498176:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144872.043997:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144872.044007:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af6727512d0a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92816 expref: 6 pid: 20722 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.044015:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af6727512d0a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92816 expref: 6 pid: 20722 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.044027:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099500c00/0x4076af6727512d0a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92816 expref: 6 pid: 20722 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.044041:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.044043:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.044050:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094377a00/0x4076af6727512d11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9281d expref: 230 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.044056:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094377a00/0x4076af6727512d11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9281d expref: 230 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.044081:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094377a00/0x4076af6727512d11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9281d expref: 230 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144872.044091:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e85c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965172128128:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144872.044136:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144872.047104:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.070666:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.070720:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.077930:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.081489:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.084095:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.092926:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.097058:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.100865:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.116084:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174500608 00000100:00100000:0.0:1746144872.116092:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174500608 00000100:00100000:0.0:1746144872.116151:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4262 00000100:00100000:0.0:1746144872.116158:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+233:30931:x1830965174500608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144872.116174:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144872.116189:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf22000/0x4076af6727512d2d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92839 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.116549:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094376e00/0x4076af6727512d26 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92832 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.116556:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.116557:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.116561:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf22000/0x4076af6727512d2d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92839 expref: 234 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.116587:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094376e00/0x4076af6727512d26 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92832 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.116597:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094376e00/0x4076af6727512d26 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92832 expref: 5 pid: 20722 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.116607:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172129024:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144872.116668:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144872.119129:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.119229:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.125472:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.133023:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.136664:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.142097:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.147836:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.153387:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.170580:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.170624:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.175286:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.177977:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.179718:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.185575:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.188649:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.192317:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.192388:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.195637:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.198490:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.205452:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.207231:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.209460:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.211080:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.213127:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.219034:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.221309:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.225625:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.227129:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.227150:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174506112 00000100:00100000:0.0:1746144872.227153:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174506112 00010000:00010000:0.0:1746144872.227166:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800925b6e00/0x4076af6727512d57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92863 expref: 241 pid: 8430 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.227179:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9690 00000100:00100000:0.0:1746144872.227184:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+241:1984:x1830965174506112:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144872.227189:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144872.227202:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800925b6e00/0x4076af6727512d57 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92863 expref: 241 pid: 8430 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.227215:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800925b6e00/0x4076af6727512d57 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92863 expref: 241 pid: 8430 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.227227:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800925b6e00/0x4076af6727512d57 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92863 expref: 241 pid: 8430 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.227239:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.227241:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.227246:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800925b7800/0x4076af6727512d65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92871 expref: 240 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.227252:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800925b7800/0x4076af6727512d65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92871 expref: 240 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.227280:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800925b7800/0x4076af6727512d65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92871 expref: 240 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144872.227291:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a00e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965172130944:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144872.227327:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144872.227370:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.230277:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.235851:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.241732:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.248073:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.249934:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.253208:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.253474:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.256636:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.259207:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.263281:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.267193:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.272067:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.272676:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.275623:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.275666:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.279224:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.279360:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.282401:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.290581:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.292851:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.296916:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.303086:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174510336 00000100:00100000:0.0:1746144872.303094:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174510336 00000100:00100000:0.0:1746144872.303129:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4277 00000100:00100000:0.0:1746144872.303145:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+245:30934:x1830965174510336:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144872.303159:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144872.303175:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf23600/0x4076af6727512d96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af928a2 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.303196:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.303198:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.303204:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf23600/0x4076af6727512d96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928a2 expref: 246 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.303221:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf23600/0x4076af6727512d96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928a2 expref: 246 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.303370:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf23600, rc 0) 00000100:00100000:0.0:1746144872.303414:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+246:30934:x1830965174510336:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 279us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144872.303420:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4277 00000100:00100000:0.0:1746144872.306805:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174510464 00000100:00100000:0.0:1746144872.306816:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174510464 00000100:00100000:0.0:1746144872.306865:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4278 00000100:00100000:0.0:1746144872.306872:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+246:30931:x1830965174510464:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144872.306887:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144872.306900:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf23000/0x4076af6727512d9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af928a9 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.306929:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800925b6e00/0x4076af6727512d8f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9289b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.306936:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf23600/0x4076af6727512d96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928a2 expref: 247 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.306941:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.306943:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.306945:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf23000/0x4076af6727512d9d lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928a9 expref: 247 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.306972:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf23600/0x4076af6727512d96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928a2 expref: 247 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.306981:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf23600/0x4076af6727512d96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928a2 expref: 247 pid: 8430 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.306991:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172132480:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144872.307236:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800925b6e00/0x4076af6727512d8f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9289b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.307247:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800925b6e00/0x4076af6727512d8f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9289b expref: 5 pid: 8430 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.307254:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172132608:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144872.307273:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144872.309463:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.310976:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172132480:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144872.310987:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac84380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172132608:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144872.311012:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf23000/0x4076af6727512d9d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928a9 expref: 247 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.311027:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf23000, rc 0) 00000100:00100000:0.0:1746144872.311060:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801362af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+247:30931:x1830965174510464:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4187us (5830us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144872.311072:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4278 00000100:00100000:0.0:1746144872.311544:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.315494:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.316267:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174511104 00000100:00100000:0.0:1746144872.316271:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174511104 00000100:00100000:0.0:1746144872.316301:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4279 00000100:00100000:0.0:1746144872.316307:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965174511104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144872.316319:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144872.316328:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b523fe00/0x4076af6727512da4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af928b0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.316344:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf23000/0x4076af6727512d9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928a9 expref: 246 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.316349:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144872.316350:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144872.316353:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b523fe00/0x4076af6727512da4 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928b0 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.316367:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf23000/0x4076af6727512d9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928a9 expref: 246 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.316377:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf23000/0x4076af6727512d9d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928a9 expref: 246 pid: 8430 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.316385:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172132864:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144872.316420:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144872.317821:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.317913:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172132864:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144872.317927:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b523fe00/0x4076af6727512da4 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928b0 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.317938:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b523fe00, rc 0) 00000100:00100000:0.0:1746144872.317968:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965174511104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1661us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144872.317973:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4279 00000100:00100000:0.0:1746144872.319952:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.322468:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.328639:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.332926:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.340360:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.341275:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.345209:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.345276:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.345297:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.345492:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174512640 00000100:00100000:0.0:1746144872.345497:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174512640 00010000:00010000:0.0:1746144872.345519:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b523fe00/0x4076af6727512da4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928b0 expref: 6 pid: 8430 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.345536:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174512896 00000100:00100000:0.0:1746144872.345538:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174512896 00010000:00010000:0.0:1746144872.345546:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094377400/0x4076af6727512dab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928b7 expref: 249 pid: 8430 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.345562:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9700 00000100:00100000:0.0:1746144872.345567:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174512640:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144872.345577:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144872.345594:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b523fe00/0x4076af6727512da4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928b0 expref: 6 pid: 8430 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.345603:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b523fe00/0x4076af6727512da4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928b0 expref: 6 pid: 8430 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.345621:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b523fe00/0x4076af6727512da4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928b0 expref: 6 pid: 8430 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.346329:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144872.346348:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174512640:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 780us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144872.346354:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9700 00000100:00100000:0.0:1746144872.348680:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a00fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965172133376:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144872.348691:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144872.348943:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+248:1983:x1830965174512896:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2960us (3644us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144872.348950:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9701 00000100:00100000:0.0:1746144872.349735:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.355289:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.359721:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.367335:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.371884:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.372068:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.374417:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.377446:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.382097:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.400056:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.405327:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.408526:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.410513:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.410550:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.414646:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.419933:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.424012:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.427869:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.431856:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.439012:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.451365:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174516992 00000100:00100000:0.0:1746144872.451373:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174516992 00000100:00100000:0.0:1746144872.451415:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4288 00000100:00100000:0.0:1746144872.451421:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e8a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+254:30931:x1830965174516992:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144872.451436:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144872.451450:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af6727512de3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af928ef expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.451475:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094377a00/0x4076af6727512dd5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928e1 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.451485:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727512ddc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928e8 expref: 255 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.451491:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.451492:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.451495:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af6727512de3 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928ef expref: 255 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.451518:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727512ddc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928e8 expref: 255 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.451527:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727512ddc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928e8 expref: 255 pid: 10401 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.451536:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009230dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965172134784:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144872.451597:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094377a00/0x4076af6727512dd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928e1 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.451603:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094377a00/0x4076af6727512dd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928e1 expref: 5 pid: 10401 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.451614:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009230df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965172134912:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144872.451630:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144872.451646:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174517120 00000100:00100000:0.0:1746144872.451649:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174517120 00002000:00100000:0.0:1746144872.451667:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88008e8a1880 x1830965174517120/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:513/0 lens 488/0 e 0 to 0 dl 1746144883 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144872.451674:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e8a1880 with x1830965174517120 ext(0->4095) 00010000:00010000:0.0:1746144872.451679:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880094377a00/0x4076af6727512dd5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928e1 expref: 6 pid: 10401 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.451685:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880094377a00/0x4076af6727512dd5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928e1 expref: 6 pid: 10401 timeout: 566 lvb_type: 0 00002000:00010000:0.0:1746144872.451690:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008e8a1880 00000100:00100000:0.0:1746144872.451713:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1267 00000100:00100000:0.0:1746144872.451717:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e8a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174517120:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144872.458680:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9708 00000100:00100000:0.0:1746144872.458685:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174517504:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144872.458691:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144872.459109:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094377a00/0x4076af6727512dd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928e1 expref: 6 pid: 10401 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.459118:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094377a00/0x4076af6727512dd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928e1 expref: 6 pid: 10401 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.459128:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094377a00/0x4076af6727512dd5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928e1 expref: 6 pid: 10401 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.459158:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.459159:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.459165:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af6727512de3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928ef expref: 255 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.459170:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af6727512de3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af928ef expref: 255 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144872.471508:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.479554:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.484593:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.486943:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.490089:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.495715:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.507102:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.516115:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.522080:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.529176:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.529255:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.533309:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.539586:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174520704 00000100:00100000:0.0:1746144872.539593:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174520704 00002000:00100000:0.0:1746144872.539628:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009ad5c380 x1830965174520704/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:513/0 lens 488/0 e 0 to 0 dl 1746144883 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144872.539635:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5c380 with x1830965174520704 ext(0->4095) 00010000:00010000:0.0:1746144872.539641:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092553e00/0x4076af6727512e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92912 expref: 259 pid: 20722 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.539651:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092553e00/0x4076af6727512e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92912 expref: 259 pid: 20722 timeout: 566 lvb_type: 0 00002000:00010000:0.0:1746144872.539661:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ad5c380 00000100:00100000:0.0:1746144872.539678:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1273 00000100:00100000:0.0:1746144872.539683:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+259:1985:x1830965174520704:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144872.539822:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+259:1985:x1830965174520704:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 139us (306us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144872.539828:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1273 00002000:00100000:0.0:1746144872.539832:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009ad5c380 x1830965174520704/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:513/0 lens 488/4536 e 0 to 0 dl 1746144883 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144872.539839:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5c380 with x1830965174520704 ext(0->4095) 00010000:00010000:0.0:1746144872.539844:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880092553e00/0x4076af6727512e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92912 expref: 259 pid: 20722 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.539852:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880092553e00/0x4076af6727512e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92912 expref: 259 pid: 20722 timeout: 566 lvb_type: 0 00002000:00010000:0.0:1746144872.539858:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ad5c380 00000100:00100000:0.0:1746144872.545632:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.553420:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.555197:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9714 00000100:00100000:0.0:1746144872.555209:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+261:1983:x1830965174521088:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144872.555224:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144872.555244:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880092553e00/0x4076af6727512e06 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92912 expref: 261 pid: 20722 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.555267:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880092553e00/0x4076af6727512e06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92912 expref: 261 pid: 20722 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.555287:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092553e00/0x4076af6727512e06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92912 expref: 261 pid: 20722 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.555303:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.555305:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.555310:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880094377000/0x4076af6727512e0d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92919 expref: 260 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.555317:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094377000/0x4076af6727512e0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92919 expref: 260 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.555347:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880094377000/0x4076af6727512e0d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92919 expref: 260 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144872.555360:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009230e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172136448:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144872.555429:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144872.564476:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.569502:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.569550:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.571813:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.574465:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.593206:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.615596:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.618295:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.621910:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.625373:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.640128:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.645108:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.645159:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.668578:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.668613:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.672522:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.678899:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4139900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144872.678935:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965172137984:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144872.678960:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad31200/0x4076af6727512e3e lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9294a expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.678975:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad31200, rc 0) 00000100:00100000:0.0:1746144872.680394:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:30934:x1830965174524672:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 11398us (11778us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144872.680403:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4301 00000100:00100000:0.0:1746144872.687717:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.693493:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174525696 00000100:00100000:0.0:1746144872.693500:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174525696 00002000:00100000:0.0:1746144872.693531:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009398d180 x1830965174525696/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:513/0 lens 488/0 e 0 to 0 dl 1746144883 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144872.693540:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398d180 with x1830965174525696 ext(0->4095) 00002000:00010000:0.0:1746144872.693544:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009398d180 00000100:00100000:0.0:1746144872.693640:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3434 00000100:00100000:0.0:1746144872.693646:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174525696:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144872.695287:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174525696:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 1634us (1847us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144872.695296:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3434 00002000:00100000:0.0:1746144872.695305:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88009398d180 x1830965174525696/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:513/0 lens 488/4536 e 0 to 0 dl 1746144883 ref 1 fl Complete:/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144872.695312:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398d180 with x1830965174525696 ext(0->4095) 00002000:00010000:0.0:1746144872.695316:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009398d180 00000100:00100000:0.0:1746144872.709149:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.709192:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.709567:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4303 00000100:00100000:0.0:1746144872.709574:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+13:30931:x1830965174525952:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144872.709581:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144872.709587:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a47b9c00/0x4076af6727512e4c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92951 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.709604:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad31200/0x4076af6727512e3e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9294a expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.709611:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf23600/0x4076af6727512e45 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92958 expref: 14 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.709616:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.709617:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.709619:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a47b9c00/0x4076af6727512e4c lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92951 expref: 14 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.709648:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf23600/0x4076af6727512e45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92958 expref: 14 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.709659:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf23600/0x4076af6727512e45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92958 expref: 14 pid: 8430 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.709668:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009181d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172138240:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144872.709715:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad31200/0x4076af6727512e3e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9294a expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.709721:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ad31200/0x4076af6727512e3e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9294a expref: 5 pid: 20722 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.709728:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009181ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172138368:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144872.709740:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144872.712227:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.712275:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.717187:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.719009:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174526592 00000100:00100000:0.0:1746144872.719014:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174526592 00010000:00010000:0.0:1746144872.719040:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf23600/0x4076af6727512e45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92958 expref: 13 pid: 8430 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.719067:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9723 00000100:00100000:0.0:1746144872.719072:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+13:1984:x1830965174526592:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144872.719081:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144872.719097:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bf23600/0x4076af6727512e45 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92958 expref: 13 pid: 8430 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.719106:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bf23600/0x4076af6727512e45 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92958 expref: 13 pid: 8430 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.719123:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf23600/0x4076af6727512e45 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92958 expref: 13 pid: 8430 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.719400:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.719402:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.719408:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a47b9c00/0x4076af6727512e4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92951 expref: 12 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.719415:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a47b9c00/0x4076af6727512e4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92951 expref: 12 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.719438:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a47b9c00/0x4076af6727512e4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92951 expref: 12 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.719447:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a47b9c00/0x4076af6727512e4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92951 expref: 12 pid: 10401 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.719457:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4f9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172138624:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144872.719523:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144872.722450:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.731208:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.743893:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.746638:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.753011:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174528256 00000100:00100000:0.0:1746144872.753015:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174528256 00000100:00100000:0.0:1746144872.753047:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4306 00000100:00100000:0.0:1746144872.753051:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a00fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+14:30931:x1830965174528256:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144872.753060:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144872.753072:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad31200/0x4076af6727512e61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9296d expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.753092:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091750200/0x4076af6727512e53 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9295f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.753100:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af6727512e5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92966 expref: 15 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.753105:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.753107:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.753110:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad31200/0x4076af6727512e61 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9296d expref: 15 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.753141:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af6727512e5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92966 expref: 15 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.753151:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af6727512e5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92966 expref: 15 pid: 20722 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.753165:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087db9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172138880:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144872.753240:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091750200/0x4076af6727512e53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9295f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.753247:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091750200/0x4076af6727512e53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9295f expref: 5 pid: 10401 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.753255:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087db8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172139008:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144872.753270:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3300 going to sleep for 11 seconds 00010000:00010000:0.0:1746144872.766287:0:10401:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af6727512e5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92966 expref: 15 pid: 20722 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.766345:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087db9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172138880:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144872.771083:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965172139136:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144872.771098:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144872.771438:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1984:x1830965174528512:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5761us (5993us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144872.771448:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9726 00000100:00100000:0.0:1746144872.781109:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.783853:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.791830:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.806560:0:20492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174529920 00000100:00100000:0.0:1746144872.806564:0:20492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174529920 00000100:00100000:0.0:1746144872.806597:0:20492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 295 00000100:00100000:0.0:1746144872.806603:0:20492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965174529920:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144872.806630:0:20492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965174529920:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144872.806634:0:20492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 295 00000100:00100000:0.0:1746144872.806801:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.806809:0:20492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174530304 00000100:00100000:0.0:1746144872.806812:0:20492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174530304 00000100:00100000:0.0:1746144872.808508:0:20492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 296 00000100:00100000:0.0:1746144872.808517:0:20492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1982:x1830965174530304:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144872.808551:0:20492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136198380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1982:x1830965174530304:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 36us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144872.808556:0:20492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 296 00000100:00100000:0.0:1746144872.810230:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172139520:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144872.810239:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172139648:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144872.810260:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf23000/0x4076af6727512e76 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92982 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.810274:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf23000, rc 0) 00000100:00100000:0.0:1746144872.810301:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+17:30931:x1830965174530176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3168us (3994us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144872.810307:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4309 00000100:00100000:0.0:1746144872.810651:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174530816 00000100:00100000:0.0:1746144872.810656:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174530816 00002000:00100000:0.0:1746144872.810687:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88008f38d500 x1830965174530816/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:513/0 lens 488/0 e 0 to 0 dl 1746144883 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144872.810700:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38d500 with x1830965174530816 ext(0->4095) 00010000:00010000:0.0:1746144872.810706:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bf22000/0x4076af6727512e6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9297b expref: 17 pid: 8430 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.810715:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bf22000/0x4076af6727512e6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9297b expref: 17 pid: 8430 timeout: 566 lvb_type: 0 00002000:00010000:0.0:1746144872.810721:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f38d500 00000100:00100000:0.0:1746144872.811113:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1286 00000100:00100000:0.0:1746144872.811120:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1984:x1830965174530816:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144872.811268:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1984:x1830965174530816:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 149us (753us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144872.811274:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1286 00002000:00100000:0.0:1746144872.811279:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff88008f38d500 x1830965174530816/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:513/0 lens 488/4536 e 0 to 0 dl 1746144883 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144872.811286:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38d500 with x1830965174530816 ext(0->4095) 00010000:00010000:0.0:1746144872.811290:0:8438:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009bf22000/0x4076af6727512e6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9297b expref: 17 pid: 8430 timeout: 566 lvb_type: 0 00010000:00010000:0.0:1746144872.811298:0:8438:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009bf22000/0x4076af6727512e6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9297b expref: 17 pid: 8430 timeout: 566 lvb_type: 0 00002000:00010000:0.0:1746144872.811303:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f38d500 00000100:00100000:0.0:1746144872.814788:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174530944 00000100:00100000:0.0:1746144872.814797:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174530944 00000100:00100000:0.0:1746144872.814957:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4312 00000100:00100000:0.0:1746144872.814964:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965174530944:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144872.814977:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144872.814989:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbb9400/0x4076af6727512e7d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92989 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.815006:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.815011:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf23000/0x4076af6727512e76 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92982 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.815016:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144872.815019:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbb9400/0x4076af6727512e7d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92989 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.815045:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf23000/0x4076af6727512e76 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92982 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.815065:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012dbb9400/0x4076af6727512e7d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92989 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.815072:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.815073:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144872.815078:0:8430:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf23000/0x4076af6727512e76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92982 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.815084:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf23000/0x4076af6727512e76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92982 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.815102:0:8430:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf23000/0x4076af6727512e76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92982 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144872.815110:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf23000/0x4076af6727512e76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92982 expref: 17 pid: 8430 timeout: 566 lvb_type: 0 00000100:00100000:0.0:1746144872.815120:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172139904:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144872.815191:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144872.817410:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.824730:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.828245:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.832427:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.835649:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.837877:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.841211:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.841311:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.843933:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.844606:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.844875:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.846738:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.850003:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.853831:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.857320:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.861005:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.867542:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.869922:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.871119:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.873554:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.874959:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.875049:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.881476:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.883680:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.887371:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.890037:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.893066:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.895365:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.895639:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.902398:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.905315:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.909542:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.913315:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.916708:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.919274:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.920926:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.921789:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174538880 00000100:00100000:0.0:1746144872.921792:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174538880 00002000:00100000:0.0:1746144872.921812:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880099a3e050 x1830965174538880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:513/0 lens 488/0 e 0 to 0 dl 1746144883 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144872.921818:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099a3e050 with x1830965174538880 ext(0->4095) 00010000:00010000:0.0:1746144872.921823:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099a73e00/0x4076af6727512ebc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af929c8 expref: 26 pid: 8432 timeout: 567 lvb_type: 0 00010000:00010000:0.0:1746144872.921830:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099a73e00/0x4076af6727512ebc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af929c8 expref: 26 pid: 8432 timeout: 567 lvb_type: 0 00002000:00010000:0.0:1746144872.921840:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099a3e050 00000100:00100000:0.0:1746144872.921860:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1297 00000100:00100000:0.0:1746144872.921865:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1983:x1830965174538880:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144872.921972:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1983:x1830965174538880:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 106us (231us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144872.921978:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1297 00002000:00100000:0.0:1746144872.921982:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff880099a3e050 x1830965174538880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:513/0 lens 488/4536 e 0 to 0 dl 1746144883 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144872.921988:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099a3e050 with x1830965174538880 ext(0->4095) 00010000:00010000:0.0:1746144872.921991:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099a73e00/0x4076af6727512ebc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af929c8 expref: 26 pid: 8432 timeout: 567 lvb_type: 0 00010000:00010000:0.0:1746144872.921997:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099a73e00/0x4076af6727512ebc lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af929c8 expref: 26 pid: 8432 timeout: 567 lvb_type: 0 00002000:00010000:0.0:1746144872.922001:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099a3e050 00000100:00100000:0.0:1746144872.925402:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.928567:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.931021:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.937118:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.952893:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.961168:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.964108:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.966496:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.968888:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.972329:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.975957:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.980400:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.982730:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.984488:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.988152:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.991160:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.991204:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144872.992703:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.003811:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.019554:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.023581:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.025536:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.031787:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.031839:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.037367:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.039871:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.043509:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.048260:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.051687:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.062902:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.064949:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.071031:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.071075:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.076312:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.076427:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172144768:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144873.076451:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af6727512f17 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92a23 expref: 33 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144873.076466:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092553200, rc 0) 00000100:00100000:0.0:1746144873.076502:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+33:30934:x1830965174545408:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5014us (5474us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144873.076509:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4334 00000100:00100000:0.0:1746144873.082579:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.084534:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.088018:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.093870:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.098483:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.098531:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.101642:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.102376:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174547200 00000100:00100000:0.0:1746144873.102383:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174547200 00010000:00010000:0.0:1746144873.102396:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af6727512f1e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92a2a expref: 6 pid: 8430 timeout: 567 lvb_type: 0 00000100:00100000:0.0:1746144873.105045:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.110463:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.115118:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.120701:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.128035:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.129595:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.133674:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.133759:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.140271:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.144220:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.148613:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.155272:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.162456:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.167005:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.170345:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.174031:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.174060:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.175646:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.175837:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.179119:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.182885:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.192399:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.194450:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.196501:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.200345:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.200395:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.204628:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.204661:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.204716:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.212920:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.218493:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.224267:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.227368:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.229565:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.233283:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.241162:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.249643:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.256044:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.267206:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.271691:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.279580:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.284217:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.284676:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.290544:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.291404:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.296281:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.300292:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.319495:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174556928 00000100:00100000:0.0:1746144873.319503:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174556928 00000100:00100000:0.0:1746144873.319544:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4352 00000100:00100000:0.0:1746144873.319552:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:30934:x1830965174556928:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144873.319566:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144873.319580:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf22800/0x4076af6727512f95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92aa1 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144873.319604:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727512f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92a9a expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144873.319610:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144873.319612:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144873.319615:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf22800/0x4076af6727512f95 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92aa1 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144873.319640:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727512f8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92a9a expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144873.319650:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727512f8e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92a9a expref: 43 pid: 8430 timeout: 567 lvb_type: 0 00000100:00100000:0.0:1746144873.319662:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172148608:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144873.321847:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144873.336857:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.339094:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.341657:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.345025:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.354235:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.354313:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.370936:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.379425:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.397741:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.401842:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.407961:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.411063:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.415140:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.430073:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174560000 00000100:00100000:0.0:1746144873.430081:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174560000 00000100:00100000:0.0:1746144873.430115:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4357 00000100:00100000:0.0:1746144873.430122:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+48:30931:x1830965174560000:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144873.431366:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144873.431382:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af6727512fb8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92ac4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144873.431408:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091751400/0x4076af6727512faa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92ab6 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144873.431419:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af6727512fb1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92abd expref: 49 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144873.431425:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144873.431426:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144873.431429:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af6727512fb8 lrc: 5/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92ac4 expref: 49 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144873.431454:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af6727512fb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92abd expref: 49 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144873.431463:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af6727512fb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92abd expref: 49 pid: 20722 timeout: 567 lvb_type: 0 00000100:00100000:0.0:1746144873.431474:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a417dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172149504:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144873.431567:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091751400/0x4076af6727512faa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92ab6 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144873.431574:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091751400/0x4076af6727512faa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92ab6 expref: 5 pid: 20722 timeout: 567 lvb_type: 0 00000100:00100000:0.0:1746144873.431580:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a417ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172149632:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144873.431595:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144873.443668:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.443688:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.445847:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.449576:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.455835:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.464101:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.477106:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.482011:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.484164:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.485208:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.491821:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.496088:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.512480:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.519239:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.520791:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174562816 00000100:00100000:0.0:1746144873.520795:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174562816 00000100:00100000:0.0:1746144873.522481:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.525017:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.530326:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.540891:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.547868:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.547924:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.553135:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.556086:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.560328:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.564065:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.579812:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.582640:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.587029:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.592753:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.597539:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.599901:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.603942:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.604862:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.614854:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174566272 00000100:00100000:0.0:1746144873.614868:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174566272 00002000:00100000:0.0:1746144873.614921:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800924da680 x1830965174566272/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:514/0 lens 488/0 e 0 to 0 dl 1746144884 ref 1 fl New:/200/ffffffff rc 0/-1 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144873.614932:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924da680 with x1830965174566272 ext(0->4095) 00010000:00010000:0.0:1746144873.614944:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091750400/0x4076af6727512ff7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92b03 expref: 56 pid: 20722 timeout: 567 lvb_type: 0 00010000:00010000:0.0:1746144873.614960:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091750400/0x4076af6727512ff7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92b03 expref: 56 pid: 20722 timeout: 567 lvb_type: 0 00002000:00010000:0.0:1746144873.614967:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800924da680 00000100:00100000:0.0:1746144873.615000:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1336 00000100:00100000:0.0:1746144873.615006:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1985:x1830965174566272:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144873.615373:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1985:x1830965174566272:12345-192.168.202.16@tcp:3:rw_seq_cst_vs_d.0 Request processed in 366us (3105us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144873.615380:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1336 00002000:00100000:0.0:1746144873.615386:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x18:0x0] (0->4095) req@ffff8800924da680 x1830965174566272/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:514/0 lens 488/4536 e 0 to 0 dl 1746144884 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'rw_seq_cst_vs_d.0' uid:0 gid:0 00002000:00100000:0.0:1746144873.615392:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924da680 with x1830965174566272 ext(0->4095) 00010000:00010000:0.0:1746144873.615397:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091750400/0x4076af6727512ff7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92b03 expref: 56 pid: 20722 timeout: 567 lvb_type: 0 00010000:00010000:0.0:1746144873.615411:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091750400/0x4076af6727512ff7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92b03 expref: 56 pid: 20722 timeout: 567 lvb_type: 0 00002000:00010000:0.0:1746144873.615416:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800924da680 00000100:00100000:0.0:1746144873.622065:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.627994:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.629868:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.640292:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.645846:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.667625:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.671474:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.671534:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.683838:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.686837:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.686889:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.693746:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.712460:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.721697:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.728860:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.740950:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.819147:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.825256:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.832470:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.842566:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144873.847927:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144875.484393:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2566f13b-362a-4e88-b0dd-c558bbe87895:3306:1830965172153088:0@lo:400:kworker.0 00000100:00100000:0.0:1746144875.486286:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144875.487701:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172153088 00000100:00100000:0.0:1746144875.487705:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172153088 00000100:00100000:0.0:1746144875.487729:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1746144875.487733:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800acc50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2566f13b-362a-4e88-b0dd-c558bbe87895+18:3306:x1830965172153088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144875.487773:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800acc50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2566f13b-362a-4e88-b0dd-c558bbe87895+18:3306:x1830965172153088:12345-0@lo:400:kworker.0 Request processed in 28us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144875.487777:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1746144875.487801:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2566f13b-362a-4e88-b0dd-c558bbe87895:3306:1830965172153088:0@lo:400:kworker.0 00000001:00100000:0.0:1746144875.959725:0:8514:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7454cbaf-97e3-4716-92c6-77cd48a94a90 00000020:00000080:0.0:1746144875.959732:0:8514:0:(genops.c:904:class_export_put()) final put ffff88012beca800/7454cbaf-97e3-4716-92c6-77cd48a94a90 00000001:00100000:0.0:1746144875.959747:0:8514:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9d7af19e-38f7-44a8-82cf-031a58749c81 00000020:00000080:0.0:1746144875.959749:0:8514:0:(genops.c:904:class_export_put()) final put ffff880093fda800/9d7af19e-38f7-44a8-82cf-031a58749c81 00000100:00100000:0.0:1746144877.036293:0:3309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172153984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746144877.036344:0:3309:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144877.036822:0:3309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172153984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746144877.821049:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.821066:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.821082:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.821116:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.821134:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.821165:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174570624 00000100:00100000:0.0:1746144877.821172:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174570624 00000100:00100000:0.0:1746144877.821208:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174570880 00000100:00100000:0.0:1746144877.821210:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174570880 00000100:00100000:0.0:1746144877.821227:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 378 00000100:00100000:0.0:1746144877.821234:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1983:x1830965174570624:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144877.821280:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1983:x1830965174570624:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 47us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144877.821286:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 378 00000100:00100000:0.0:1746144877.821296:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 379 00000100:00100000:0.0:1746144877.821299:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965174570880:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144877.821315:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965174570880:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 15us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144877.821319:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 379 00000100:00080000:0.0:1746144877.821330:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144877.821346:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174570368 00000100:00100000:0.0:1746144877.821349:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174570368 00000100:00100000:0.0:1746144877.821365:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 365 00000100:00100000:0.0:1746144877.821369:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4574b85-29c1-4863-b96a-3fe350afea52+12:1983:x1830965174570368:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144877.821390:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4574b85-29c1-4863-b96a-3fe350afea52+12:1983:x1830965174570368:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 16us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144877.821395:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 365 00000100:00080000:0.0:1746144877.821729:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144877.837108:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174571008 00000100:00100000:0.0:1746144877.837117:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174571008 00000100:00100000:0.0:1746144877.837152:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48204 00000100:00100000:0.0:1746144877.837160:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31565:x1830965174571008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144877.837176:0:21076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144877.837192:0:21076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6c00/0x4076af6727513067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92b3b expref: -99 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144877.837243:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b7800/0x4076af672751306e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144877.837252:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b7800/0x4076af672751306e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144877.837260:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b7800/0x4076af672751306e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000004:00200000:0.0:1746144877.837302:0:21076:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:0.0:1746144877.837305:0:21076:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 24 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144877.837318:0:21076:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b7800/0x4076af672751306e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144877.837333:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6c00/0x4076af6727513067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92b3b expref: 10 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144877.837344:0:21076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b7800/0x4076af672751306e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92b3b expref: 9 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144877.837350:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008a389a00) 00010000:00010000:0.0:1746144877.837353:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746144877.837355:0:21076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925b7800, rc 0) 00000100:00100000:0.0:1746144877.837404:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31565:x1830965174571008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 244us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144877.837409:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48204 00000100:00100000:0.0:1746144877.841564:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:0.0:1746144877.844218:0:3292:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fb200/0x4076af6727513083 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21078 initiator: MDT0 00010000:00010000:0.0:1746144877.844230:0:3292:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fb200/0x4076af6727513083 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21078 initiator: MDT0 00010000:00010000:0.0:1746144877.844236:0:3292:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fb200/0x4076af6727513083 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21078 initiator: MDT0 00010000:00010000:0.0:1746144877.844241:0:3292:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800916fb200 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144877.844245:0:3292:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fb200/0x4076af6727513083 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21078 initiator: MDT0 00010000:00010000:0.0:1746144877.844250:0:3292:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fb200/0x4076af6727513083 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21078 initiator: MDT0 00010000:00010000:0.0:1746144877.844262:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf0ce3da1 (ffff8800917b0f00) 00010000:00010000:0.0:1746144877.844264:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144877.844267:0:3292:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fb200/0x4076af6727513083 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21078 initiator: MDT0 00010000:00010000:0.0:1746144877.844272:0:3292:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fb200/0x4076af6727513083 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21078 initiator: MDT0 00000100:00100000:0.0:1746144877.848583:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.860915:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.875073:0:21078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174571648 00000100:00100000:0.0:1746144877.875081:0:21078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174571648 00000100:00100000:0.0:1746144877.875141:0:21078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48206 00000100:00100000:0.0:1746144877.875149:0:21078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:31565:x1830965174571648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144877.875165:0:21078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144877.875182:0:21078:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b7200/0x4076af67275130a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92b50 expref: -99 pid: 21078 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144877.875232:0:21078:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6e00/0x4076af67275130ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21078 initiator: MDT0 00010000:00010000:0.0:1746144877.875243:0:21078:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6e00/0x4076af67275130ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21078 initiator: MDT0 00010000:00010000:0.0:1746144877.875252:0:21078:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6e00/0x4076af67275130ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21078 initiator: MDT0 00000004:00200000:0.0:1746144877.875301:0:21078:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:0.0:1746144877.875304:0:21078:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144877.875317:0:21078:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6e00/0x4076af67275130ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21078 initiator: MDT0 00010000:00010000:0.0:1746144877.875334:0:21078:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b7200/0x4076af67275130a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92b50 expref: 9 pid: 21078 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144877.875345:0:21078:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800925b6e00/0x4076af67275130ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92b50 expref: 8 pid: 21078 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144877.875352:0:21078:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008a389100) 00010000:00010000:0.0:1746144877.875355:0:21078:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746144877.875357:0:21078:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800925b6e00, rc 0) 00000100:00100000:0.0:1746144877.875404:0:21078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:31565:x1830965174571648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 256us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144877.875410:0:21078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48206 00000100:00100000:0.0:1746144877.880052:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.886809:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.892962:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.899413:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.902713:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.905135:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.907945:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.912476:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009181c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172154368:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144877.912495:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144877.912537:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965174572800:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3952us (4593us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144877.912543:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9791 00002000:00010000:0.0:1746144877.938411:0:31840:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746144877.938415:0:31840:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 0 -> 1746144878 00002000:00010000:0.0:1746144877.938417:0:31840:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746144877.938419:0:31840:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 0 -> 1746144878 00002000:00010000:0.0:1746144877.938420:0:31840:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:0.0:1746144877.938639:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174572928:12345-192.168.202.16@tcp:10:rw_seq_cst_vs_d.0 Request processed in 26185us (26532us total) trans 4294967858 rc 0/0 00000100:00100000:0.0:1746144877.938647:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3476 00002000:00010000:0.0:1746144877.938652:0:31840:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/24 (0->18446744073709551615) 00002000:00100000:0.0:1746144877.938654:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181c000 with x1830965174572928 ext(0->18446744073709551615) 00002000:00010000:0.0:1746144877.938660:0:31840:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009181c000. 00000100:00100000:0.0:1746144877.941082:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.951164:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.953272:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.958309:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.962481:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.968627:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.975103:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.978914:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144877.984328:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.000473:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.006289:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.016055:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.019159:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.023355:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.027267:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.029725:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.034030:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.037898:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.041936:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.044266:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.049230:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.052676:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.053479:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.053880:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174576640 00000100:00100000:0.0:1746144878.053883:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174576640 00000100:00100000:0.0:1746144878.053915:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4382 00000100:00100000:0.0:1746144878.053920:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31565:x1830965174576640:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144878.053931:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144878.053945:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e906600/0x4076af6727513139 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92ba4 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144878.053968:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cec0200/0x4076af6727513132 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92b9d expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144878.053975:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144878.053977:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144878.053980:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e906600/0x4076af6727513139 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92ba4 expref: 9 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144878.054004:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cec0200/0x4076af6727513132 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92b9d expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144878.054014:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cec0200/0x4076af6727513132 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92b9d expref: 6 pid: 10401 timeout: 572 lvb_type: 0 00000100:00100000:0.0:1746144878.054024:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093854380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172156032:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144878.054072:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144878.059162:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.061461:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.068167:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.070555:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.074252:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.075829:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.078862:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.086022:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.086099:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.089355:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.090239:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.093730:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.095394:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.098131:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.100697:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174579200 00000100:00100000:0.0:1746144878.100702:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174579200 00000100:00100000:0.0:1746144878.100747:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4387 00000100:00100000:0.0:1746144878.100753:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174579200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144878.100785:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144878.100803:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800925b7800/0x4076af672751315c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92bc7 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144878.100944:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af6727513155 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92bc0 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144878.100952:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144878.100953:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144878.100956:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800925b7800/0x4076af672751315c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92bc7 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144878.100984:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af6727513155 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92bc0 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144878.100995:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af6727513155 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92bc0 expref: 8 pid: 8432 timeout: 572 lvb_type: 0 00000100:00100000:0.0:1746144878.101005:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172157312:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144878.101080:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144878.104824:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.109392:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.109933:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.116928:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.119692:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.126939:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.133929:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.136835:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.139850:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.143257:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.143898:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.149908:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.149997:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.154165:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.156593:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.161978:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.164468:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.167341:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.169456:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.170834:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.172316:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.175481:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.179657:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.183216:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.183329:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.187796:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.189989:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.190728:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.192941:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.196204:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.199899:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.202160:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.205717:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.209156:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.209984:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.214067:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.214118:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.223572:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.227923:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.230372:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.234219:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.239597:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.239709:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.243356:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.246180:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.249013:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174587392 00000100:00100000:0.0:1746144878.249019:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174587392 00002000:00100000:0.0:1746144878.249056:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70380 x1830965174587392/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:519/0 lens 488/0 e 0 to 0 dl 1746144889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144878.249298:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70380 with x1830965174587392 ext(0->4095) 00010000:00010000:0.0:1746144878.249308:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009170ba00/0x4076af67275131c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92c30 expref: 10 pid: 8430 timeout: 572 lvb_type: 0 00010000:00010000:0.0:1746144878.249320:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009170ba00/0x4076af67275131c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92c30 expref: 10 pid: 8430 timeout: 572 lvb_type: 0 00002000:00010000:0.0:1746144878.249326:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f70380 00000100:00100000:0.0:1746144878.249349:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1354 00000100:00100000:0.0:1746144878.249355:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965174587392:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144878.249529:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965174587392:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 173us (570us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144878.249539:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1354 00002000:00100000:0.0:1746144878.249544:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70380 x1830965174587392/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746144889 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144878.249551:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70380 with x1830965174587392 ext(0->4095) 00010000:00010000:0.0:1746144878.249556:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009170ba00/0x4076af67275131c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92c30 expref: 10 pid: 8430 timeout: 572 lvb_type: 0 00010000:00010000:0.0:1746144878.249564:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009170ba00/0x4076af67275131c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92c30 expref: 10 pid: 8430 timeout: 572 lvb_type: 0 00002000:00010000:0.0:1746144878.249569:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f70380 00000100:00100000:0.0:1746144878.251208:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.254808:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.258508:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.261191:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.264056:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.264834:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.266839:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.269057:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.275195:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.278816:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.281715:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.286421:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.290848:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.290956:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.297365:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.298925:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.305037:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.309448:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.312932:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.316579:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.321054:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.324787:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.324834:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.331089:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.334498:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.339454:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.344955:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.348676:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.353021:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.358557:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.360462:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.363739:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174593024 00000100:00100000:0.0:1746144878.363745:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174593024 00002000:00100000:0.0:1746144878.363807:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181e680 x1830965174593024/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:519/0 lens 488/0 e 0 to 0 dl 1746144889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144878.363816:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181e680 with x1830965174593024 ext(0->4095) 00010000:00010000:0.0:1746144878.363823:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009170aa00/0x4076af6727513212 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92c7d expref: 6 pid: 8432 timeout: 572 lvb_type: 0 00010000:00010000:0.0:1746144878.363834:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009170aa00/0x4076af6727513212 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92c7d expref: 6 pid: 8432 timeout: 572 lvb_type: 0 00002000:00010000:0.0:1746144878.363840:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181e680 00000100:00100000:0.0:1746144878.363856:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1359 00000100:00100000:0.0:1746144878.363863:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174593024:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144878.364018:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174593024:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 155us (844us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144878.364024:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1359 00002000:00100000:0.0:1746144878.364029:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181e680 x1830965174593024/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746144889 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144878.364037:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181e680 with x1830965174593024 ext(0->4095) 00010000:00010000:0.0:1746144878.364042:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009170aa00/0x4076af6727513212 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92c7d expref: 6 pid: 8432 timeout: 572 lvb_type: 0 00010000:00010000:0.0:1746144878.364050:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009170aa00/0x4076af6727513212 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92c7d expref: 6 pid: 8432 timeout: 572 lvb_type: 0 00002000:00010000:0.0:1746144878.364055:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181e680 00000100:00100000:0.0:1746144878.367523:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.372139:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.376515:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.384366:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174593664 00000100:00100000:0.0:1746144878.384374:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174593664 00002000:00100000:0.0:1746144878.384417:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880092f71500 x1830965174593664/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:519/0 lens 496/0 e 0 to 0 dl 1746144889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144878.384427:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f71500 with x1830965174593664 ext(0->7) 00010000:00010000:0.0:1746144878.384433:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009170ba00/0x4076af6727513219 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92c84 expref: 9 pid: 8432 timeout: 572 lvb_type: 0 00010000:00010000:0.0:1746144878.384450:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009170ba00/0x4076af6727513219 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92c84 expref: 9 pid: 8432 timeout: 572 lvb_type: 0 00002000:00010000:0.0:1746144878.384456:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f71500 00000100:00100000:0.0:1746144878.384489:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1360 00000100:00100000:0.0:1746144878.384496:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965174593664:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746144878.384869:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1985:x1830965174593664:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 372us (664us total) trans 4294967861 rc 0/0 00000100:00100000:0.0:1746144878.384876:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1360 00002000:00100000:0.0:1746144878.384882:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880092f71500 x1830965174593664/t4294967861(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:519/0 lens 496/448 e 0 to 0 dl 1746144889 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144878.384890:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f71500 with x1830965174593664 ext(0->7) 00010000:00010000:0.0:1746144878.384894:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009170ba00/0x4076af6727513219 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92c84 expref: 11 pid: 8432 timeout: 572 lvb_type: 0 00010000:00010000:0.0:1746144878.384903:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009170ba00/0x4076af6727513219 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92c84 expref: 11 pid: 8432 timeout: 572 lvb_type: 0 00002000:00010000:0.0:1746144878.384908:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f71500 00000100:00100000:0.0:1746144878.387246:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.392885:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.395899:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.395936:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.395966:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174594432 00000100:00100000:0.0:1746144878.395970:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174594432 00010000:00010000:0.0:1746144878.395991:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093f04c00/0x4076af6727513220 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92c8b expref: 6 pid: 8432 timeout: 572 lvb_type: 0 00000100:00100000:0.0:1746144878.396074:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9832 00000100:00100000:0.0:1746144878.396090:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965174594432:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144878.396100:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144878.396510:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093f04c00/0x4076af6727513220 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92c8b expref: 6 pid: 8432 timeout: 572 lvb_type: 0 00010000:00010000:0.0:1746144878.396520:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093f04c00/0x4076af6727513220 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92c8b expref: 6 pid: 8432 timeout: 572 lvb_type: 0 00010000:00010000:0.0:1746144878.396537:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f04c00/0x4076af6727513220 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92c8b expref: 6 pid: 8432 timeout: 572 lvb_type: 0 00010000:00010000:0.0:1746144878.396627:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144878.396656:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965174594432:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 577us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144878.396662:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9832 00000100:00100000:0.0:1746144878.398125:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.400913:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.406103:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.409532:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.417254:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.418416:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.424655:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.429744:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.435515:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.445104:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.473581:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174596608 00000100:00100000:0.0:1746144878.473593:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174596608 00010000:00010000:0.0:1746144878.473632:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800929f3600/0x4076af672751323c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92ca7 expref: 14 pid: 10401 timeout: 572 lvb_type: 0 00000100:00100000:0.0:1746144878.485110:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172166144 00000100:00100000:0.0:1746144878.485117:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172166144 00000100:00100000:0.0:1746144878.485224:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4422 00000100:00100000:0.0:1746144878.485231:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172166144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1746144878.485251:0:8432:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:24 count 1 00010000:00010000:0.0:1746144878.485268:0:8432:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091752e00/0x4076af6727513251 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144878.485281:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099a72e00/0x4076af6727513044 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92b34 expref: 5 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144878.485288:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144878.485289:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144878.485291:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091752e00/0x4076af6727513251 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144878.485311:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099a72e00/0x4076af6727513044 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92b34 expref: 5 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144878.485318:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099a72e00/0x4076af6727513044 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92b34 expref: 5 pid: 10401 timeout: 572 lvb_type: 1 00000100:00100000:0.0:1746144878.485331:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172166272:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144878.485370:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144878.485954:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.488416:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.493915:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.496923:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.503331:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.503410:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.503431:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174598016 00000100:00100000:0.0:1746144878.503438:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174598016 00002000:00100000:0.0:1746144878.503475:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925a9180 x1830965174598016/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:519/0 lens 488/0 e 0 to 0 dl 1746144889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144878.503484:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9180 with x1830965174598016 ext(0->4095) 00002000:00010000:0.0:1746144878.503488:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925a9180 00000100:00100000:0.0:1746144878.503507:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3503 00000100:00100000:0.0:1746144878.503514:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174598016:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144878.503664:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174598016:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 151us (253us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144878.503671:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3503 00002000:00100000:0.0:1746144878.503676:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925a9180 x1830965174598016/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746144889 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144878.503683:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9180 with x1830965174598016 ext(0->4095) 00002000:00010000:0.0:1746144878.503685:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925a9180 00000100:00100000:0.0:1746144878.508346:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.509962:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.515257:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.522091:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.527240:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174598912 00000100:00100000:0.0:1746144878.527245:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174598912 00002000:00100000:0.0:1746144878.527275:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181d880 x1830965174598912/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:519/0 lens 488/0 e 0 to 0 dl 1746144889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144878.527284:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181d880 with x1830965174598912 ext(0->4095) 00002000:00010000:0.0:1746144878.527292:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009181d880 00000100:00100000:0.0:1746144878.527316:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3504 00000100:00100000:0.0:1746144878.527321:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+13:1985:x1830965174598912:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144878.527446:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+13:1985:x1830965174598912:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 125us (265us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144878.527452:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3504 00002000:00100000:0.0:1746144878.527456:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181d880 x1830965174598912/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746144889 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144878.527463:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181d880 with x1830965174598912 ext(0->4095) 00002000:00010000:0.0:1746144878.527465:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009181d880 00000100:00100000:0.0:1746144878.533477:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.537830:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.538269:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.541405:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.541463:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.547302:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.555318:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.561840:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.566353:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.570321:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.574250:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.575260:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.579893:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.581847:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.585434:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.591032:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.594918:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.597340:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.601404:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.605219:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.605290:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.610695:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.613550:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.618315:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.621848:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.627095:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.630164:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.635732:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.636581:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.643870:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.649100:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.655232:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.661548:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.686973:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.694677:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.699544:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.703429:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.707831:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.709984:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.713952:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.719182:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.723433:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.726000:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.729846:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.733137:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.734423:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.738861:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.740412:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174607104 00000100:00100000:0.0:1746144878.740415:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174607104 00010000:00010000:0.0:1746144878.740435:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af67275132cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92d33 expref: 6 pid: 8430 timeout: 572 lvb_type: 0 00000100:00100000:0.0:1746144878.740462:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9857 00000100:00100000:0.0:1746144878.740466:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174607104:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144878.740475:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144878.740493:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af67275132cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92d33 expref: 6 pid: 8430 timeout: 572 lvb_type: 0 00010000:00010000:0.0:1746144878.740501:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af67275132cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92d33 expref: 6 pid: 8430 timeout: 572 lvb_type: 0 00010000:00010000:0.0:1746144878.740517:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af67275132cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92d33 expref: 6 pid: 8430 timeout: 572 lvb_type: 0 00010000:00010000:0.0:1746144878.740541:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144878.740543:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144878.740549:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275132d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92d3a expref: 15 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144878.740556:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275132d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92d3a expref: 15 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144878.740578:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275132d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92d3a expref: 15 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144878.740586:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275132d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92d3a expref: 15 pid: 8430 timeout: 572 lvb_type: 0 00000100:00100000:0.0:1746144878.740595:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d367b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172171392:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144878.740677:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144878.744376:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.749465:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.753955:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.756891:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.760639:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.764423:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174608256 00000100:00100000:0.0:1746144878.764431:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174608256 00002000:00100000:0.0:1746144878.764466:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f71180 x1830965174608256/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:519/0 lens 488/0 e 0 to 0 dl 1746144889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144878.764474:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f71180 with x1830965174608256 ext(0->4095) 00002000:00010000:0.0:1746144878.764479:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f71180 00000100:00100000:0.0:1746144878.764516:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3514 00000100:00100000:0.0:1746144878.764522:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174608256:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144878.764670:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174608256:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 147us (570us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144878.764677:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3514 00002000:00100000:0.0:1746144878.764682:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f71180 x1830965174608256/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746144889 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144878.764689:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f71180 with x1830965174608256 ext(0->4095) 00002000:00010000:0.0:1746144878.764691:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f71180 00000100:00100000:0.0:1746144878.773257:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.777700:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.783056:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.785675:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.788959:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.791438:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.796073:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.798846:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.804401:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.809805:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174610432 00000100:00100000:0.0:1746144878.809811:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174610432 00002000:00100000:0.0:1746144878.809845:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181c700 x1830965174610432/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:519/0 lens 488/0 e 0 to 0 dl 1746144889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144878.809852:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181c700 with x1830965174610432 ext(0->4095) 00010000:00010000:0.0:1746144878.809859:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091ceb000/0x4076af6727513300 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92d64 expref: 16 pid: 10401 timeout: 572 lvb_type: 0 00010000:00010000:0.0:1746144878.810106:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091ceb000/0x4076af6727513300 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92d64 expref: 16 pid: 10401 timeout: 572 lvb_type: 0 00002000:00010000:0.0:1746144878.810114:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181c700 00000100:00100000:0.0:1746144878.810205:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1376 00000100:00100000:0.0:1746144878.810212:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1984:x1830965174610432:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144878.810341:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1984:x1830965174610432:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 130us (619us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144878.810346:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1376 00002000:00100000:0.0:1746144878.810351:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181c700 x1830965174610432/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746144889 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144878.810358:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181c700 with x1830965174610432 ext(0->4095) 00010000:00010000:0.0:1746144878.810363:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091ceb000/0x4076af6727513300 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92d64 expref: 16 pid: 10401 timeout: 572 lvb_type: 0 00010000:00010000:0.0:1746144878.810371:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091ceb000/0x4076af6727513300 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92d64 expref: 16 pid: 10401 timeout: 572 lvb_type: 0 00002000:00010000:0.0:1746144878.810376:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181c700 00000100:00100000:0.0:1746144878.813892:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.818726:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.823659:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.832127:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.838852:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.842134:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.849236:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.854417:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.854759:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.860355:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.864536:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.864587:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.868929:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.871411:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.871468:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.875569:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.880112:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.884050:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.886927:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.890930:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.894422:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174614016 00000100:00100000:0.0:1746144878.894430:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174614016 00002000:00100000:0.0:1746144878.894466:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181fb80 x1830965174614016/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:519/0 lens 488/0 e 0 to 0 dl 1746144889 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144878.894475:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181fb80 with x1830965174614016 ext(0->4095) 00002000:00010000:0.0:1746144878.894478:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009181fb80 00000100:00100000:0.0:1746144878.894503:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3520 00000100:00100000:0.0:1746144878.894508:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174614016:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144878.894638:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174614016:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 130us (434us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144878.894643:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3520 00002000:00100000:0.0:1746144878.894648:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181fb80 x1830965174614016/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:519/0 lens 488/4536 e 0 to 0 dl 1746144889 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144878.894654:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181fb80 with x1830965174614016 ext(0->4095) 00002000:00010000:0.0:1746144878.894657:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009181fb80 00000100:00100000:0.0:1746144878.897681:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.899694:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.907390:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.911136:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.917183:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.919539:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.925587:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.926093:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.931461:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.936584:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.940400:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.949387:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.959021:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.966500:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.971378:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.979619:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.982725:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.987349:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144878.999256:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.009511:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.010404:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.015643:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144879.016596:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144879.019365:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174618112 00000100:00100000:0.0:1746144879.019373:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174618112 00010000:00010000:0.0:1746144879.019399:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800927d1600/0x4076af6727513362 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92dc6 expref: 6 pid: 20722 timeout: 573 lvb_type: 0 00000100:00100000:0.0:1746144879.019431:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9878 00000100:00100000:0.0:1746144879.019439:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174618112:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144879.019449:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144879.019466:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800927d1600/0x4076af6727513362 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92dc6 expref: 6 pid: 20722 timeout: 573 lvb_type: 0 00010000:00010000:0.0:1746144879.019477:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800927d1600/0x4076af6727513362 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92dc6 expref: 6 pid: 20722 timeout: 573 lvb_type: 0 00010000:00010000:0.0:1746144879.019719:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927d1600/0x4076af6727513362 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92dc6 expref: 6 pid: 20722 timeout: 573 lvb_type: 0 00010000:00010000:0.0:1746144879.019930:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144879.019932:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144879.019938:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927d0c00/0x4076af6727513369 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92dcd expref: 20 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.019945:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927d0c00/0x4076af6727513369 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92dcd expref: 20 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.019973:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800927d0c00/0x4076af6727513369 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92dcd expref: 20 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144879.019987:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093442a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172176640:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144879.020795:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144879.022887:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.025845:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.029823:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.033666:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.035879:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.040502:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.042866:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.047352:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.051117:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.056976:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.060498:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.064182:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.067526:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.068528:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.072649:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.073822:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.079471:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.082527:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.092573:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.100819:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.100902:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.111447:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.114158:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.134994:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174622592 00000100:00100000:0.0:1746144879.135003:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174622592 00000100:00100000:0.0:1746144879.135041:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4471 00000100:00100000:0.0:1746144879.135048:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174622592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144879.135064:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144879.135089:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275133a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92e0c expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.135113:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275133a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e05 expref: 20 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.135120:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144879.135122:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144879.135125:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275133a8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e0c expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.136091:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275133a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e05 expref: 20 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.136102:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275133a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e05 expref: 20 pid: 8432 timeout: 573 lvb_type: 0 00000100:00100000:0.0:1746144879.136114:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172178816:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144879.136198:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144879.140135:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.142579:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.147510:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.149457:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.152326:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.153786:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.156969:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.160583:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.164499:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.167126:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.172107:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.177091:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.177189:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.180517:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.181546:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.185975:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.188719:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.191963:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.197429:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.201732:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.204316:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.208406:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.215692:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.220377:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.225599:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.225646:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.230347:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801362ac380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172180992:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144879.230366:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144879.231386:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1984:x1830965174627072:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5444us (5736us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144879.231395:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9895 00000100:00100000:0.0:1746144879.232503:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.235975:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.241155:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174627712 00000100:00100000:0.0:1746144879.241163:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174627712 00002000:00100000:0.0:1746144879.241195:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38c000 x1830965174627712/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:520/0 lens 488/0 e 0 to 0 dl 1746144890 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144879.241204:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38c000 with x1830965174627712 ext(0->4095) 00002000:00010000:0.0:1746144879.241207:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f38c000 00000100:00100000:0.0:1746144879.241230:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3533 00000100:00100000:0.0:1746144879.241236:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965174627712:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144879.241375:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965174627712:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 139us (484us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144879.241380:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3533 00002000:00100000:0.0:1746144879.241385:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38c000 x1830965174627712/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:520/0 lens 488/4536 e 0 to 0 dl 1746144890 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144879.241391:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38c000 with x1830965174627712 ext(0->4095) 00002000:00010000:0.0:1746144879.241393:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f38c000 00000100:00100000:0.0:1746144879.244015:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.246314:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.252883:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.256472:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.261240:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.263579:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.267084:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.269322:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.273804:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.276692:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.277723:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.278818:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.280648:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.284102:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.287423:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174630528 00000100:00100000:0.0:1746144879.287429:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174630528 00010000:00010000:0.0:1746144879.287452:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099a73e00/0x4076af672751340a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e6e expref: 24 pid: 8432 timeout: 573 lvb_type: 0 00000100:00100000:0.0:1746144879.287526:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9902 00000100:00100000:0.0:1746144879.287532:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1982:x1830965174630528:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144879.287542:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144879.287557:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099a73e00/0x4076af672751340a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e6e expref: 24 pid: 8432 timeout: 573 lvb_type: 0 00010000:00010000:0.0:1746144879.287566:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099a73e00/0x4076af672751340a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e6e expref: 24 pid: 8432 timeout: 573 lvb_type: 0 00010000:00010000:0.0:1746144879.287583:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099a73e00/0x4076af672751340a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e6e expref: 24 pid: 8432 timeout: 573 lvb_type: 0 00010000:00010000:0.0:1746144879.287605:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144879.287607:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144879.287613:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad30c00/0x4076af6727513411 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e75 expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.287619:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad30c00/0x4076af6727513411 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e75 expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.287646:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad30c00/0x4076af6727513411 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e75 expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144879.287655:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e87b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172182784:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144879.288498:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144879.291809:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.294922:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.297899:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.302602:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.309461:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.311259:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.316959:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.321559:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174632064 00000100:00100000:0.0:1746144879.321567:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174632064 00010000:00010000:0.0:1746144879.321595:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099a73c00/0x4076af672751341f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e83 expref: 24 pid: 8432 timeout: 573 lvb_type: 0 00000100:00100000:0.0:1746144879.321624:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9905 00000100:00100000:0.0:1746144879.321631:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801362af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1983:x1830965174632064:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144879.321641:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144879.321658:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099a73c00/0x4076af672751341f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e83 expref: 24 pid: 8432 timeout: 573 lvb_type: 0 00010000:00010000:0.0:1746144879.321668:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099a73c00/0x4076af672751341f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e83 expref: 24 pid: 8432 timeout: 573 lvb_type: 0 00010000:00010000:0.0:1746144879.321689:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099a73c00/0x4076af672751341f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e83 expref: 24 pid: 8432 timeout: 573 lvb_type: 0 00010000:00010000:0.0:1746144879.321711:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144879.321714:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144879.321719:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af6727513426 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e8a expref: 23 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.321726:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af6727513426 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e8a expref: 23 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.321750:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af6727513426 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e8a expref: 23 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144879.321759:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b460e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172183552:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144879.321826:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144879.325089:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.328529:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174632448 00000100:00100000:0.0:1746144879.328536:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174632448 00000100:00100000:0.0:1746144879.328580:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4490 00000100:00100000:0.0:1746144879.328587:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174632448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144879.328602:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144879.328615:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752200/0x4076af672751342d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92e91 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.328637:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af6727513426 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e8a expref: 22 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.328645:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144879.328646:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144879.328649:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752200/0x4076af672751342d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e91 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.328672:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af6727513426 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e8a expref: 22 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.328682:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af6727513426 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92e8a expref: 22 pid: 8432 timeout: 573 lvb_type: 0 00000100:00100000:0.0:1746144879.328693:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b462d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172183680:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144879.328782:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144879.331722:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.337458:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.337526:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.343647:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.347938:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.353250:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.363028:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.367494:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.368524:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.373712:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.379861:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.383952:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.395235:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.418945:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.420494:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.427122:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.433498:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.439080:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.442640:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.450518:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.468731:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.468842:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.478176:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.478219:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174636544 00000100:00100000:0.0:1746144879.478226:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174636544 00010000:00010000:0.0:1746144879.478258:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099a73200/0x4076af6727513457 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92ebb expref: 28 pid: 8432 timeout: 573 lvb_type: 0 00000100:00100000:0.0:1746144879.478293:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9913 00000100:00100000:0.0:1746144879.478301:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1985:x1830965174636544:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144879.478313:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144879.478332:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099a73200/0x4076af6727513457 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92ebb expref: 28 pid: 8432 timeout: 573 lvb_type: 0 00010000:00010000:0.0:1746144879.478342:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099a73200/0x4076af6727513457 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92ebb expref: 28 pid: 8432 timeout: 573 lvb_type: 0 00010000:00010000:0.0:1746144879.478360:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099a73200/0x4076af6727513457 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92ebb expref: 28 pid: 8432 timeout: 573 lvb_type: 0 00010000:00010000:0.0:1746144879.478377:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144879.478379:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144879.478385:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad31400/0x4076af672751345e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92ec2 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.478391:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad31400/0x4076af672751345e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92ec2 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.478433:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad31400/0x4076af672751345e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92ec2 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.478442:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ad31400/0x4076af672751345e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92ec2 expref: 5 pid: 10401 timeout: 573 lvb_type: 0 00000100:00100000:0.0:1746144879.478452:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bae2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172185728:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144879.481683:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.481931:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144879.481955:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bae2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172185728:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144879.481974:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144879.482009:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1985:x1830965174636544:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3708us (3840us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144879.482017:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9913 00000100:00100000:0.0:1746144879.488660:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.494229:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.497870:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.502962:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.504423:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.506984:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.512129:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.515737:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.518824:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.521968:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.527536:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.530354:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.532862:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.534107:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.537865:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.541537:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.544469:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.550608:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.554804:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.557598:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.559231:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.562622:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.562915:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.567943:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.572042:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.577450:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093369c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172187904:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144879.577474:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144879.577524:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+29:1983:x1830965174641152:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5049us (5487us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144879.577533:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9922 00000100:00100000:0.0:1746144879.581015:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.585899:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.585972:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.589223:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.592602:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.595406:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.599540:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.620674:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.644439:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.655659:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.662363:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.666374:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.671870:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.684515:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.710871:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.716460:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.721014:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.726677:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.732602:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.739852:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.742462:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.746008:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.751973:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174645120 00000100:00100000:0.0:1746144879.751981:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174645120 00000100:00100000:0.0:1746144879.752338:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4514 00000100:00100000:0.0:1746144879.752347:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+33:31565:x1830965174645120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144879.752363:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144879.752378:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275134d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92f39 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.752400:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad31400/0x4076af67275134ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f32 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.752408:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144879.752409:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144879.752412:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275134d5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f39 expref: 34 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.752439:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad31400/0x4076af67275134ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f32 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.752448:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ad31400/0x4076af67275134ce lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f32 expref: 5 pid: 20722 timeout: 573 lvb_type: 0 00000100:00100000:0.0:1746144879.752458:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb4b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172189824:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144879.753274:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144879.755102:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.758610:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.758706:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.761731:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.764545:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.765204:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.768899:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.772736:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.777676:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.782305:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.785118:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.795493:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.800343:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.804540:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.812323:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.816445:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.820505:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.823821:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.831715:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.837006:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.864688:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.879444:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.879494:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.885643:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.892671:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.898402:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.909041:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.913080:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.918446:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.922426:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174650624 00000100:00100000:0.0:1746144879.922432:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174650624 00010000:00010000:0.0:1746144879.922460:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099a73e00/0x4076af672751350d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f71 expref: 40 pid: 8432 timeout: 574 lvb_type: 0 00000100:00100000:0.0:1746144879.922526:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9939 00000100:00100000:0.0:1746144879.922533:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1985:x1830965174650624:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144879.922543:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144879.922561:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099a73e00/0x4076af672751350d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f71 expref: 40 pid: 8432 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144879.922572:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099a73e00/0x4076af672751350d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f71 expref: 40 pid: 8432 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144879.922591:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099a73e00/0x4076af672751350d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f71 expref: 40 pid: 8432 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144879.923182:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144879.923184:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144879.923191:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af6727513514 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f78 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.923199:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af6727513514 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f78 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.923227:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af6727513514 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f78 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.923237:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af6727513514 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f78 expref: 5 pid: 8432 timeout: 574 lvb_type: 0 00000100:00100000:0.0:1746144879.923247:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a417c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172192384:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144879.923313:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144879.925514:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.931456:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.935238:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.947541:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.958835:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.973304:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174651648 00000100:00100000:0.0:1746144879.973312:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174651648 00010000:00010000:0.0:1746144879.973343:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af672751351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f7f expref: 41 pid: 8432 timeout: 574 lvb_type: 0 00000100:00100000:0.0:1746144879.973381:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9941 00000100:00100000:0.0:1746144879.973388:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1984:x1830965174651648:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144879.973401:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144879.973419:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af672751351b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f7f expref: 41 pid: 8432 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144879.973430:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af672751351b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f7f expref: 41 pid: 8432 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144879.973449:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af672751351b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f7f expref: 41 pid: 8432 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144879.973473:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144879.973475:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144879.973481:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad30e00/0x4076af6727513522 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f86 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.973487:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad30e00/0x4076af6727513522 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f86 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144879.973514:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad30e00/0x4076af6727513522 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92f86 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144879.973525:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a417c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172192768:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144879.973603:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144879.976401:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.978499:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.978532:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a417c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172192768:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144879.978543:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144879.978565:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+42:1984:x1830965174651648:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5178us (6210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144879.978572:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9941 00000100:00100000:0.0:1746144879.982985:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.986286:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.990144:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.993569:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144879.996611:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.001829:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.038569:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.041802:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.043113:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.054021:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.057409:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.062564:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174654208 00000100:00100000:0.0:1746144880.062571:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174654208 00000100:00100000:0.0:1746144880.062613:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4530 00000100:00100000:0.0:1746144880.062619:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174654208:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144880.062632:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144880.062644:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513545 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92fa9 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.062666:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a72e00/0x4076af672751353e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92fa2 expref: 42 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.062672:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144880.062674:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144880.062677:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513545 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92fa9 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.062697:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099a72e00/0x4076af672751353e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92fa2 expref: 42 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.062706:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099a72e00/0x4076af672751353e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92fa2 expref: 42 pid: 8432 timeout: 574 lvb_type: 0 00000100:00100000:0.0:1746144880.062714:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092586300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172193920:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144880.062796:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144880.066100:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.069374:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.069489:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.073739:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.073937:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.079562:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.084227:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.084699:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9948 00000100:00100000:0.0:1746144880.084712:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965174655360:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144880.084723:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144880.084742:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ad30c00/0x4076af672751354c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92fb0 expref: 44 pid: 20722 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144880.084756:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ad30c00/0x4076af672751354c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92fb0 expref: 44 pid: 20722 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144880.084808:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad30c00/0x4076af672751354c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92fb0 expref: 44 pid: 20722 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144880.084834:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144880.084835:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144880.084842:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a73200/0x4076af6727513553 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92fb7 expref: 43 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.084850:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099a73200/0x4076af6727513553 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92fb7 expref: 43 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.084882:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099a73200/0x4076af6727513553 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92fb7 expref: 43 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144880.084892:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c28700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172194560:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144880.084971:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144880.087614:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.090482:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.093551:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.099278:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.101838:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.106197:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.110950:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.116572:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.124117:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.130471:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.135601:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.143667:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.143715:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.149970:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.153330:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.157136:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.157184:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.161107:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.162822:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.166795:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.169868:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.172567:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.175843:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.179568:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.183076:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174659712 00000100:00100000:0.0:1746144880.183083:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174659712 00000100:00100000:0.0:1746144880.183110:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4541 00000100:00100000:0.0:1746144880.183116:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965174659712:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144880.183130:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144880.183141:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513592 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af92ff6 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.183161:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad30c00/0x4076af672751358b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92fef expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.183171:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144880.183172:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144880.183175:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513592 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92ff6 expref: 45 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.183195:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad30c00/0x4076af672751358b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92fef expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.183205:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ad30c00/0x4076af672751358b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92fef expref: 6 pid: 10401 timeout: 574 lvb_type: 0 00000100:00100000:0.0:1746144880.183213:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb4b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172196736:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144880.183271:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144880.184894:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.184928:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.186627:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.188827:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.190555:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.192623:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.195760:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.199119:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.201687:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.201755:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.204858:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.209851:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.212384:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.215805:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.218133:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.219597:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.222580:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.224560:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.227074:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.227216:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.231291:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.234196:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.237842:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.246097:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.249897:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.252184:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.258002:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.263273:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.265339:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.269234:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.274572:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.277023:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.277836:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.282122:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.282142:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174665728 00000100:00100000:0.0:1746144880.282147:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174665728 00002000:00100000:0.0:1746144880.282179:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181dc00 x1830965174665728/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:521/0 lens 488/0 e 0 to 0 dl 1746144891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144880.282187:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181dc00 with x1830965174665728 ext(0->4095) 00010000:00010000:0.0:1746144880.282193:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af67275135d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9303c expref: 47 pid: 8432 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144880.282204:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af67275135d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9303c expref: 47 pid: 8432 timeout: 574 lvb_type: 0 00002000:00010000:0.0:1746144880.282210:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181dc00 00000100:00100000:0.0:1746144880.282223:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1444 00000100:00100000:0.0:1746144880.282229:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+47:1984:x1830965174665728:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144880.282370:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+47:1984:x1830965174665728:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 140us (250us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144880.282376:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1444 00002000:00100000:0.0:1746144880.282381:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181dc00 x1830965174665728/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746144891 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144880.282387:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181dc00 with x1830965174665728 ext(0->4095) 00010000:00010000:0.0:1746144880.282391:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af67275135d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9303c expref: 47 pid: 8432 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144880.282399:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af67275135d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9303c expref: 47 pid: 8432 timeout: 574 lvb_type: 0 00002000:00010000:0.0:1746144880.282404:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181dc00 00000100:00100000:0.0:1746144880.284828:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.285149:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.288548:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.292836:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.296828:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.304316:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.306879:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.307917:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.312858:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.315681:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.324914:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.329696:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.342109:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.342259:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.348435:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.352132:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.356301:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.360908:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.364738:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.369522:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.374104:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.386079:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.386121:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.394814:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.400432:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.406882:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.415191:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.422760:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.432973:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.436911:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.436953:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174670848 00000100:00100000:0.0:1746144880.436959:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174670848 00000100:00100000:0.0:1746144880.437012:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4562 00000100:00100000:0.0:1746144880.437020:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+51:31565:x1830965174670848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144880.437038:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144880.437056:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513625 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93089 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.437813:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092552800/0x4076af672751361e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93082 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.437822:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144880.437824:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144880.437828:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513625 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93089 expref: 52 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.437862:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092552800/0x4076af672751361e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93082 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.437876:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092552800/0x4076af672751361e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93082 expref: 5 pid: 8430 timeout: 574 lvb_type: 0 00000100:00100000:0.0:1746144880.437888:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172202112:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144880.441729:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144880.441776:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174671104 00000100:00100000:0.0:1746144880.441784:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174671104 00002000:00100000:0.0:1746144880.441836:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f72a00 x1830965174671104/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:521/0 lens 488/0 e 0 to 0 dl 1746144891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144880.441846:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f72a00 with x1830965174671104 ext(0->4095) 00010000:00010000:0.0:1746144880.441856:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092552800/0x4076af672751361e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93082 expref: 6 pid: 8430 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144880.441871:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092552800/0x4076af672751361e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93082 expref: 6 pid: 8430 timeout: 574 lvb_type: 0 00002000:00010000:0.0:1746144880.441878:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f72a00 00000100:00100000:0.0:1746144880.441908:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1452 00000100:00100000:0.0:1746144880.441914:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174671104:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144880.442406:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174671104:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 490us (3036us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144880.442414:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1452 00002000:00100000:0.0:1746144880.442625:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f72a00 x1830965174671104/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746144891 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144880.442633:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f72a00 with x1830965174671104 ext(0->4095) 00010000:00010000:0.0:1746144880.442640:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092552800/0x4076af672751361e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93082 expref: 6 pid: 8430 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144880.442649:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092552800/0x4076af672751361e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93082 expref: 6 pid: 8430 timeout: 574 lvb_type: 0 00002000:00010000:0.0:1746144880.442655:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f72a00 00000100:00100000:0.0:1746144880.442693:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172202112:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144880.442715:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513625 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93089 expref: 51 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.442728:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:0.0:1746144880.442782:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+51:31565:x1830965174670848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5743us (5855us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144880.442789:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4562 00000100:00100000:0.0:1746144880.448926:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.455177:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.465884:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.474515:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.479902:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.486271:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.491374:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.491630:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174672256 00000100:00100000:0.0:1746144880.491636:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174672256 00002000:00100000:0.0:1746144880.491678:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932aaa00 x1830965174672256/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:521/0 lens 488/0 e 0 to 0 dl 1746144891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144880.491687:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932aaa00 with x1830965174672256 ext(0->4095) 00010000:00010000:0.0:1746144880.491693:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ad30e00/0x4076af672751362c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93090 expref: 6 pid: 8430 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144880.491704:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ad30e00/0x4076af672751362c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93090 expref: 6 pid: 8430 timeout: 574 lvb_type: 0 00002000:00010000:0.0:1746144880.491710:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932aaa00 00000100:00100000:0.0:1746144880.491729:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1454 00000100:00100000:0.0:1746144880.491736:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174672256:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144880.491920:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174672256:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 183us (556us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144880.491930:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1454 00002000:00100000:0.0:1746144880.491936:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932aaa00 x1830965174672256/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746144891 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144880.491943:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932aaa00 with x1830965174672256 ext(0->4095) 00010000:00010000:0.0:1746144880.491947:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ad30e00/0x4076af672751362c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93090 expref: 6 pid: 8430 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144880.491957:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ad30e00/0x4076af672751362c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93090 expref: 6 pid: 8430 timeout: 574 lvb_type: 0 00002000:00010000:0.0:1746144880.491962:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932aaa00 00000100:00100000:0.0:1746144880.493380:0:3309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1830965172203008:0@lo:400:kworker.0 00000100:00100000:0.0:1746144880.493426:0:3309:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144880.493452:0:3309:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746144880.493457:0:3309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1830965172202880:0@lo:400:kworker.0 00000100:00100000:0.0:1746144880.493487:0:3309:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144880.493501:0:3309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172203392:0@lo:400:kworker.0 00000100:00100000:0.0:1746144880.493520:0:3309:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144880.493539:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172202752 00000100:00100000:0.0:1746144880.493542:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172202752 00000100:00100000:0.0:1746144880.493560:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1746144880.493564:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2566f13b-362a-4e88-b0dd-c558bbe87895+18:3307:x1830965172202752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144880.493586:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2566f13b-362a-4e88-b0dd-c558bbe87895+18:3307:x1830965172202752:12345-0@lo:400:kworker.0 Request processed in 22us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144880.493591:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00080000:0.0:1746144880.493610:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144880.493631:0:3309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1830965172202880:0@lo:400:kworker.0 00000100:00100000:0.0:1746144880.493639:0:3309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1830965172203008:0@lo:400:kworker.0 00000100:00080000:0.0:1746144880.495237:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746144880.495240:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746144880.495242:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144880.496697:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.501170:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.507048:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.532520:0:3309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172203776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746144880.532591:0:3309:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144880.533003:0:3309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172203776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746144880.533352:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.537108:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.547056:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.557177:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.563233:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.568660:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.571044:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.575989:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.580476:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.585058:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.585558:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.587956:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.589619:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.592576:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.596753:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.601922:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.604276:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.606850:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.609644:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.613354:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.614251:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.616084:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.619276:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.621252:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.628386:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.631324:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.636400:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.639892:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.640495:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.644854:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.645547:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.654649:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.662482:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.666291:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.670757:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.671959:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.676033:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.677355:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.679963:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.685894:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.689566:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.702425:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.725888:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.730602:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.736394:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.739872:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:0.0:1746144880.740852:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144880.740881:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af672751369c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93100 expref: 6 pid: 10401 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144880.740893:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af672751369c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93100 expref: 6 pid: 10401 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144880.740925:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af672751369c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93100 expref: 6 pid: 10401 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144880.740964:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144880.740966:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144880.740973:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a73200/0x4076af67275136a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93107 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.740990:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099a73200/0x4076af67275136a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93107 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144880.748882:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.752421:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.754542:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.757235:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172208000:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144880.757256:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144880.757304:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1984:x1830965174681472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4721us (4881us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144880.757318:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9997 00000100:00100000:0.0:1746144880.761705:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.764476:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.767940:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.772219:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.775848:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.779170:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.783210:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.786737:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.788557:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.793950:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.793998:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.797867:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.800816:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.804914:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.810321:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.816489:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.816711:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.821017:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174684928 00000100:00100000:0.0:1746144880.821024:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174684928 00002000:00100000:0.0:1746144880.821085:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368000 x1830965174684928/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:521/0 lens 488/0 e 0 to 0 dl 1746144891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144880.821095:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368000 with x1830965174684928 ext(0->4095) 00010000:00010000:0.0:1746144880.821102:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af67275136d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93138 expref: 6 pid: 10401 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144880.821118:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af67275136d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93138 expref: 6 pid: 10401 timeout: 574 lvb_type: 0 00002000:00010000:0.0:1746144880.821124:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093368000 00000100:00100000:0.0:1746144880.821999:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1471 00000100:00100000:0.0:1746144880.822007:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174684928:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144880.822206:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174684928:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 201us (1493us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144880.822212:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1471 00002000:00100000:0.0:1746144880.822217:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368000 x1830965174684928/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746144891 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144880.822224:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368000 with x1830965174684928 ext(0->4095) 00010000:00010000:0.0:1746144880.822230:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af67275136d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93138 expref: 6 pid: 10401 timeout: 574 lvb_type: 0 00010000:00010000:0.0:1746144880.822238:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af67275136d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93138 expref: 6 pid: 10401 timeout: 574 lvb_type: 0 00002000:00010000:0.0:1746144880.822243:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093368000 00000100:00100000:0.0:1746144880.825364:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.829078:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.829140:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174685312 00000100:00100000:0.0:1746144880.829146:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174685312 00002000:00100000:0.0:1746144880.829180:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea4e00 x1830965174685312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:521/0 lens 488/0 e 0 to 0 dl 1746144891 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144880.829190:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4e00 with x1830965174685312 ext(0->4095) 00002000:00010000:0.0:1746144880.829195:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea4e00 00000100:00100000:0.0:1746144880.829210:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3585 00000100:00100000:0.0:1746144880.829216:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1983:x1830965174685312:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:0.0:1746144880.829365:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1983:x1830965174685312:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 149us (288us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144880.829371:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3585 00002000:00100000:0.0:1746144880.829375:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea4e00 x1830965174685312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:521/0 lens 488/4536 e 0 to 0 dl 1746144891 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144880.829381:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4e00 with x1830965174685312 ext(0->4095) 00002000:00010000:0.0:1746144880.829384:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea4e00 00000100:00100000:0.0:1746144880.835344:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.846569:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.851441:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.854106:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.861249:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.866507:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.871538:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174686592 00000100:00100000:0.0:1746144880.871548:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174686592 00000100:00100000:0.0:1746144880.871601:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4591 00000100:00100000:0.0:1746144880.871609:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174686592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144880.871628:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144880.871645:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275136f0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93154 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.871673:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091cebc00/0x4076af67275136e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9314d expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.871680:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144880.871682:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144880.871685:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275136f0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93154 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.871716:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091cebc00/0x4076af67275136e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9314d expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144880.871728:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091cebc00/0x4076af67275136e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9314d expref: 60 pid: 10401 timeout: 575 lvb_type: 0 00000100:00100000:0.0:1746144880.871739:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172210432:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144880.871842:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144880.879447:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.882654:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.886389:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.893370:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.897076:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.904808:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.913839:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.922192:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.929030:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.929114:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.934356:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.940373:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.943674:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.947430:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.947550:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.951682:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.955014:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.959504:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.963455:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.963558:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.972425:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.976687:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.981049:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144880.990384:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.002434:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144881.003344:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144881.008186:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144881.009833:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144881.015542:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.018934:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.023722:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.028332:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.034612:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.034725:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.041087:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.047141:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.047200:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.054635:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.055280:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.061371:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.064987:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.069418:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.071835:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.074115:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.080379:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.085371:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.092328:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.095886:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.100607:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.108186:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.110981:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.113325:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.118152:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.129873:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.136867:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.136926:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.144384:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.149453:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.152983:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.160581:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.162884:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.168081:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.169594:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.178845:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.178935:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.182206:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.186610:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.193981:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.197512:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.200298:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.203298:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.207508:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.207559:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.212111:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.214845:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.215790:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.220387:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.222888:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.227854:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.230383:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.239167:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.239222:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.242872:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.248602:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.252219:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.257260:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.274607:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.299698:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.303908:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174702720 00000100:00100000:0.0:1746144881.303915:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174702720 00002000:00100000:0.0:1746144881.303953:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2f800 x1830965174702720/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:522/0 lens 488/0 e 0 to 0 dl 1746144892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144881.303962:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2f800 with x1830965174702720 ext(0->4095) 00010000:00010000:0.0:1746144881.303970:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092553e00/0x4076af67275137c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93226 expref: 6 pid: 20722 timeout: 575 lvb_type: 0 00010000:00010000:0.0:1746144881.303982:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092553e00/0x4076af67275137c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93226 expref: 6 pid: 20722 timeout: 575 lvb_type: 0 00002000:00010000:0.0:1746144881.303988:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2f800 00000100:00100000:0.0:1746144881.304084:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1496 00000100:00100000:0.0:1746144881.304091:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174702720:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144881.304251:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174702720:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 161us (1219us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144881.304258:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1496 00002000:00100000:0.0:1746144881.304263:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2f800 x1830965174702720/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746144892 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144881.304270:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2f800 with x1830965174702720 ext(0->4095) 00010000:00010000:0.0:1746144881.304274:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880092553e00/0x4076af67275137c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93226 expref: 6 pid: 20722 timeout: 575 lvb_type: 0 00010000:00010000:0.0:1746144881.304283:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880092553e00/0x4076af67275137c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93226 expref: 6 pid: 20722 timeout: 575 lvb_type: 0 00002000:00010000:0.0:1746144881.304288:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2f800 00000100:00100000:0.0:1746144881.311094:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.319413:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.348690:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.360645:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.365343:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.367262:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.376590:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.380861:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.389712:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.404432:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.408741:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.416151:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.419427:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.424436:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.431127:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.434153:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.438604:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.441542:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.446289:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174706048 00000100:00100000:0.0:1746144881.446296:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174706048 00002000:00100000:0.0:1746144881.446332:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2c700 x1830965174706048/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:522/0 lens 488/0 e 0 to 0 dl 1746144892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144881.446341:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2c700 with x1830965174706048 ext(0->4095) 00010000:00010000:0.0:1746144881.446347:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275137ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93250 expref: 6 pid: 10401 timeout: 575 lvb_type: 0 00010000:00010000:0.0:1746144881.446359:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275137ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93250 expref: 6 pid: 10401 timeout: 575 lvb_type: 0 00002000:00010000:0.0:1746144881.446365:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2c700 00000100:00100000:0.0:1746144881.446378:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1500 00000100:00100000:0.0:1746144881.446383:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174706048:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144881.446524:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174706048:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 141us (650us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144881.446529:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1500 00002000:00100000:0.0:1746144881.446533:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2c700 x1830965174706048/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746144892 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144881.446540:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2c700 with x1830965174706048 ext(0->4095) 00010000:00010000:0.0:1746144881.446544:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275137ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93250 expref: 6 pid: 10401 timeout: 575 lvb_type: 0 00010000:00010000:0.0:1746144881.446552:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275137ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93250 expref: 6 pid: 10401 timeout: 575 lvb_type: 0 00002000:00010000:0.0:1746144881.446557:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2c700 00000100:00100000:0.0:1746144881.449685:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.468839:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.491384:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.494959:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.502890:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.505551:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.509409:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.511911:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.518372:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.545356:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.557930:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.563555:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.568843:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c2b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172220928:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144881.568919:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144881.570648:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+79:1982:x1830965174708096:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6662us (7094us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144881.570661:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10047 00000100:00100000:0.0:1746144881.571173:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174708352 00000100:00100000:0.0:1746144881.571180:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174708352 00002000:00100000:0.0:1746144881.571221:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c2a680 x1830965174708352/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:522/0 lens 488/0 e 0 to 0 dl 1746144892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144881.571230:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c2a680 with x1830965174708352 ext(0->4095) 00010000:00010000:0.0:1746144881.571238:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a73e00/0x4076af6727513808 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9326c expref: 6 pid: 10401 timeout: 575 lvb_type: 0 00010000:00010000:0.0:1746144881.571252:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a73e00/0x4076af6727513808 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9326c expref: 6 pid: 10401 timeout: 575 lvb_type: 0 00002000:00010000:0.0:1746144881.571258:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c2a680 00000100:00100000:0.0:1746144881.571286:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1504 00000100:00100000:0.0:1746144881.571293:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174708352:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144881.571462:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174708352:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 169us (343us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144881.571468:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1504 00002000:00100000:0.0:1746144881.571472:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c2a680 x1830965174708352/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746144892 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144881.571479:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c2a680 with x1830965174708352 ext(0->4095) 00010000:00010000:0.0:1746144881.571483:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a73e00/0x4076af6727513808 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9326c expref: 6 pid: 10401 timeout: 575 lvb_type: 0 00010000:00010000:0.0:1746144881.571492:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a73e00/0x4076af6727513808 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9326c expref: 6 pid: 10401 timeout: 575 lvb_type: 0 00002000:00010000:0.0:1746144881.571497:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c2a680 00000100:00100000:0.0:1746144881.576258:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.582450:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.593001:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.609206:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.618777:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174709248 00000100:00100000:0.0:1746144881.618781:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174709248 00010000:00010000:0.0:1746144881.618799:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099a73c00/0x4076af672751380f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93273 expref: 82 pid: 10401 timeout: 575 lvb_type: 0 00000100:00100000:0.0:1746144881.618815:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10049 00000100:00100000:0.0:1746144881.618819:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1983:x1830965174709248:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144881.618827:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746144881.618844:0:7098:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 1746144881 -> 1746144882 00002000:00010000:0.0:1746144881.618847:0:7098:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 1746144881 -> 1746144882 00010000:00010000:0.0:1746144881.618852:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099a73c00/0x4076af672751380f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93273 expref: 82 pid: 10401 timeout: 575 lvb_type: 0 00010000:00010000:0.0:1746144881.618862:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099a73c00/0x4076af672751380f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93273 expref: 82 pid: 10401 timeout: 575 lvb_type: 0 00010000:00010000:0.0:1746144881.618880:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099a73c00/0x4076af672751380f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93273 expref: 82 pid: 10401 timeout: 575 lvb_type: 0 00010000:00010000:0.0:1746144881.618901:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144881.618902:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144881.618908:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a72e00/0x4076af6727513816 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9327a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.618914:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099a72e00/0x4076af6727513816 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9327a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.618933:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099a72e00/0x4076af6727513816 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9327a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.618944:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099a72e00/0x4076af6727513816 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9327a expref: 5 pid: 10401 timeout: 575 lvb_type: 0 00000100:00100000:0.0:1746144881.618955:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172221440:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144881.619014:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144881.629397:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.635468:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cf2d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172221568:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144881.635497:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144881.635554:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965174709632:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5353us (6166us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144881.635565:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10050 00000100:00100000:0.0:1746144881.636183:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174709888 00000100:00100000:0.0:1746144881.636190:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174709888 00002000:00100000:0.0:1746144881.636228:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38d180 x1830965174709888/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:522/0 lens 488/0 e 0 to 0 dl 1746144892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144881.636243:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38d180 with x1830965174709888 ext(0->4095) 00002000:00010000:0.0:1746144881.636248:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f38d180 00000100:00100000:0.0:1746144881.636437:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3605 00000100:00100000:0.0:1746144881.636443:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+81:1984:x1830965174709888:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144881.636617:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+81:1984:x1830965174709888:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 173us (919us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144881.636622:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3605 00002000:00100000:0.0:1746144881.636627:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38d180 x1830965174709888/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746144892 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144881.636633:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38d180 with x1830965174709888 ext(0->4095) 00002000:00010000:0.0:1746144881.636636:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f38d180 00000100:00100000:0.0:1746144881.640170:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.657437:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.666335:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.671558:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.680605:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.683940:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.686334:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.688891:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.690982:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.693450:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.696279:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.701666:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.703847:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.715326:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.715955:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.720529:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.723352:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.723418:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.725791:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.729072:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.732754:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.735632:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.738152:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.743455:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.745608:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.747836:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.747937:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.751242:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.757659:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.761701:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.764936:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.768892:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.772017:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.775183:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.776149:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.778419:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.780603:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.784090:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.788322:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.792504:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.796318:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.798479:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.801404:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:1.0:1746144881.801949:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af672751387f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af932e3 expref: 6 pid: 10401 timeout: 575 lvb_type: 0 00010000:00010000:1.0:1746144881.801957:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af672751387f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af932e3 expref: 6 pid: 10401 timeout: 575 lvb_type: 0 00002000:00010000:1.0:1746144881.801963:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a006a00 00000100:00100000:0.0:1746144881.804098:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.804162:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.810380:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.817379:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.817466:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:0.0:1746144881.819591:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6400/0x4076af672751388d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af932f1 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.819606:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6400/0x4076af672751388d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af932f1 expref: 5 pid: 10401 timeout: 575 lvb_type: 0 00000100:00100000:0.0:1746144881.819617:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a004700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172225792:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144881.819931:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144881.822562:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a004700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172225792:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144881.822578:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144881.822823:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a007b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965174718208:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4448us (5355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144881.822831:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10066 00000100:00100000:0.0:1746144881.824677:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.833746:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.840135:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144881.840935:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174718848 00000100:00100000:1.0:1746144881.840943:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174718848 00002000:00100000:1.0:1746144881.840988:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e38380 x1830965174718848/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:522/0 lens 488/0 e 0 to 0 dl 1746144892 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144881.840998:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38380 with x1830965174718848 ext(0->4095) 00002000:00010000:1.0:1746144881.841003:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e38380 00000100:00100000:1.0:1746144881.841038:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3613 00000100:00100000:1.0:1746144881.841046:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965174718848:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144881.841237:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965174718848:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 192us (1105us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144881.841244:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3613 00002000:00100000:1.0:1746144881.841249:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e38380 x1830965174718848/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:522/0 lens 488/4536 e 0 to 0 dl 1746144892 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144881.841256:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38380 with x1830965174718848 ext(0->4095) 00002000:00010000:1.0:1746144881.841259:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e38380 00000100:00100000:0.0:1746144881.846130:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.854267:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.856413:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.857798:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10068 00000100:00100000:0.0:1746144881.857810:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1982:x1830965174719232:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144881.857823:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144881.857846:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7400/0x4076af6727513894 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af932f8 expref: 87 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144881.857857:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7400/0x4076af6727513894 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af932f8 expref: 87 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144881.857884:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7400/0x4076af6727513894 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af932f8 expref: 87 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144881.857917:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144881.857919:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144881.857926:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6000/0x4076af672751389b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af932ff expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.857933:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6000/0x4076af672751389b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af932ff expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.857969:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6000/0x4076af672751389b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af932ff expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144881.857981:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172226176:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144881.858059:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144881.860555:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172226176:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144881.860577:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144881.860790:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144881.860949:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1982:x1830965174719232:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3140us (4539us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144881.860962:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10068 00000100:00100000:0.0:1746144881.863814:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.863901:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.863944:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4654 00000100:00100000:0.0:1746144881.863949:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31565:x1830965174719744:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144881.863957:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144881.863973:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275138a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9330d expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.863996:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6000/0x4076af672751389b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af932ff expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.864002:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144881.864060:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144881.864063:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275138a2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9330d expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.864104:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6000/0x4076af672751389b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af932ff expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.864114:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6000/0x4076af672751389b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af932ff expref: 5 pid: 10401 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1746144881.864125:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172226432:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144881.865012:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144881.866388:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.868367:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.871746:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.874219:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.878797:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174720640 00000100:00100000:0.0:1746144881.878805:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174720640 00000100:00100000:0.0:1746144881.878837:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4655 00000100:00100000:0.0:1746144881.878843:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174720640:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144881.878859:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144881.878871:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275138b0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93314 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.878895:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7400/0x4076af67275138a9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93306 expref: 86 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.878901:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144881.878902:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144881.878905:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275138b0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93314 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.878932:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7400/0x4076af67275138a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93306 expref: 86 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.878941:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7400/0x4076af67275138a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93306 expref: 86 pid: 10401 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1746144881.878951:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172226816:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144881.879821:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144881.883288:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.885598:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.890289:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.899302:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.902761:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.917729:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144881.930926:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.938273:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.942131:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.944119:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.955096:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.955184:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.955213:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174722560 00000100:00100000:0.0:1746144881.955220:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174722560 00010000:00010000:0.0:1746144881.955249:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6400/0x4076af67275138be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93322 expref: 6 pid: 20722 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1746144881.955284:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10074 00000100:00100000:0.0:1746144881.955292:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174722560:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144881.955303:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144881.955322:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6400/0x4076af67275138be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93322 expref: 6 pid: 20722 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144881.955333:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6400/0x4076af67275138be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93322 expref: 6 pid: 20722 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144881.955353:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144881.955355:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144881.955362:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6800/0x4076af67275138c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93329 expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.955370:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6800/0x4076af67275138c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93329 expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.955401:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6800/0x4076af67275138c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93329 expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144881.955413:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938a0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172227712:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144881.955476:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144881.955567:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174722432 00000100:00100000:1.0:1746144881.955570:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174722432 00000100:00100000:1.0:1746144881.955592:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4659 00000100:00100000:1.0:1746144881.955597:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31579:x1830965174722432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144881.955609:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144881.955618:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275138cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93330 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144881.955634:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6800/0x4076af67275138c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93329 expref: 91 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144881.955639:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144881.955641:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144881.955643:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275138cc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93330 expref: 91 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144881.955658:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6800/0x4076af67275138c5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93329 expref: 91 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144881.955667:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6800/0x4076af67275138c5 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93329 expref: 91 pid: 20722 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144881.955675:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cf2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172227840:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144881.955697:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53270c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144881.958735:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cf2ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172227840:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144881.958755:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275138cc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93330 expref: 90 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.958788:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092553a00, rc 0) 00000100:00100000:0.0:1746144881.958827:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31579:x1830965174722432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3228us (3739us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144881.958833:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4659 00000100:00100000:1.0:1746144881.958974:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938a0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172227712:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144881.958984:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144881.959010:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965174722560:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3720us (3827us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144881.959017:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10074 00000100:00100000:0.0:1746144881.965977:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.969212:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144881.969420:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174722944 00000100:00100000:1.0:1746144881.969427:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174722944 00010000:00010000:1.0:1746144881.969451:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6800/0x4076af67275138c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93329 expref: 90 pid: 20722 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144881.969688:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10075 00000100:00100000:1.0:1746144881.969695:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1983:x1830965174722944:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144881.969706:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144881.969722:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6800/0x4076af67275138c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93329 expref: 90 pid: 20722 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144881.969732:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6800/0x4076af67275138c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93329 expref: 90 pid: 20722 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144881.969749:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6800/0x4076af67275138c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93329 expref: 90 pid: 20722 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144881.971228:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144881.971231:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144881.971240:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275138cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93330 expref: 89 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144881.971249:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275138cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93330 expref: 89 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144881.971282:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275138cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93330 expref: 89 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144881.971293:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cf2ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172227968:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144881.971932:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53270c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144881.975840:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cf2ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172227968:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144881.975858:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144881.976386:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1983:x1830965174722944:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6689us (7176us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144881.976395:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10075 00000100:00100000:0.0:1746144881.976602:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.980571:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.983816:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144881.983883:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174723456 00000100:00100000:1.0:1746144881.983889:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174723456 00010000:00010000:1.0:1746144881.983912:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275138cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93330 expref: 89 pid: 10401 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144881.984004:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10076 00000100:00100000:1.0:1746144881.984010:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5138450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965174723456:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144881.984021:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144881.984037:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275138cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93330 expref: 89 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144881.984056:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275138cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93330 expref: 89 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144881.984075:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275138cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93330 expref: 89 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144881.984100:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144881.984102:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144881.984108:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7a00/0x4076af67275138d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93337 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144881.984114:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7a00/0x4076af67275138d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93337 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144881.984140:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7a00/0x4076af67275138d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93337 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144881.984150:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cf2ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172228224:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144881.984538:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53270c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144881.986520:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cf2ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172228224:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144881.986536:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144881.986561:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5138450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965174723456:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2551us (2748us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144881.986570:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10076 00000100:00100000:0.0:1746144881.987236:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.988635:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.993854:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144881.995960:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4662 00000100:00100000:0.0:1746144881.995971:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31579:x1830965174723968:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144881.995987:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144881.996001:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275138e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93345 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.996020:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144881.996024:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af67275138da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9333e expref: 90 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.996029:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144881.996032:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275138e1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93345 expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.996067:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af67275138da lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9333e expref: 90 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.996076:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275138e1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93345 expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144881.996084:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:0.0:1746144881.997447:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31579:x1830965174723968:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1474us (3594us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144881.997454:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4662 00000100:00100000:0.0:1746144881.997518:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144881.998140:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174724096 00000100:00100000:1.0:1746144881.998146:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174724096 00010000:00010000:1.0:1746144881.998170:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7a00/0x4076af67275138d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93337 expref: 6 pid: 10401 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144881.998202:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10077 00000100:00100000:1.0:1746144881.998208:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174724096:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144881.998220:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144881.998237:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7a00/0x4076af67275138d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93337 expref: 6 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144881.998248:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7a00/0x4076af67275138d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93337 expref: 6 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144881.998263:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7a00/0x4076af67275138d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93337 expref: 6 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144881.998289:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144881.998291:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144881.998296:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af67275138da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9333e expref: 89 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144881.998302:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af67275138da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9333e expref: 89 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144881.998326:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af67275138da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9333e expref: 89 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144881.998335:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af67275138da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9333e expref: 89 pid: 10401 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144881.998345:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012cf2ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172228608:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144881.998401:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41396c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144882.001642:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.001734:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012cf2ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172228608:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144882.001750:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144882.001816:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965174724096:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3607us (4297us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144882.001824:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10077 00000100:00100000:0.0:1746144882.005594:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.005681:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174724480 00000100:00100000:1.0:1746144882.005689:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174724480 00010000:00010000:1.0:1746144882.005714:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af67275138da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9333e expref: 90 pid: 10401 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1746144882.008954:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.010746:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.013625:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.015902:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.017565:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.020797:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.029600:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.036383:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.041411:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.042015:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.047353:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.047479:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174726400 00000100:00100000:1.0:1746144882.047483:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174726400 00002000:00100000:1.0:1746144882.047510:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a0700 x1830965174726400/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.047518:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a0700 with x1830965174726400 ext(0->4095) 00010000:00010000:1.0:1746144882.047524:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a72200/0x4076af67275138f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9335a expref: 89 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.047534:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a72200/0x4076af67275138f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9335a expref: 89 pid: 8430 timeout: 576 lvb_type: 0 00002000:00010000:1.0:1746144882.047540:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a0700 00000100:00100000:1.0:1746144882.047560:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1525 00000100:00100000:1.0:1746144882.047564:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1982:x1830965174726400:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144882.047691:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1982:x1830965174726400:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 125us (338us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144882.047697:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1525 00002000:00100000:1.0:1746144882.047702:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a0700 x1830965174726400/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.047708:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a0700 with x1830965174726400 ext(0->4095) 00010000:00010000:1.0:1746144882.047712:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a72200/0x4076af67275138f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9335a expref: 89 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.047721:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a72200/0x4076af67275138f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9335a expref: 89 pid: 8430 timeout: 576 lvb_type: 0 00002000:00010000:1.0:1746144882.047726:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a0700 00000100:00100000:0.0:1746144882.050466:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.050537:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.054948:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.059165:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.062863:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.063281:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174727296 00000100:00100000:1.0:1746144882.063287:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174727296 00002000:00100000:1.0:1746144882.063316:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c28700 x1830965174727296/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.063324:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28700 with x1830965174727296 ext(0->4095) 00002000:00010000:1.0:1746144882.063328:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c28700 00000100:00100000:1.0:1746144882.063340:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3622 00000100:00100000:1.0:1746144882.063346:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1984:x1830965174727296:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144882.063473:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1984:x1830965174727296:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 127us (616us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144882.063478:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3622 00002000:00100000:1.0:1746144882.063483:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c28700 x1830965174727296/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.063490:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28700 with x1830965174727296 ext(0->4095) 00002000:00010000:1.0:1746144882.063492:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c28700 00000100:00100000:0.0:1746144882.066390:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.070671:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.073986:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.074015:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.080726:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.081222:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.086436:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.086742:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174728448 00000100:00100000:1.0:1746144882.086749:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174728448 00002000:00100000:1.0:1746144882.086806:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093854a80 x1830965174728448/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.086815:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854a80 with x1830965174728448 ext(0->4095) 00010000:00010000:1.0:1746144882.086821:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a73200/0x4076af6727513912 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93376 expref: 90 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.086832:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a73200/0x4076af6727513912 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93376 expref: 90 pid: 10401 timeout: 576 lvb_type: 0 00002000:00010000:1.0:1746144882.086838:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093854a80 00000100:00100000:1.0:1746144882.086865:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1528 00000100:00100000:1.0:1746144882.086871:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965174728448:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144882.087007:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965174728448:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 135us (572us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144882.087013:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1528 00002000:00100000:1.0:1746144882.087019:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093854a80 x1830965174728448/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.087026:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854a80 with x1830965174728448 ext(0->4095) 00010000:00010000:1.0:1746144882.087030:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a73200/0x4076af6727513912 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93376 expref: 90 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.087039:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a73200/0x4076af6727513912 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93376 expref: 90 pid: 10401 timeout: 576 lvb_type: 0 00002000:00010000:1.0:1746144882.087060:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093854a80 00000100:00100000:0.0:1746144882.090698:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.093594:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.097534:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.102409:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.105732:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.109619:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.110399:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174729472 00000100:00100000:1.0:1746144882.110405:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174729472 00002000:00100000:1.0:1746144882.110440:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924d8a80 x1830965174729472/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.110448:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d8a80 with x1830965174729472 ext(0->4095) 00010000:00010000:1.0:1746144882.110455:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a73c00/0x4076af6727513920 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93384 expref: 6 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.110466:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a73c00/0x4076af6727513920 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93384 expref: 6 pid: 10401 timeout: 576 lvb_type: 0 00002000:00010000:1.0:1746144882.110472:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924d8a80 00000100:00100000:1.0:1746144882.110495:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1529 00000100:00100000:1.0:1746144882.110501:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174729472:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144882.110633:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174729472:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 132us (1017us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144882.110640:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1529 00002000:00100000:1.0:1746144882.110645:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924d8a80 x1830965174729472/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.110651:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d8a80 with x1830965174729472 ext(0->4095) 00010000:00010000:1.0:1746144882.110655:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a73c00/0x4076af6727513920 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93384 expref: 6 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.110668:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a73c00/0x4076af6727513920 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93384 expref: 6 pid: 10401 timeout: 576 lvb_type: 0 00002000:00010000:1.0:1746144882.110674:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924d8a80 00000100:00100000:0.0:1746144882.113689:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.114842:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.119227:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.122177:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.127576:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172231680:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144882.127598:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144882.127634:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965174730112:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5126us (5462us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144882.127643:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10089 00000100:00100000:0.0:1746144882.128174:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.128357:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174730368 00000100:00100000:1.0:1746144882.128363:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174730368 00002000:00100000:1.0:1746144882.128395:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ca80 x1830965174730368/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.128402:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ca80 with x1830965174730368 ext(0->4095) 00002000:00010000:1.0:1746144882.128405:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398ca80 00000100:00100000:1.0:1746144882.128429:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3625 00000100:00100000:1.0:1746144882.128435:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965174730368:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144882.128576:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965174730368:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 140us (402us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144882.128582:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3625 00002000:00100000:1.0:1746144882.128586:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ca80 x1830965174730368/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.128593:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ca80 with x1830965174730368 ext(0->4095) 00002000:00010000:1.0:1746144882.128596:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398ca80 00000100:00100000:0.0:1746144882.130978:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.136326:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.138251:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.142681:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.150209:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.157038:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174731392 00000100:00100000:0.0:1746144882.157052:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174731392 00002000:00100000:0.0:1746144882.157089:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5ea00 x1830965174731392/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144882.157098:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ea00 with x1830965174731392 ext(0->4095) 00002000:00010000:0.0:1746144882.157102:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5ea00 00000100:00100000:0.0:1746144882.157128:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3626 00000100:00100000:0.0:1746144882.157134:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965174731392:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144882.157262:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965174731392:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 129us (350us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144882.157268:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3626 00002000:00100000:0.0:1746144882.157272:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5ea00 x1830965174731392/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144882.157279:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ea00 with x1830965174731392 ext(0->4095) 00002000:00010000:0.0:1746144882.157281:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5ea00 00000100:00100000:0.0:1746144882.167133:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.179340:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.182404:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.188614:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.194509:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.198532:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.202746:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.213190:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.239756:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.245943:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.255271:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.258994:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.260209:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.263811:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.267031:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.267075:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174733824 00000100:00100000:1.0:1746144882.267082:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174733824 00002000:00100000:1.0:1746144882.267119:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008bafa300 x1830965174733824/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.267140:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008bafa300 with x1830965174733824 ext(0->4095) 00010000:00010000:1.0:1746144882.267147:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6000/0x4076af6727513958 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933bc expref: 94 pid: 8432 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.267159:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6000/0x4076af6727513958 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933bc expref: 94 pid: 8432 timeout: 576 lvb_type: 0 00002000:00010000:1.0:1746144882.267165:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008bafa300 00000100:00100000:1.0:1746144882.267192:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1535 00000100:00100000:1.0:1746144882.267200:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bafa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1985:x1830965174733824:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144882.267336:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bafa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1985:x1830965174733824:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 137us (314us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144882.267341:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1535 00002000:00100000:1.0:1746144882.267346:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008bafa300 x1830965174733824/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.267353:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008bafa300 with x1830965174733824 ext(0->4095) 00010000:00010000:1.0:1746144882.267358:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6000/0x4076af6727513958 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933bc expref: 94 pid: 8432 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.267366:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6000/0x4076af6727513958 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933bc expref: 94 pid: 8432 timeout: 576 lvb_type: 0 00002000:00010000:1.0:1746144882.267372:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008bafa300 00000100:00100000:0.0:1746144882.270461:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.273109:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.278341:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174734336 00000100:00100000:0.0:1746144882.278349:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174734336 00000100:00100000:0.0:1746144882.278397:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4681 00000100:00100000:0.0:1746144882.278405:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174734336:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144882.278420:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144882.278433:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513966 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af933ca expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.278455:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7400/0x4076af672751395f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933c3 expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.278462:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144882.278463:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144882.278467:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513966 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933ca expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.278489:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7400/0x4076af672751395f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933c3 expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.278499:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7400/0x4076af672751395f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933c3 expref: 92 pid: 20722 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1746144882.278510:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008bafad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172233600:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144882.278593:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144882.286078:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.286125:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.290854:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174734848 00000100:00100000:0.0:1746144882.290861:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174734848 00002000:00100000:0.0:1746144882.290897:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5ca80 x1830965174734848/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144882.290905:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ca80 with x1830965174734848 ext(0->4095) 00010000:00010000:0.0:1746144882.290912:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513966 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933ca expref: 6 pid: 8432 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.290923:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513966 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933ca expref: 6 pid: 8432 timeout: 576 lvb_type: 0 00002000:00010000:0.0:1746144882.290929:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5ca80 00000100:00100000:0.0:1746144882.290955:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1536 00000100:00100000:0.0:1746144882.290960:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174734848:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144882.291112:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174734848:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 152us (319us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144882.291117:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1536 00002000:00100000:0.0:1746144882.291122:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5ca80 x1830965174734848/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144882.291127:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ca80 with x1830965174734848 ext(0->4095) 00010000:00010000:0.0:1746144882.291131:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513966 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933ca expref: 6 pid: 8432 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.291138:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513966 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933ca expref: 6 pid: 8432 timeout: 576 lvb_type: 0 00002000:00010000:0.0:1746144882.291142:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5ca80 00000100:00100000:0.0:1746144882.296460:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.304835:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.316304:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.336449:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.343345:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.344002:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.348035:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.348123:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174736000 00000100:00100000:1.0:1746144882.348130:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174736000 00002000:00100000:1.0:1746144882.348164:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008baf9f80 x1830965174736000/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.348172:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008baf9f80 with x1830965174736000 ext(0->4095) 00010000:00010000:1.0:1746144882.348187:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6400/0x4076af6727513974 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933d8 expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.348198:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6400/0x4076af6727513974 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933d8 expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00002000:00010000:1.0:1746144882.348203:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008baf9f80 00000100:00100000:1.0:1746144882.348224:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1538 00000100:00100000:1.0:1746144882.348230:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008baf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174736000:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144882.348371:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008baf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174736000:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 140us (339us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144882.348377:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1538 00002000:00100000:1.0:1746144882.348382:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008baf9f80 x1830965174736000/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.348388:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008baf9f80 with x1830965174736000 ext(0->4095) 00010000:00010000:1.0:1746144882.348392:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6400/0x4076af6727513974 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933d8 expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.348925:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3b6400/0x4076af6727513974 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933d8 expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00002000:00010000:1.0:1746144882.348932:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008baf9f80 00000100:00100000:0.0:1746144882.353743:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.360873:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.360967:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174736384 00000100:00100000:1.0:1746144882.360972:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174736384 00002000:00100000:1.0:1746144882.361002:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008bafad80 x1830965174736384/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.361011:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008bafad80 with x1830965174736384 ext(0->4095) 00002000:00010000:1.0:1746144882.361014:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008bafad80 00000100:00100000:1.0:1746144882.361040:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3631 00000100:00100000:1.0:1746144882.361053:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1985:x1830965174736384:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144882.361170:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bafad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1985:x1830965174736384:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 125us (298us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144882.361175:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3631 00002000:00100000:1.0:1746144882.361179:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008bafad80 x1830965174736384/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.361186:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008bafad80 with x1830965174736384 ext(0->4095) 00002000:00010000:1.0:1746144882.361188:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008bafad80 00000100:00100000:0.0:1746144882.363519:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.373593:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.377078:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.382881:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.387532:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.394504:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.396519:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.399475:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.399522:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174737664 00000100:00100000:1.0:1746144882.399528:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174737664 00002000:00100000:1.0:1746144882.399555:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800883d9880 x1830965174737664/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.399564:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800883d9880 with x1830965174737664 ext(0->4095) 00010000:00010000:1.0:1746144882.399570:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a72e00/0x4076af6727513989 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933ed expref: 98 pid: 8432 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.399584:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a72e00/0x4076af6727513989 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933ed expref: 98 pid: 8432 timeout: 576 lvb_type: 0 00002000:00010000:1.0:1746144882.399589:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800883d9880 00000100:00100000:1.0:1746144882.399616:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1540 00000100:00100000:1.0:1746144882.399622:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800883d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+98:1984:x1830965174737664:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144882.399749:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800883d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+98:1984:x1830965174737664:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 127us (276us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144882.399755:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1540 00002000:00100000:1.0:1746144882.399759:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800883d9880 x1830965174737664/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.399783:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800883d9880 with x1830965174737664 ext(0->4095) 00010000:00010000:1.0:1746144882.399787:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a72e00/0x4076af6727513989 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933ed expref: 98 pid: 8432 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.399795:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a72e00/0x4076af6727513989 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af933ed expref: 98 pid: 8432 timeout: 576 lvb_type: 0 00002000:00010000:1.0:1746144882.399799:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800883d9880 00000100:00100000:0.0:1746144882.403663:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.409829:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.413431:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.418297:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.425640:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.425808:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.433719:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.439279:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.455880:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.457197:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1542 00000100:00100000:1.0:1746144882.457209:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800883db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+98:1985:x1830965174739200:12345-192.168.202.16@tcp:3:ldlm_bl.0 00000100:00100000:0.0:1746144882.473621:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.473753:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800883db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+98:1985:x1830965174739200:12345-192.168.202.16@tcp:3:ldlm_bl.0 Request processed in 16544us (17870us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144882.473778:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1542 00002000:00100000:1.0:1746144882.473792:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800883db480 x1830965174739200/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.473802:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800883db480 with x1830965174739200 ext(0->4095) 00010000:00010000:1.0:1746144882.473814:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a73c00/0x4076af672751399e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93402 expref: 98 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.473830:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a73c00/0x4076af672751399e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93402 expref: 98 pid: 10401 timeout: 576 lvb_type: 0 00002000:00010000:1.0:1746144882.473836:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800883db480 00000100:00100000:0.0:1746144882.478967:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.485686:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.509455:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.509551:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174739840 00000100:00100000:1.0:1746144882.509561:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174739840 00002000:00100000:1.0:1746144882.509606:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800883d9500 x1830965174739840/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 496/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.509617:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800883d9500 with x1830965174739840 ext(0->7) 00010000:00010000:1.0:1746144882.509626:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af67275139a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93409 expref: 97 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.509641:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af67275139a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93409 expref: 97 pid: 10401 timeout: 576 lvb_type: 0 00002000:00010000:1.0:1746144882.509648:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800883d9500 00000100:00100000:1.0:1746144882.509677:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1543 00000100:00100000:1.0:1746144882.509685:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800883d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+97:1984:x1830965174739840:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144882.510031:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800883d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+99:1984:x1830965174739840:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 347us (587us total) trans 4294967905 rc 0/0 00000100:00100000:1.0:1746144882.510037:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1543 00002000:00100000:1.0:1746144882.510053:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800883d9500 x1830965174739840/t4294967905(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 496/448 e 0 to 0 dl 1746144893 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.510061:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800883d9500 with x1830965174739840 ext(0->7) 00010000:00010000:1.0:1746144882.510065:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af67275139a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93409 expref: 99 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.510074:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a72c00/0x4076af67275139a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93409 expref: 99 pid: 10401 timeout: 576 lvb_type: 0 00002000:00010000:1.0:1746144882.510080:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800883d9500 00000100:00100000:0.0:1746144882.534816:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.539693:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.545594:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.560648:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.563993:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.564068:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174740736 00000100:00100000:1.0:1746144882.564076:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174740736 00002000:00100000:1.0:1746144882.564119:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800915a0a80 x1830965174740736/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.564128:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915a0a80 with x1830965174740736 ext(0->4095) 00002000:00010000:1.0:1746144882.564133:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915a0a80 00000100:00100000:1.0:1746144882.564212:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3635 00000100:00100000:1.0:1746144882.564219:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+99:1984:x1830965174740736:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144882.564461:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+99:1984:x1830965174740736:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 242us (470us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144882.564466:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3635 00002000:00100000:1.0:1746144882.564473:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800915a0a80 x1830965174740736/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.564480:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915a0a80 with x1830965174740736 ext(0->4095) 00002000:00010000:1.0:1746144882.564482:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915a0a80 00000100:00100000:0.0:1746144882.567889:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.590942:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.590974:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174740992 00000100:00100000:0.0:1746144882.590983:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174740992 00002000:00100000:0.0:1746144882.591594:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800915a1180 x1830965174740992/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 496/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144882.591605:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915a1180 with x1830965174740992 ext(0->7) 00010000:00010000:0.0:1746144882.591616:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275139b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93417 expref: 99 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.591632:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275139b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93417 expref: 99 pid: 10401 timeout: 576 lvb_type: 0 00002000:00010000:0.0:1746144882.591639:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800915a1180 00000100:00100000:0.0:1746144882.591665:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1545 00000100:00100000:0.0:1746144882.591674:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+99:1985:x1830965174740992:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746144882.593348:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1985:x1830965174740992:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 1671us (2412us total) trans 4294967906 rc 0/0 00000100:00100000:0.0:1746144882.593359:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1545 00002000:00100000:0.0:1746144882.593368:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800915a1180 x1830965174740992/t4294967906(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 496/448 e 0 to 0 dl 1746144893 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144882.593376:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915a1180 with x1830965174740992 ext(0->7) 00010000:00010000:0.0:1746144882.593384:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275139b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93417 expref: 101 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.593396:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275139b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93417 expref: 101 pid: 10401 timeout: 576 lvb_type: 0 00002000:00010000:0.0:1746144882.593402:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800915a1180 00000100:00100000:1.0:1746144882.607519:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.608000:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174741120 00000100:00100000:0.0:1746144882.608010:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174741120 00010000:00010000:0.0:1746144882.608058:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275139b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93417 expref: 101 pid: 10401 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1746144882.608093:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10109 00000100:00100000:0.0:1746144882.608101:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1985:x1830965174741120:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144882.608114:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144882.608139:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275139b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93417 expref: 101 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.608150:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275139b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93417 expref: 101 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.608173:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099a72800/0x4076af67275139b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93417 expref: 101 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.608185:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144882.608187:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144882.608194:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7400/0x4076af67275139ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9341e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.608202:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7400/0x4076af67275139ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9341e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.608236:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7400/0x4076af67275139ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9341e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144882.608248:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915a1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172236800:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144882.608516:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.608600:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144882.619622:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174741504 00000100:00100000:0.0:1746144882.619630:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174741504 00002000:00100000:0.0:1746144882.619672:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38f100 x1830965174741504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144882.619681:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38f100 with x1830965174741504 ext(0->4095) 00010000:00010000:0.0:1746144882.619689:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7400/0x4076af67275139ba lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9341e expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.619702:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7400/0x4076af67275139ba lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9341e expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00002000:00010000:0.0:1746144882.619708:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f38f100 00000100:00100000:1.0:1746144882.619722:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915a1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172236800:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144882.619726:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1546 00010000:00010000:1.0:1746144882.619733:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144882.619733:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174741504:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144882.619751:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1985:x1830965174741120:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 11652us (12245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144882.619759:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10109 00000100:00100000:0.0:1746144882.619909:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174741504:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 176us (580us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144882.619915:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1546 00002000:00100000:0.0:1746144882.619920:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38f100 x1830965174741504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144882.619927:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38f100 with x1830965174741504 ext(0->4095) 00010000:00010000:0.0:1746144882.619932:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7400/0x4076af67275139ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9341e expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.619941:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012d3b7400/0x4076af67275139ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9341e expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00002000:00010000:0.0:1746144882.619951:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f38f100 00000100:00100000:1.0:1746144882.649303:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.650316:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174742016 00000100:00100000:0.0:1746144882.650326:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174742016 00002000:00100000:0.0:1746144882.650372:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e38000 x1830965174742016/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144882.650383:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38000 with x1830965174742016 ext(0->4095) 00010000:00010000:0.0:1746144882.650392:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139c1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93425 expref: 101 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.650405:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139c1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93425 expref: 101 pid: 8430 timeout: 576 lvb_type: 0 00002000:00010000:0.0:1746144882.650412:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e38000 00000100:00100000:0.0:1746144882.650430:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1547 00000100:00100000:0.0:1746144882.650436:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1985:x1830965174742016:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144882.650628:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1985:x1830965174742016:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 191us (1335us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144882.650634:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1547 00002000:00100000:0.0:1746144882.650640:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e38000 x1830965174742016/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144882.650647:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38000 with x1830965174742016 ext(0->4095) 00010000:00010000:0.0:1746144882.650651:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139c1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93425 expref: 101 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.650664:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139c1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93425 expref: 101 pid: 8430 timeout: 576 lvb_type: 0 00002000:00010000:0.0:1746144882.650669:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e38000 00000100:00100000:0.0:1746144882.650713:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172237184:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144882.650728:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144882.650747:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174741632:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 22767us (23332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144882.650755:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10110 00000100:00100000:1.0:1746144882.655485:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.655566:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.655604:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174742272 00000100:00100000:1.0:1746144882.655611:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174742272 00010000:00010000:1.0:1746144882.655645:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93425 expref: 102 pid: 8430 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144882.655667:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10111 00000100:00100000:1.0:1746144882.655672:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+102:1982:x1830965174742272:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144882.655682:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144882.655702:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93425 expref: 103 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.656952:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93425 expref: 103 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.656976:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93425 expref: 103 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.656988:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.656990:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.656996:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a72200/0x4076af67275139c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9342c expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.657003:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099a72200/0x4076af67275139c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9342c expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.657396:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099a72200/0x4076af67275139c8 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9342c expref: 5 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.657481:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099a72200/0x4076af67275139c8 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9342c expref: 5 pid: 8430 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144882.657489:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172237440:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144882.659963:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4139780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144882.670020:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.670546:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172237440:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144882.670558:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144882.670594:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1982:x1830965174742272:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 14921us (15120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144882.670603:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10111 00000100:00100000:0.0:1746144882.670674:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174742528 00000100:00100000:0.0:1746144882.670680:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174742528 00002000:00100000:0.0:1746144882.671374:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e3b100 x1830965174742528/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144882.671383:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3b100 with x1830965174742528 ext(0->4095) 00010000:00010000:0.0:1746144882.671389:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a72200/0x4076af67275139c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9342c expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.671401:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a72200/0x4076af67275139c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9342c expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00002000:00010000:0.0:1746144882.671411:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e3b100 00000100:00100000:0.0:1746144882.671433:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1548 00000100:00100000:0.0:1746144882.671521:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174742528:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144882.671673:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174742528:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 153us (1663us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144882.672553:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1548 00002000:00100000:0.0:1746144882.672561:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e3b100 x1830965174742528/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144882.672569:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3b100 with x1830965174742528 ext(0->4095) 00010000:00010000:0.0:1746144882.672574:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a72200/0x4076af67275139c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9342c expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.672583:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a72200/0x4076af67275139c8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9342c expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00002000:00010000:0.0:1746144882.672588:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e3b100 00000100:00100000:0.0:1746144882.687443:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.695669:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.699550:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.704163:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174743168 00000100:00100000:0.0:1746144882.704173:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174743168 00010000:00010000:0.0:1746144882.704212:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e800/0x4076af67275139cf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93433 expref: 101 pid: 10401 timeout: 576 lvb_type: 0 00000100:00100000:0.0:1746144882.704241:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10113 00000100:00100000:0.0:1746144882.704250:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1984:x1830965174743168:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144882.704264:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144882.704285:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e800/0x4076af67275139cf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93433 expref: 101 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.704298:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e800/0x4076af67275139cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93433 expref: 101 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.704323:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144882.704326:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144882.704333:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9343a expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.704341:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9343a expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.704373:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9343a expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144882.704384:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800915a1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172237824:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144882.705056:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144882.707486:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.708559:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800915a1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172237824:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144882.708579:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144882.708601:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+102:1984:x1830965174743168:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4352us (4617us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144882.708610:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10113 00000100:00100000:1.0:1746144882.708707:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.709494:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174743552 00000100:00100000:0.0:1746144882.709499:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174743552 00002000:00100000:0.0:1746144882.709776:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e39c00 x1830965174743552/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144882.709786:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e39c00 with x1830965174743552 ext(0->4095) 00010000:00010000:0.0:1746144882.709793:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139d6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9343a expref: 6 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.709804:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139d6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9343a expref: 6 pid: 10401 timeout: 576 lvb_type: 0 00002000:00010000:0.0:1746144882.709810:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e39c00 00000100:00100000:0.0:1746144882.710739:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1549 00000100:00100000:0.0:1746144882.710747:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174743552:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:0.0:1746144882.710927:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174743552:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 181us (2219us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144882.710932:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1549 00002000:00100000:0.0:1746144882.710936:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e39c00 x1830965174743552/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144882.710943:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e39c00 with x1830965174743552 ext(0->4095) 00010000:00010000:0.0:1746144882.710948:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9343a expref: 6 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:0.0:1746144882.710957:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9343a expref: 6 pid: 10401 timeout: 576 lvb_type: 0 00002000:00010000:0.0:1746144882.710962:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e39c00 00000100:00100000:0.0:1746144882.721119:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.721180:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.721631:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174743808 00000100:00100000:1.0:1746144882.721636:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174743808 00010000:00010000:1.0:1746144882.721654:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9343a expref: 6 pid: 10401 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144882.721992:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10114 00000100:00100000:1.0:1746144882.721999:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965174743808:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144882.722008:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144882.722030:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9343a expref: 6 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.722052:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139d6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9343a expref: 6 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.722071:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af67275139d6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9343a expref: 6 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.722087:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.722089:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.722095:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9fa00/0x4076af67275139dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93441 expref: 101 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.722102:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb9fa00/0x4076af67275139dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93441 expref: 101 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.722122:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb9fa00/0x4076af67275139dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93441 expref: 101 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.722536:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb9fa00/0x4076af67275139dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93441 expref: 101 pid: 10401 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144882.722555:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172238208:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144882.722843:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144882.725574:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172238208:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144882.725595:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144882.725637:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965174743808:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3638us (4456us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144882.725647:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10114 00000100:00100000:0.0:1746144882.728805:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.732900:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.732985:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174744192 00000100:00100000:1.0:1746144882.732993:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174744192 00010000:00010000:1.0:1746144882.733023:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb9fa00/0x4076af67275139dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93441 expref: 102 pid: 10401 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144882.733067:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10115 00000100:00100000:1.0:1746144882.733074:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+102:1984:x1830965174744192:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144882.733086:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144882.733105:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb9fa00/0x4076af67275139dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93441 expref: 102 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.733116:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb9fa00/0x4076af67275139dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93441 expref: 102 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.733138:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9fa00/0x4076af67275139dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93441 expref: 102 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.733161:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.733163:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.733170:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e800/0x4076af67275139e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93448 expref: 101 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.733178:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e800/0x4076af67275139e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93448 expref: 101 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.733212:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e800/0x4076af67275139e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93448 expref: 101 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144882.733223:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172238336:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144882.733300:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144882.734893:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172238336:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144882.734908:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144882.734938:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1984:x1830965174744192:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1863us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144882.734947:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10115 00000100:00100000:0.0:1746144882.735195:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.735528:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174744448 00000100:00100000:1.0:1746144882.735534:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174744448 00002000:00100000:1.0:1746144882.735569:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800915a2680 x1830965174744448/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.735578:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915a2680 with x1830965174744448 ext(0->4095) 00002000:00010000:1.0:1746144882.735583:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915a2680 00000100:00100000:1.0:1746144882.735746:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3637 00000100:00100000:1.0:1746144882.735753:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1983:x1830965174744448:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144882.735955:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1983:x1830965174744448:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 201us (760us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144882.735961:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3637 00002000:00100000:1.0:1746144882.735966:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800915a2680 x1830965174744448/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 488/4536 e 0 to 0 dl 1746144893 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.735973:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800915a2680 with x1830965174744448 ext(0->4095) 00002000:00010000:1.0:1746144882.735975:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800915a2680 00000100:00100000:0.0:1746144882.738115:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.738581:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174744576 00000100:00100000:1.0:1746144882.738588:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174744576 00000100:00100000:1.0:1746144882.738638:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4700 00000100:00100000:1.0:1746144882.738644:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174744576:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144882.738658:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144882.738676:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092552a00/0x4076af67275139eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9344f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.738703:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e800/0x4076af67275139e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93448 expref: 100 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.738711:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144882.738713:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144882.738716:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092552a00/0x4076af67275139eb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9344f expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.738747:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e800/0x4076af67275139e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93448 expref: 100 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.738784:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e800/0x4076af67275139e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93448 expref: 100 pid: 10401 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144882.738797:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172238464:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144882.739886:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144882.746167:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172238464:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144882.746203:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092552a00/0x4076af67275139eb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9344f expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.746222:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092552a00, rc 0) 00000100:00100000:1.0:1746144882.746287:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174744576:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7641us (8179us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144882.746296:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4700 00000100:00100000:0.0:1746144882.752007:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.760712:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.762074:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174744832 00000100:00100000:1.0:1746144882.762087:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174744832 00010000:00010000:1.0:1746144882.762131:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e800/0x4076af67275139e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93448 expref: 103 pid: 10401 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144882.762181:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10116 00000100:00100000:1.0:1746144882.762189:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+103:1982:x1830965174744832:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144882.762204:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746144882.762224:0:7098:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 1746144882 -> 1746144883 00002000:00010000:1.0:1746144882.762227:0:7098:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 1746144882 -> 1746144883 00010000:00010000:1.0:1746144882.762232:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e800/0x4076af67275139e4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93448 expref: 103 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.762244:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e800/0x4076af67275139e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93448 expref: 103 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.762267:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e800/0x4076af67275139e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93448 expref: 103 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.762943:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.762946:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.762956:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092552a00/0x4076af67275139eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9344f expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.762965:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092552a00/0x4076af67275139eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9344f expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.763187:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092552a00/0x4076af67275139eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9344f expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144882.763201:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172238592:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144882.763315:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41396c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144882.768665:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.770490:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172238592:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144882.770511:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144882.771637:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+102:1982:x1830965174744832:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 9448us (10934us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144882.771646:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10116 00000100:00100000:0.0:1746144882.783659:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.784193:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174745216 00000100:00100000:1.0:1746144882.784204:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174745216 00000100:00100000:1.0:1746144882.784267:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4701 00000100:00100000:1.0:1746144882.784276:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+102:31565:x1830965174745216:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144882.784296:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144882.784315:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092553200/0x4076af67275139f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93456 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.784348:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092552a00/0x4076af67275139eb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9344f expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.784356:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.784358:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.784361:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092553200/0x4076af67275139f2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93456 expref: 103 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.784393:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092552a00/0x4076af67275139eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9344f expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.784405:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092552a00/0x4076af67275139eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9344f expref: 5 pid: 8430 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144882.784418:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172238720:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144882.784518:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41396c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144882.789631:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.791402:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172238720:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144882.791425:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092553200/0x4076af67275139f2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93456 expref: 104 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.791441:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092553200, rc 0) 00000100:00100000:1.0:1746144882.791503:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+104:31565:x1830965174745216:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7228us (7856us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144882.791509:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4701 00000100:00100000:0.0:1746144882.793529:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.793955:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174745472 00000100:00100000:1.0:1746144882.793963:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174745472 00010000:00010000:1.0:1746144882.793998:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092552a00/0x4076af67275139eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9344f expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144882.795652:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10117 00000100:00100000:1.0:1746144882.795665:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174745472:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144882.795683:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144882.795707:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092552a00/0x4076af67275139eb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9344f expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.795721:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092552a00/0x4076af67275139eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9344f expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.795750:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092552a00/0x4076af67275139eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9344f expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.795786:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.795789:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.795796:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092553200/0x4076af67275139f2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93456 expref: 103 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.795808:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092553200/0x4076af67275139f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93456 expref: 103 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.795845:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092553200/0x4076af67275139f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93456 expref: 103 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.795855:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092553200/0x4076af67275139f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93456 expref: 103 pid: 8430 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144882.795867:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172238976:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144882.795965:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144882.799059:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172238976:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144882.799083:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144882.799125:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965174745472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3463us (5603us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144882.799137:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10117 00000100:00100000:0.0:1746144882.799403:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.803066:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.803175:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174745856 00000100:00100000:1.0:1746144882.803183:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174745856 00010000:00010000:1.0:1746144882.803216:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092553200/0x4076af67275139f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93456 expref: 104 pid: 8430 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144882.803254:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10118 00000100:00100000:1.0:1746144882.803262:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+104:1984:x1830965174745856:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144882.803274:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144882.803294:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092553200/0x4076af67275139f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93456 expref: 104 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.803306:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092553200/0x4076af67275139f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93456 expref: 104 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.803330:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092553200/0x4076af67275139f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93456 expref: 104 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.803360:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.803362:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.803370:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2c00/0x4076af67275139f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9345d expref: 103 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.803377:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2c00/0x4076af67275139f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9345d expref: 103 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.803410:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2c00/0x4076af67275139f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9345d expref: 103 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144882.803427:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172239104:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144882.803517:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b41396c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144882.809401:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172239104:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144882.809423:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144882.809480:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+103:1984:x1830965174745856:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6218us (6422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144882.809491:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10118 00000100:00100000:0.0:1746144882.819149:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.819249:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174746240 00000100:00100000:1.0:1746144882.819259:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174746240 00000100:00100000:1.0:1746144882.819303:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4703 00000100:00100000:1.0:1746144882.819311:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800883db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174746240:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144882.819329:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144882.819349:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af6727513a00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93464 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.819382:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2c00/0x4076af67275139f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9345d expref: 102 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.819389:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144882.819391:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144882.819394:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af6727513a00 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93464 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.819425:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2c00/0x4076af67275139f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9345d expref: 102 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.819437:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2c00/0x4076af67275139f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9345d expref: 102 pid: 10401 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144882.819448:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172239232:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144882.819938:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4139780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144882.827448:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172239232:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144882.827483:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af6727513a00 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93464 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.827509:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092553a00, rc 0) 00000100:00100000:1.0:1746144882.827557:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800883db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174746240:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 8246us (8419us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144882.827566:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4703 00000100:00100000:0.0:1746144882.833184:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.839264:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174746624 00000100:00100000:1.0:1746144882.839268:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174746624 00000100:00100000:1.0:1746144882.839310:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174746880 00000100:00100000:1.0:1746144882.839312:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174746880 00000100:00100000:1.0:1746144882.839329:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 382 00000100:00100000:1.0:1746144882.839333:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1984:x1830965174746624:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1746144882.839358:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1984:x1830965174746624:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144882.839367:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 382 00000100:00100000:1.0:1746144882.839376:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 383 00000100:00100000:1.0:1746144882.839382:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965174746880:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1746144882.839398:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965174746880:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 16us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144882.839405:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 383 00000100:00100000:0.0:1746144882.847337:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.847430:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174747264 00000100:00100000:1.0:1746144882.847441:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174747264 00010000:00010000:1.0:1746144882.847478:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2c00/0x4076af67275139f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9345d expref: 106 pid: 10401 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144882.847523:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10119 00000100:00100000:1.0:1746144882.847531:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+106:1982:x1830965174747264:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144882.847546:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144882.847566:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2c00/0x4076af67275139f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9345d expref: 106 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.847579:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2c00/0x4076af67275139f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9345d expref: 106 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.847604:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2c00/0x4076af67275139f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9345d expref: 106 pid: 10401 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.847636:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.847638:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.847645:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af6727513a00 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93464 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.847652:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af6727513a00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93464 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.847685:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af6727513a00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93464 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.847696:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af6727513a00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93464 expref: 5 pid: 8430 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144882.847706:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172239488:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144882.847810:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4139780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144882.850311:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172239488:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144882.850332:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144882.850381:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+105:1982:x1830965174747264:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2849us (3054us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144882.850391:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10119 00000100:00100000:0.0:1746144882.851092:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.854135:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.854217:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174747648 00000100:00100000:1.0:1746144882.854223:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174747648 00010000:00010000:1.0:1746144882.854251:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af6727513a00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93464 expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00000100:00100000:1.0:1746144882.854286:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10120 00000100:00100000:1.0:1746144882.854292:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174747648:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144882.854303:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144882.854323:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af6727513a00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93464 expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.854334:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af6727513a00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93464 expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.854361:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af6727513a00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93464 expref: 6 pid: 8430 timeout: 576 lvb_type: 0 00010000:00010000:1.0:1746144882.854384:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.854386:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.854392:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af6727513a07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9346b expref: 104 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.854400:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af6727513a07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9346b expref: 104 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.854433:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af6727513a07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9346b expref: 104 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144882.854444:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172239616:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144882.856302:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4139780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144882.864919:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172239616:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144882.864944:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144882.865005:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965174747648:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 10711us (10878us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144882.865016:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10120 00000100:00100000:0.0:1746144882.866006:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.872343:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.877139:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.877967:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174748160 00000100:00100000:1.0:1746144882.877975:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174748160 00002000:00100000:1.0:1746144882.878015:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008a2d5180 x1830965174748160/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 496/0 e 0 to 0 dl 1746144893 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.878023:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d5180 with x1830965174748160 ext(0->7) 00010000:00010000:1.0:1746144882.878030:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af6727513a07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9346b expref: 105 pid: 10401 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144882.878051:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af6727513a07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9346b expref: 105 pid: 10401 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144882.878057:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a2d5180 00000100:00100000:1.0:1746144882.878087:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1555 00000100:00100000:1.0:1746144882.878094:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+105:1982:x1830965174748160:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144882.878402:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+107:1982:x1830965174748160:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 309us (1277us total) trans 4294967909 rc 0/0 00000100:00100000:1.0:1746144882.878408:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1555 00002000:00100000:1.0:1746144882.878413:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008a2d5180 x1830965174748160/t4294967909(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:523/0 lens 496/448 e 0 to 0 dl 1746144893 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144882.878421:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d5180 with x1830965174748160 ext(0->7) 00010000:00010000:1.0:1746144882.878424:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af6727513a07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9346b expref: 107 pid: 10401 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144882.878433:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af6727513a07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9346b expref: 107 pid: 10401 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144882.878438:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a2d5180 00000100:00100000:0.0:1746144882.889343:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.889446:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.889965:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174748288 00000100:00100000:1.0:1746144882.889970:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174748288 00010000:00010000:1.0:1746144882.889988:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af6727513a07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9346b expref: 109 pid: 10401 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144882.890007:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10121 00000100:00100000:1.0:1746144882.890012:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+109:1982:x1830965174748288:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144882.890020:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144882.890050:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af6727513a07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9346b expref: 109 pid: 10401 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144882.890060:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af6727513a07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9346b expref: 109 pid: 10401 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144882.890078:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af6727513a07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9346b expref: 109 pid: 10401 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144882.890095:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.890096:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.890102:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a0e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93472 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.890109:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93472 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.890128:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93472 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.890138:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93472 expref: 5 pid: 8432 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144882.890150:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172240000:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144882.890508:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4139780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144882.893096:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.893674:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172240000:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144882.893691:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144882.893714:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+107:1982:x1830965174748288:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3702us (4382us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144882.893722:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10121 00000100:00100000:0.0:1746144882.897370:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.897470:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174748800 00000100:00100000:1.0:1746144882.897480:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174748800 00010000:00010000:1.0:1746144882.897522:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93472 expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144882.897567:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10122 00000100:00100000:1.0:1746144882.897575:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174748800:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144882.897589:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144882.897611:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93472 expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144882.897623:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93472 expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144882.897645:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93472 expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144882.897678:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.897680:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144882.897687:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b76e400/0x4076af6727513a15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93479 expref: 106 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.897695:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b76e400/0x4076af6727513a15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93479 expref: 106 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144882.897731:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b76e400/0x4076af6727513a15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93479 expref: 106 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144882.897742:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172240128:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144882.898808:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4139780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144882.902949:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.902962:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172240128:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144882.902985:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144882.903029:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965174748800:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5455us (5668us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144882.903051:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10122 00000100:00100000:0.0:1746144882.913003:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144882.924084:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.931422:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.931468:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.931512:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174749440 00000100:00100000:0.0:1746144882.931521:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174749440 00010000:00010000:0.0:1746144882.931558:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b76e400/0x4076af6727513a15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93479 expref: 109 pid: 8432 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1746144882.931587:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10123 00000100:00100000:0.0:1746144882.931594:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+109:1984:x1830965174749440:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144882.931608:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746144882.931627:0:7098:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb blocks from disk: 3 -> 11 00010000:00010000:0.0:1746144882.931633:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b76e400/0x4076af6727513a15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93479 expref: 109 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1746144882.931645:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b76e400/0x4076af6727513a15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93479 expref: 109 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1746144882.931668:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b76e400/0x4076af6727513a15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93479 expref: 109 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1746144882.931688:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144882.931690:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144882.931697:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b76e600/0x4076af6727513a1c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93480 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.931704:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b76e600/0x4076af6727513a1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93480 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.931744:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b76e600/0x4076af6727513a1c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93480 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.937054:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b76e600/0x4076af6727513a1c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93480 expref: 5 pid: 8432 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1746144882.937067:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a2d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172240384:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144882.937131:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144882.940224:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.940386:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a2d6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172240384:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144882.940398:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144882.940419:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+109:1984:x1830965174749440:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 8826us (9010us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144882.940427:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10123 00000100:00100000:0.0:1746144882.954673:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.961293:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174750336 00000100:00100000:0.0:1746144882.961303:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174750336 00000100:00100000:0.0:1746144882.961358:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4709 00000100:00100000:0.0:1746144882.961366:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174750336:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144882.961387:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144882.961406:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727513a2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9348e expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.961435:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012d0d8800/0x4076af6727513a23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93487 expref: 108 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.961447:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144882.961449:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144882.961452:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727513a2a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9348e expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.961483:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012d0d8800/0x4076af6727513a23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93487 expref: 108 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.961495:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012d0d8800/0x4076af6727513a23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93487 expref: 108 pid: 8432 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1746144882.961508:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a2d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172240768:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144882.961590:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144882.963425:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a2d7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172240768:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144882.963447:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727513a2a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9348e expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.963462:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091751c00, rc 0) 00000100:00100000:0.0:1746144882.963494:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174750336:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2129us (2339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144882.963502:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4709 00000100:00100000:1.0:1746144882.966910:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000001:00080000:1.0:1746144882.971630:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967906 is committed 00000001:00080000:1.0:1746144882.971654:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967909 is committed 00000100:00100000:0.0:1746144882.979897:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.984880:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.984971:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.985024:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174750976 00000100:00100000:0.0:1746144882.985031:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174750976 00000100:00100000:0.0:1746144882.985073:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4710 00000100:00100000:0.0:1746144882.985079:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31565:x1830965174750976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144882.985096:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144882.985113:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091751200/0x4076af6727513a31 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93495 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.985142:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727513a2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9348e expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.985150:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144882.985151:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144882.985154:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091751200/0x4076af6727513a31 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93495 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.985180:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727513a2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9348e expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144882.985191:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727513a2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9348e expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1746144882.985201:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a2d7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172241024:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144882.986613:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144882.989138:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.991206:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.994184:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.997293:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144882.999679:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.002316:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144883.002729:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144883.007244:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144883.008302:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144883.010524:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.010606:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.011027:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174752384 00000100:00100000:1.0:1746144883.011031:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174752384 00002000:00100000:1.0:1746144883.011067:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d4e00 x1830965174752384/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.011076:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d4e00 with x1830965174752384 ext(0->4095) 00010000:00010000:1.0:1746144883.011081:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093167800/0x4076af6727513a3f lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934a3 expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.011090:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093167800/0x4076af6727513a3f lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934a3 expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.011096:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a2d4e00 00000100:00100000:1.0:1746144883.011109:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1562 00000100:00100000:1.0:1746144883.011114:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174752384:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144883.011262:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174752384:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 147us (745us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.011268:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1562 00002000:00100000:1.0:1746144883.011273:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d4e00 x1830965174752384/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.011280:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d4e00 with x1830965174752384 ext(0->4095) 00010000:00010000:1.0:1746144883.011284:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093167800/0x4076af6727513a3f lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934a3 expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.011291:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093167800/0x4076af6727513a3f lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934a3 expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.011297:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a2d4e00 00000100:00100000:0.0:1746144883.014548:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.018824:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.023411:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.030002:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.033886:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.035396:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174753408 00000100:00100000:1.0:1746144883.035412:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174753408 00002000:00100000:1.0:1746144883.035548:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800883da300 x1830965174753408/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.035559:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800883da300 with x1830965174753408 ext(0->4095) 00002000:00010000:1.0:1746144883.035564:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800883da300 00000100:00100000:1.0:1746144883.035601:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3644 00000100:00100000:1.0:1746144883.035608:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800883da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965174753408:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.035863:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800883da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965174753408:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 254us (1978us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.035869:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3644 00002000:00100000:1.0:1746144883.035875:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800883da300 x1830965174753408/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.035886:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800883da300 with x1830965174753408 ext(0->4095) 00002000:00010000:1.0:1746144883.035889:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800883da300 00000100:00100000:0.0:1746144883.044228:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.052570:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.053583:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174753664 00000100:00100000:1.0:1746144883.053591:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174753664 00002000:00100000:1.0:1746144883.053629:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800883dad80 x1830965174753664/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 496/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.053638:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800883dad80 with x1830965174753664 ext(0->7) 00010000:00010000:1.0:1746144883.053645:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9fa00/0x4076af6727513a4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934b1 expref: 10 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.053656:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb9fa00/0x4076af6727513a4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934b1 expref: 10 pid: 8432 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.053662:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800883dad80 00000100:00100000:1.0:1746144883.053690:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1564 00000100:00100000:1.0:1746144883.053696:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800883dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965174753664:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144883.054168:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800883dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1985:x1830965174753664:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 471us (1608us total) trans 4294967912 rc 0/0 00000100:00100000:1.0:1746144883.054173:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1564 00002000:00100000:1.0:1746144883.054178:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800883dad80 x1830965174753664/t4294967912(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 496/448 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.054184:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800883dad80 with x1830965174753664 ext(0->7) 00010000:00010000:1.0:1746144883.054189:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9fa00/0x4076af6727513a4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934b1 expref: 12 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.054201:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb9fa00/0x4076af6727513a4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934b1 expref: 12 pid: 8432 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.054206:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800883dad80 00000100:00100000:0.0:1746144883.059444:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.060365:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.064413:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.064618:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174754176 00000100:00100000:1.0:1746144883.064625:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174754176 00002000:00100000:1.0:1746144883.064661:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800883db800 x1830965174754176/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.064671:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800883db800 with x1830965174754176 ext(0->4095) 00010000:00010000:1.0:1746144883.064678:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513a54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934b8 expref: 6 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.064690:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513a54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934b8 expref: 6 pid: 20722 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.064696:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800883db800 00000100:00100000:1.0:1746144883.064712:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1565 00000100:00100000:1.0:1746144883.064718:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800883db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174754176:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.064891:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800883db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174754176:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 173us (478us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.064896:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1565 00002000:00100000:1.0:1746144883.064901:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800883db800 x1830965174754176/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.064908:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800883db800 with x1830965174754176 ext(0->4095) 00010000:00010000:1.0:1746144883.064912:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513a54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934b8 expref: 6 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.064920:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513a54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934b8 expref: 6 pid: 20722 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.064925:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800883db800 00000100:00100000:0.0:1746144883.068071:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.073964:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174754560 00000100:00100000:0.0:1746144883.073972:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174754560 00002000:00100000:0.0:1746144883.074013:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5df80 x1830965174754560/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144883.074023:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5df80 with x1830965174754560 ext(0->4095) 00002000:00010000:0.0:1746144883.074028:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5df80 00000100:00100000:0.0:1746144883.074064:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3645 00000100:00100000:0.0:1746144883.074071:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1985:x1830965174754560:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144883.074298:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1985:x1830965174754560:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 227us (392us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144883.074307:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3645 00002000:00100000:0.0:1746144883.074312:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5df80 x1830965174754560/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144883.074319:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5df80 with x1830965174754560 ext(0->4095) 00002000:00010000:0.0:1746144883.074322:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5df80 00000100:00100000:0.0:1746144883.082900:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.093857:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.096966:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.098613:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174754944 00000100:00100000:0.0:1746144883.098619:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174754944 00002000:00100000:0.0:1746144883.098652:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880087e3b480 x1830965174754944/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 496/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144883.098662:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3b480 with x1830965174754944 ext(0->7) 00010000:00010000:0.0:1746144883.098667:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af6727513a5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934bf expref: 14 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1746144883.098678:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af6727513a5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934bf expref: 14 pid: 20722 timeout: 577 lvb_type: 0 00002000:00010000:0.0:1746144883.098684:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e3b480 00000100:00100000:0.0:1746144883.098706:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1566 00000100:00100000:0.0:1746144883.098711:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+14:1985:x1830965174754944:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746144883.099897:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+15:1985:x1830965174754944:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 1184us (2934us total) trans 4294967913 rc 0/0 00000100:00100000:0.0:1746144883.099904:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1566 00002000:00100000:0.0:1746144883.099912:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880087e3b480 x1830965174754944/t4294967913(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 496/448 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144883.099919:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3b480 with x1830965174754944 ext(0->7) 00010000:00010000:0.0:1746144883.099925:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af6727513a5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934bf expref: 15 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1746144883.099935:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb9e400/0x4076af6727513a5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934bf expref: 15 pid: 20722 timeout: 577 lvb_type: 0 00002000:00010000:0.0:1746144883.099940:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e3b480 00000100:00100000:0.0:1746144883.108271:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.116276:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.125055:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.131557:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.131627:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174755712 00000100:00100000:1.0:1746144883.131636:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174755712 00002000:00100000:1.0:1746144883.131684:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398dc00 x1830965174755712/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.131694:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398dc00 with x1830965174755712 ext(0->4095) 00002000:00010000:1.0:1746144883.131699:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398dc00 00000100:00100000:1.0:1746144883.131735:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3646 00000100:00100000:1.0:1746144883.131743:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+14:1982:x1830965174755712:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144883.131957:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+14:1982:x1830965174755712:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 213us (409us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.131964:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3646 00002000:00100000:1.0:1746144883.131970:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398dc00 x1830965174755712/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.131977:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398dc00 with x1830965174755712 ext(0->4095) 00002000:00010000:1.0:1746144883.133286:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398dc00 00000100:00100000:0.0:1746144883.133807:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.144461:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.161699:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.169022:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.172838:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.172945:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174756480 00000100:00100000:1.0:1746144883.172955:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174756480 00002000:00100000:1.0:1746144883.173006:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e832a00 x1830965174756480/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.173017:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e832a00 with x1830965174756480 ext(0->4095) 00002000:00010000:1.0:1746144883.173023:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e832a00 00000100:00100000:1.0:1746144883.173062:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3647 00000100:00100000:1.0:1746144883.173070:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174756480:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144883.173232:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174756480:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 162us (405us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.173238:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3647 00002000:00100000:1.0:1746144883.173243:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e832a00 x1830965174756480/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.173250:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e832a00 with x1830965174756480 ext(0->4095) 00002000:00010000:1.0:1746144883.173253:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e832a00 00000100:00100000:0.0:1746144883.180182:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.180234:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.180321:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174756608 00000100:00100000:1.0:1746144883.180331:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174756608 00000100:00100000:1.0:1746144883.180381:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4721 00000100:00100000:1.0:1746144883.180389:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+17:31579:x1830965174756608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144883.180407:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.180425:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727513a7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af934e2 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.180454:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.180459:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b76e600/0x4076af6727513a77 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934db expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.180470:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.180473:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727513a7e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e2 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.180509:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b76e600/0x4076af6727513a77 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934db expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.180523:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727513a7e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e2 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.180532:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:1.0:1746144883.180573:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31579:x1830965174756608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 186us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.180579:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4721 00000100:00100000:0.0:1746144883.186652:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.187877:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174756992 00000100:00100000:1.0:1746144883.187888:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174756992 00002000:00100000:1.0:1746144883.187944:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e83800 x1830965174756992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.187955:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83800 with x1830965174756992 ext(0->4095) 00010000:00010000:1.0:1746144883.187965:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b76e600/0x4076af6727513a77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934db expref: 17 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.187979:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b76e600/0x4076af6727513a77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934db expref: 17 pid: 8432 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.187985:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e83800 00000100:00100000:1.0:1746144883.188022:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1569 00000100:00100000:1.0:1746144883.188030:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1985:x1830965174756992:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144883.188254:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1985:x1830965174756992:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 224us (1608us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.188262:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1569 00002000:00100000:1.0:1746144883.188267:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e83800 x1830965174756992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.188274:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83800 with x1830965174756992 ext(0->4095) 00010000:00010000:1.0:1746144883.188279:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b76e600/0x4076af6727513a77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934db expref: 17 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.188288:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b76e600/0x4076af6727513a77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934db expref: 17 pid: 8432 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.188294:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e83800 00000100:00100000:0.0:1746144883.192440:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.194684:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172243968:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144883.194708:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144883.194743:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1985:x1830965174757120:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2139us (2312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144883.194756:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10137 00000100:00100000:0.0:1746144883.196064:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.202368:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.206461:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.207275:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.207346:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174757760 00000100:00100000:1.0:1746144883.207355:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174757760 00010000:00010000:1.0:1746144883.207388:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727513a7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e2 expref: 16 pid: 20722 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.207423:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10138 00000100:00100000:1.0:1746144883.207429:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1984:x1830965174757760:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144883.207443:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144883.207464:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727513a7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e2 expref: 16 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.207479:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727513a7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e2 expref: 16 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.207504:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727513a7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e2 expref: 16 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.207531:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.207533:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.207541:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e9 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.207548:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e9 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.207580:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e9 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144883.207591:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172244224:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144883.207655:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144883.211132:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.211242:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172244224:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144883.211262:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144883.211303:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1984:x1830965174757760:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3873us (4028us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.211314:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10138 00000100:00100000:1.0:1746144883.211349:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174758016 00000100:00100000:1.0:1746144883.211355:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174758016 00002000:00100000:1.0:1746144883.211388:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a3b80 x1830965174758016/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.211397:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a3b80 with x1830965174758016 ext(0->4095) 00010000:00010000:1.0:1746144883.211405:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a85 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e9 expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.211417:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a85 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e9 expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.211424:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a3b80 00000100:00100000:1.0:1746144883.213922:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1570 00000100:00100000:1.0:1746144883.213934:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174758016:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.214125:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174758016:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 194us (3001us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.214132:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1570 00002000:00100000:1.0:1746144883.214140:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a3b80 x1830965174758016/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.214150:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a3b80 with x1830965174758016 ext(0->4095) 00010000:00010000:1.0:1746144883.214157:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e9 expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.214169:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e9 expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.214175:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a3b80 00000100:00100000:0.0:1746144883.220905:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.224023:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174758144 00000100:00100000:1.0:1746144883.224048:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174758144 00010000:00010000:1.0:1746144883.224094:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e9 expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.224128:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10139 00000100:00100000:1.0:1746144883.224136:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965174758144:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144883.224149:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144883.224170:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e9 expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.224182:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e9 expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.224207:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b76e200/0x4076af6727513a85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934e9 expref: 6 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.224240:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.224242:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.224249:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513a8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934f0 expref: 15 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.224257:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513a8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934f0 expref: 15 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.224292:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513a8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934f0 expref: 15 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144883.224308:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172244480:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144883.224402:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144883.229020:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.229571:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172244480:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144883.229590:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144883.230665:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965174758144:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6526us (9767us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.230675:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10139 00000100:00100000:0.0:1746144883.235860:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.249124:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.262954:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.263077:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174758784 00000100:00100000:0.0:1746144883.263088:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174758784 00010000:00010000:0.0:1746144883.263124:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513a8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934f0 expref: 18 pid: 8432 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1746144883.263148:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10140 00000100:00100000:0.0:1746144883.263154:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965174758784:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144883.263167:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144883.263190:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513a8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934f0 expref: 18 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1746144883.263201:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513a8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934f0 expref: 18 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1746144883.263222:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513a8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934f0 expref: 18 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:0.0:1746144883.263256:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144883.263258:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144883.263265:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb9ec00/0x4076af6727513a93 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934f7 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.263272:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb9ec00/0x4076af6727513a93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934f7 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.263303:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb9ec00/0x4076af6727513a93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934f7 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144883.263314:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938a3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172244736:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144883.263379:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144883.265644:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.272300:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.276937:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.277147:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174759296 00000100:00100000:1.0:1746144883.277157:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174759296 00000100:00100000:1.0:1746144883.277202:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4726 00000100:00100000:1.0:1746144883.277209:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31579:x1830965174759296:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144883.277226:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.277244:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513aa1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93505 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.277272:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.277277:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727513a9a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934fe expref: 20 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.277283:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.277287:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513aa1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93505 expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.277324:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727513a9a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af934fe expref: 20 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.277339:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513aa1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93505 expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.277350:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:1.0:1746144883.277394:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31579:x1830965174759296:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 186us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.277401:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4726 00000100:00100000:1.0:1746144883.278250:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.284246:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.288545:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.292796:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.300854:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.308384:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.315705:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.318694:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.344918:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.352212:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.352314:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174761344 00000100:00100000:1.0:1746144883.352324:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174761344 00002000:00100000:1.0:1746144883.352372:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008baf9180 x1830965174761344/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.352384:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008baf9180 with x1830965174761344 ext(0->4095) 00010000:00010000:1.0:1746144883.352395:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af6727513aaf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93513 expref: 21 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.352409:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af6727513aaf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93513 expref: 21 pid: 20722 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.352417:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008baf9180 00000100:00100000:1.0:1746144883.352455:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1574 00000100:00100000:1.0:1746144883.352463:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008baf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1984:x1830965174761344:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.352661:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008baf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1984:x1830965174761344:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 198us (461us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.352671:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1574 00002000:00100000:1.0:1746144883.352677:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008baf9180 x1830965174761344/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.352685:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008baf9180 with x1830965174761344 ext(0->4095) 00010000:00010000:1.0:1746144883.352690:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af6727513aaf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93513 expref: 21 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.352698:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2800/0x4076af6727513aaf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93513 expref: 21 pid: 20722 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.352703:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008baf9180 00000100:00100000:0.0:1746144883.354898:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.355561:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.362464:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.362567:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174761856 00000100:00100000:1.0:1746144883.362578:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174761856 00002000:00100000:1.0:1746144883.362626:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b4f9880 x1830965174761856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.362637:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4f9880 with x1830965174761856 ext(0->4095) 00010000:00010000:1.0:1746144883.362646:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cf00c00/0x4076af6727513ab6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9351a expref: 20 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.362661:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cf00c00/0x4076af6727513ab6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9351a expref: 20 pid: 8432 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.362668:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b4f9880 00000100:00100000:1.0:1746144883.362994:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1575 00000100:00100000:1.0:1746144883.363003:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1985:x1830965174761856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.363210:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1985:x1830965174761856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 207us (755us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.363216:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1575 00002000:00100000:1.0:1746144883.363222:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b4f9880 x1830965174761856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.363230:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4f9880 with x1830965174761856 ext(0->4095) 00010000:00010000:1.0:1746144883.363235:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cf00c00/0x4076af6727513ab6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9351a expref: 20 pid: 8432 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.363244:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cf00c00/0x4076af6727513ab6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9351a expref: 20 pid: 8432 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.363251:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b4f9880 00000100:00100000:0.0:1746144883.367889:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.367990:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.371199:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174761984 00000100:00100000:1.0:1746144883.371213:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174761984 00000100:00100000:1.0:1746144883.371287:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4731 00000100:00100000:1.0:1746144883.371295:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31565:x1830965174761984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144883.371315:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.371334:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513ac4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93528 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.371363:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.371368:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cec0200/0x4076af6727513abd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93521 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.371374:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144883.371377:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513ac4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93528 expref: 21 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.371415:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cec0200/0x4076af6727513abd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93521 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.371428:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513ac4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93528 expref: 21 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.371438:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:1.0:1746144883.371501:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+21:31565:x1830965174761984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 207us (3624us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.371507:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4731 00000100:00100000:0.0:1746144883.377153:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.383865:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.389276:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174762752 00000100:00100000:1.0:1746144883.389285:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174762752 00002000:00100000:1.0:1746144883.389333:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38ce00 x1830965174762752/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.389342:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38ce00 with x1830965174762752 ext(0->4095) 00002000:00010000:1.0:1746144883.389347:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f38ce00 00000100:00100000:1.0:1746144883.389366:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3653 00000100:00100000:1.0:1746144883.389373:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1984:x1830965174762752:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.389558:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1984:x1830965174762752:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 185us (423us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.389563:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3653 00002000:00100000:1.0:1746144883.389568:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38ce00 x1830965174762752/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.389580:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38ce00 with x1830965174762752 ext(0->4095) 00002000:00010000:1.0:1746144883.389582:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f38ce00 00000100:00100000:0.0:1746144883.393398:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.398659:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.400451:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174763136 00000100:00100000:0.0:1746144883.400456:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174763136 00000100:00100000:0.0:1746144883.400492:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4733 00000100:00100000:0.0:1746144883.400500:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31565:x1830965174763136:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144883.400514:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144883.400529:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727513ad2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93536 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.400549:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf28600/0x4076af6727513acb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9352f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.400556:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144883.400558:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144883.400561:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727513ad2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93536 expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.400580:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf28600/0x4076af6727513acb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9352f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.400591:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf28600/0x4076af6727513acb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9352f expref: 5 pid: 20722 timeout: 577 lvb_type: 0 00000100:00100000:0.0:1746144883.400601:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a006680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172246912:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144883.400659:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144883.405869:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.405949:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a006680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172246912:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144883.405977:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727513ad2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93536 expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.405994:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091751c00, rc 0) 00000100:00100000:1.0:1746144883.406044:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+21:31565:x1830965174763136:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5536us (5866us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.406052:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4733 00000100:00100000:0.0:1746144883.414729:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.424980:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.449419:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.455554:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174763904 00000100:00100000:1.0:1746144883.455569:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174763904 00000100:00100000:1.0:1746144883.455633:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4734 00000100:00100000:1.0:1746144883.455641:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174763904:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144883.455660:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.455680:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ad9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9353d expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.455709:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727513ad2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93536 expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.455717:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.455718:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.455722:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ad9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9353d expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.455758:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727513ad2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93536 expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.455799:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727513ad2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93536 expref: 19 pid: 20722 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.455811:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172247168:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144883.455918:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144883.463668:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172247168:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144883.463708:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ad9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9353d expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.463726:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:1.0:1746144883.463812:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174763904:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 8170us (14402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.463821:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4734 00000100:00100000:0.0:1746144883.468835:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.468882:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.469529:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174764032 00000100:00100000:1.0:1746144883.469533:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174764032 00000100:00100000:1.0:1746144883.469556:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4735 00000100:00100000:1.0:1746144883.469564:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+22:31565:x1830965174764032:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144883.469572:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.469585:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513ae0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93544 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.469606:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.469612:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ad9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9353d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.469617:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144883.469621:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513ae0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93544 expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.469654:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ad9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9353d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.469665:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513ae0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93544 expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.469674:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:1.0:1746144883.469689:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+23:31565:x1830965174764032:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 128us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.469694:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4735 00000100:00100000:0.0:1746144883.472224:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.475695:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.476459:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174764544 00000100:00100000:1.0:1746144883.476466:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174764544 00002000:00100000:1.0:1746144883.476506:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac86680 x1830965174764544/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.476515:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac86680 with x1830965174764544 ext(0->4095) 00010000:00010000:1.0:1746144883.476524:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ad9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9353d expref: 6 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.476536:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ad9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9353d expref: 6 pid: 20722 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.476547:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac86680 00000100:00100000:1.0:1746144883.476575:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1579 00000100:00100000:1.0:1746144883.476582:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174764544:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144883.476744:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174764544:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 162us (1056us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.476750:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1579 00002000:00100000:1.0:1746144883.476755:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac86680 x1830965174764544/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.476778:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac86680 with x1830965174764544 ext(0->4095) 00010000:00010000:1.0:1746144883.476782:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ad9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9353d expref: 6 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.476791:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ad9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9353d expref: 6 pid: 20722 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.476797:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac86680 00000100:00100000:0.0:1746144883.479057:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.482256:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.486396:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.495093:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.498614:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174765184 00000100:00100000:1.0:1746144883.498629:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174765184 00002000:00100000:1.0:1746144883.498683:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009b463100 x1830965174765184/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 496/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.498694:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463100 with x1830965174765184 ext(0->7) 00010000:00010000:1.0:1746144883.498703:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513ae0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93544 expref: 22 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.498725:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513ae0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93544 expref: 22 pid: 20722 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.498732:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b463100 00000100:00100000:0.0:1746144883.502290:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.503944:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.509833:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.512723:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.518024:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.518280:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174766080 00000100:00100000:1.0:1746144883.518288:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174766080 00002000:00100000:1.0:1746144883.518331:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932ab100 x1830965174766080/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.518340:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932ab100 with x1830965174766080 ext(0->4095) 00002000:00010000:1.0:1746144883.518344:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800932ab100 00000100:00100000:1.0:1746144883.518363:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3656 00000100:00100000:1.0:1746144883.518369:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1982:x1830965174766080:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144883.518550:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1982:x1830965174766080:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 180us (527us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.518555:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3656 00002000:00100000:1.0:1746144883.518561:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932ab100 x1830965174766080/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.518568:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932ab100 with x1830965174766080 ext(0->4095) 00002000:00010000:1.0:1746144883.518570:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800932ab100 00000100:00100000:0.0:1746144883.534814:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.534928:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174766208 00000100:00100000:1.0:1746144883.534938:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174766208 00000100:00100000:0.0:1746144883.545592:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.554048:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.557708:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.560017:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.560640:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174766848 00000100:00100000:1.0:1746144883.560645:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174766848 00002000:00100000:1.0:1746144883.560683:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880099e84700 x1830965174766848/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.560693:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e84700 with x1830965174766848 ext(0->4095) 00010000:00010000:1.0:1746144883.560700:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a91d000/0x4076af6727513af5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93559 expref: 6 pid: 10401 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.560711:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a91d000/0x4076af6727513af5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93559 expref: 6 pid: 10401 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.560717:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099e84700 00000100:00100000:1.0:1746144883.562349:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1583 00000100:00100000:1.0:1746144883.562360:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174766848:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.562537:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174766848:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 179us (2524us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.562543:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1583 00002000:00100000:1.0:1746144883.562549:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880099e84700 x1830965174766848/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.562557:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e84700 with x1830965174766848 ext(0->4095) 00010000:00010000:1.0:1746144883.562564:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a91d000/0x4076af6727513af5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93559 expref: 6 pid: 10401 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.562576:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a91d000/0x4076af6727513af5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93559 expref: 6 pid: 10401 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.562582:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099e84700 00000100:00100000:0.0:1746144883.564936:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.566240:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.566642:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174767104 00000100:00100000:1.0:1746144883.566647:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174767104 00000100:00100000:1.0:1746144883.566676:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4740 00000100:00100000:1.0:1746144883.566681:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174767104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144883.566695:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.566707:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513b03 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93567 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.566725:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099aff200/0x4076af6727513afc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93560 expref: 25 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.566731:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.566733:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.566736:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513b03 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93567 expref: 7 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.566751:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099aff200/0x4076af6727513afc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93560 expref: 25 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.566778:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099aff200/0x4076af6727513afc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93560 expref: 25 pid: 10401 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.566787:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172248704:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144883.566831:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144883.570806:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172248704:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144883.570839:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513b03 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93567 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.570862:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:1.0:1746144883.570918:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174767104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4235us (4676us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.570926:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4740 00000100:00100000:0.0:1746144883.571024:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.575485:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.575536:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174767488 00000100:00100000:1.0:1746144883.575541:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174767488 00002000:00100000:1.0:1746144883.575577:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612ca80 x1830965174767488/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.575585:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ca80 with x1830965174767488 ext(0->4095) 00002000:00010000:1.0:1746144883.575589:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612ca80 00000100:00100000:1.0:1746144883.575613:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3657 00000100:00100000:1.0:1746144883.575618:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174767488:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.575805:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174767488:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 185us (320us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.575811:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3657 00002000:00100000:1.0:1746144883.575816:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612ca80 x1830965174767488/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.575824:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ca80 with x1830965174767488 ext(0->4095) 00002000:00010000:1.0:1746144883.575826:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612ca80 00000100:00100000:0.0:1746144883.577591:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.577667:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174767616 00000100:00100000:1.0:1746144883.577674:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174767616 00000100:00100000:1.0:1746144883.577739:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4741 00000100:00100000:1.0:1746144883.577746:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+25:31579:x1830965174767616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144883.577788:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.577806:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513b0a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9356e expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.577834:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513b03 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93567 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.577841:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.577843:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.577845:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513b0a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9356e expref: 26 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.577875:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513b03 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93567 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.577886:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513b03 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93567 expref: 5 pid: 20722 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.577897:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172248960:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144883.579079:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.579193:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144883.581527:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172248960:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144883.581554:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513b0a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9356e expref: 27 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.581568:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:1.0:1746144883.581714:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+27:31579:x1830965174767616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3967us (4127us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.581726:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4741 00000100:00100000:0.0:1746144883.582182:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.585850:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.588862:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.589012:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174768256 00000100:00100000:1.0:1746144883.589019:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174768256 00000100:00100000:1.0:1746144883.589068:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4743 00000100:00100000:1.0:1746144883.589075:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174768256:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144883.589089:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.589106:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513b18 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9357c expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.589130:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.589136:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a91d000/0x4076af6727513b11 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93575 expref: 26 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.589141:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144883.589144:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513b18 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9357c expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.589176:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a91d000/0x4076af6727513b11 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93575 expref: 26 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.589192:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513b18 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9357c expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.589200:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:1.0:1746144883.590213:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174768256:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1134us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.590221:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4743 00000100:00100000:1.0:1746144883.590353:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.595896:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174768640 00000100:00100000:1.0:1746144883.595903:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174768640 00002000:00100000:1.0:1746144883.595942:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5e680 x1830965174768640/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.595952:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5e680 with x1830965174768640 ext(0->4095) 00010000:00010000:1.0:1746144883.595960:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a91d000/0x4076af6727513b11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93575 expref: 26 pid: 10401 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.595973:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a91d000/0x4076af6727513b11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93575 expref: 26 pid: 10401 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.595979:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5e680 00000100:00100000:1.0:1746144883.596006:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1585 00000100:00100000:1.0:1746144883.596012:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1985:x1830965174768640:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144883.596195:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1985:x1830965174768640:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 183us (752us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.596201:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1585 00002000:00100000:1.0:1746144883.596206:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5e680 x1830965174768640/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.596213:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5e680 with x1830965174768640 ext(0->4095) 00010000:00010000:1.0:1746144883.596217:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a91d000/0x4076af6727513b11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93575 expref: 26 pid: 10401 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.596227:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a91d000/0x4076af6727513b11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93575 expref: 26 pid: 10401 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.596232:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5e680 00000100:00100000:0.0:1746144883.600349:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.600405:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.604625:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.609181:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.612487:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.612962:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174769536 00000100:00100000:1.0:1746144883.612969:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174769536 00002000:00100000:1.0:1746144883.613004:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea8a80 x1830965174769536/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.613013:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8a80 with x1830965174769536 ext(0->4095) 00002000:00010000:1.0:1746144883.613017:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea8a80 00000100:00100000:1.0:1746144883.613047:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3658 00000100:00100000:1.0:1746144883.613052:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1984:x1830965174769536:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.613203:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1984:x1830965174769536:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 150us (722us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.613208:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3658 00002000:00100000:1.0:1746144883.613212:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea8a80 x1830965174769536/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.613219:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8a80 with x1830965174769536 ext(0->4095) 00002000:00010000:1.0:1746144883.613221:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea8a80 00000100:00100000:0.0:1746144883.615269:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.620645:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.620968:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10161 00000100:00100000:1.0:1746144883.620976:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1985:x1830965174769792:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144883.620989:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144883.621011:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513b1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93583 expref: 26 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.621021:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513b1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93583 expref: 26 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.621054:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513b1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93583 expref: 26 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.621265:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.621267:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.621275:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b26 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9358a expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.621283:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9358a expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.621316:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9358a expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144883.621326:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172250112:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144883.622165:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144883.623623:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.624283:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.624493:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172250112:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144883.624513:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144883.624562:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1985:x1830965174769792:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3585us (3919us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.624571:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10161 00000100:00100000:0.0:1746144883.630923:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.631717:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.632780:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174770432 00000100:00100000:1.0:1746144883.632787:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174770432 00010000:00010000:1.0:1746144883.632815:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9358a expref: 6 pid: 8430 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.633131:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10162 00000100:00100000:1.0:1746144883.633138:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174770432:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144883.633150:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144883.633171:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b26 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9358a expref: 6 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.633182:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9358a expref: 6 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.633201:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9358a expref: 6 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.633230:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.633232:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.633238:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93591 expref: 26 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.633246:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93591 expref: 26 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.633270:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93591 expref: 26 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.633280:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93591 expref: 26 pid: 8430 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.633296:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172250496:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144883.633369:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144883.635393:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172250496:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144883.635417:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144883.635457:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965174770432:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2318us (3739us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.635467:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10162 00000100:00100000:0.0:1746144883.636304:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.639336:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.639509:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174770816 00000100:00100000:1.0:1746144883.639516:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174770816 00010000:00010000:1.0:1746144883.639547:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93591 expref: 27 pid: 8430 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.639990:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10163 00000100:00100000:1.0:1746144883.639998:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1983:x1830965174770816:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144883.640011:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144883.640030:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b2d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93591 expref: 27 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.640054:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93591 expref: 27 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.640077:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93591 expref: 27 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.640092:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.640095:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.640102:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af6727513b34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93598 expref: 26 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.640109:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af6727513b34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93598 expref: 26 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.640140:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af6727513b34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93598 expref: 26 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144883.640150:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172250624:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144883.640215:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144883.642816:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.642924:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172250624:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144883.642945:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144883.642983:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1983:x1830965174770816:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2985us (3655us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.642994:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10163 00000100:00100000:0.0:1746144883.647138:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.650085:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.650585:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174771328 00000100:00100000:1.0:1746144883.650591:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174771328 00010000:00010000:1.0:1746144883.650616:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af6727513b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93598 expref: 26 pid: 8430 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.650645:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10164 00000100:00100000:1.0:1746144883.650650:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800915a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1985:x1830965174771328:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144883.650661:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144883.650680:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af6727513b34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93598 expref: 26 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.650695:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af6727513b34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93598 expref: 26 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.650715:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af6727513b34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93598 expref: 26 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.651042:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.651044:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.651052:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9359f expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.651059:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9359f expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.651089:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9359f expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144883.651099:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172250880:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144883.651166:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144883.654179:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.654266:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172250880:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144883.654289:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144883.654332:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800915a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1985:x1830965174771328:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3681us (4246us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.654343:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10164 00000100:00100000:0.0:1746144883.654519:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.659607:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.660732:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.661352:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174771968 00000100:00100000:1.0:1746144883.661357:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174771968 00010000:00010000:1.0:1746144883.661375:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9359f expref: 6 pid: 8430 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.661392:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10165 00000100:00100000:1.0:1746144883.661397:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174771968:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144883.661405:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144883.661423:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b3b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9359f expref: 6 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.661435:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9359f expref: 6 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.661451:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b3b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9359f expref: 6 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.661477:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.661478:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.661483:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935a6 expref: 26 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.661490:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935a6 expref: 26 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.661508:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935a6 expref: 26 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.661518:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935a6 expref: 26 pid: 8430 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.661530:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172251264:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144883.661579:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144883.664820:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172251264:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144883.664842:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144883.664886:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965174771968:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3487us (4154us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.664897:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10165 00000100:00100000:1.0:1746144883.665556:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174772224 00000100:00100000:1.0:1746144883.665563:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174772224 00002000:00100000:1.0:1746144883.665600:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5f480 x1830965174772224/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.665610:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5f480 with x1830965174772224 ext(0->4095) 00010000:00010000:1.0:1746144883.665619:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935a6 expref: 27 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.665631:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935a6 expref: 27 pid: 8430 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.665638:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5f480 00000100:00100000:1.0:1746144883.665665:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1590 00000100:00100000:1.0:1746144883.665671:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1984:x1830965174772224:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.665860:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1984:x1830965174772224:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 188us (720us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.665869:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1590 00002000:00100000:1.0:1746144883.665874:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5f480 x1830965174772224/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.665881:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5f480 with x1830965174772224 ext(0->4095) 00010000:00010000:1.0:1746144883.665886:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935a6 expref: 27 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.665895:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935a6 expref: 27 pid: 8430 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.665901:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5f480 00000100:00100000:0.0:1746144883.668973:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.669089:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174772352 00000100:00100000:1.0:1746144883.669097:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174772352 00010000:00010000:1.0:1746144883.669131:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935a6 expref: 27 pid: 8430 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.669266:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10166 00000100:00100000:1.0:1746144883.669274:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1984:x1830965174772352:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144883.669288:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144883.669308:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935a6 expref: 27 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.669320:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935a6 expref: 27 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.669342:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513b42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935a6 expref: 27 pid: 8430 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.669493:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.669495:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.669503:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513b49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935ad expref: 26 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.669511:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513b49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935ad expref: 26 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.669542:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513b49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935ad expref: 26 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144883.669554:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172251392:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144883.670008:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144883.674357:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.674511:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172251392:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144883.674532:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144883.674573:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1984:x1830965174772352:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5300us (5609us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.674585:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10166 00000100:00100000:0.0:1746144883.678117:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.678336:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174772736 00000100:00100000:1.0:1746144883.678344:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174772736 00000100:00100000:1.0:1746144883.678531:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4751 00000100:00100000:1.0:1746144883.678539:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174772736:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144883.678557:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.678575:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513b50 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af935b4 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.678610:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513b49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935ad expref: 25 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.678617:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.678618:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.678622:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513b50 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935b4 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.678653:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513b49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935ad expref: 25 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.678665:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513b49 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935ad expref: 25 pid: 8430 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.678677:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172251520:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144883.678760:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144883.681454:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.681972:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172251520:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144883.682004:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513b50 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935b4 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.682022:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:1.0:1746144883.682084:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174772736:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3545us (3975us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.682093:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4751 00000100:00100000:0.0:1746144883.684020:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.684097:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174772992 00000100:00100000:1.0:1746144883.684102:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174772992 00000100:00100000:1.0:1746144883.684143:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4752 00000100:00100000:1.0:1746144883.684149:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+25:31565:x1830965174772992:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144883.684162:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.684175:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513b57 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af935bb expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.684198:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513b50 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935b4 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.684206:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.684207:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.684211:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513b57 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935bb expref: 26 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.684229:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513b50 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935b4 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.684239:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513b50 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935b4 expref: 5 pid: 20722 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.684247:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172251776:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144883.684288:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144883.684454:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.684651:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1591 00000100:00100000:1.0:1746144883.684658:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174773248:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.684866:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174773248:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 208us (411us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.684877:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1591 00002000:00100000:1.0:1746144883.684881:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa0380 x1830965174773248/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.684887:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0380 with x1830965174773248 ext(0->4095) 00010000:00010000:1.0:1746144883.684891:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513b50 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935b4 expref: 6 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.684899:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513b50 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935b4 expref: 6 pid: 20722 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.684904:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa0380 00000100:00100000:1.0:1746144883.686181:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172251776:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144883.686201:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513b57 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935bb expref: 26 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.686215:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:1.0:1746144883.686256:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+26:31565:x1830965174772992:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2107us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.686263:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4752 00000100:00100000:0.0:1746144883.687952:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.690392:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.694606:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.694677:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174773760 00000100:00100000:1.0:1746144883.694690:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174773760 00000100:00100000:1.0:1746144883.694748:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4753 00000100:00100000:1.0:1746144883.694757:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174773760:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144883.694806:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.695229:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513b5e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af935c2 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.695261:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513b57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935bb expref: 25 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.695269:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.695270:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.695274:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513b5e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935c2 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.695671:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513b57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935bb expref: 25 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.695685:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513b57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935bb expref: 25 pid: 20722 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.695697:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172252032:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144883.696106:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144883.698713:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172252032:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144883.698743:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513b5e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935c2 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.698786:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:1.0:1746144883.698828:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174773760:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4071us (4232us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.698837:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4753 00000100:00100000:0.0:1746144883.699318:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.699390:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174773888 00000100:00100000:1.0:1746144883.699397:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174773888 00002000:00100000:1.0:1746144883.699437:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009258ed80 x1830965174773888/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 496/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.699446:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258ed80 with x1830965174773888 ext(0->7) 00010000:00010000:1.0:1746144883.699453:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513b57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935bb expref: 26 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.699465:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513b57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935bb expref: 26 pid: 20722 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.699472:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258ed80 00000100:00100000:1.0:1746144883.699538:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1592 00000100:00100000:1.0:1746144883.699546:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1984:x1830965174773888:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144883.699961:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1984:x1830965174773888:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 415us (642us total) trans 4294967920 rc 0/0 00000100:00100000:1.0:1746144883.699968:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1592 00002000:00100000:1.0:1746144883.699973:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009258ed80 x1830965174773888/t4294967920(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 496/448 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.699980:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258ed80 with x1830965174773888 ext(0->7) 00010000:00010000:1.0:1746144883.699984:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513b57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935bb expref: 28 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.699993:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513b57 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935bb expref: 28 pid: 20722 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.700003:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258ed80 00000100:00100000:0.0:1746144883.702233:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.705564:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.705629:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174774272 00000100:00100000:1.0:1746144883.705637:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174774272 00002000:00100000:1.0:1746144883.705682:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258c700 x1830965174774272/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.705690:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258c700 with x1830965174774272 ext(0->4095) 00002000:00010000:1.0:1746144883.705694:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258c700 00000100:00100000:1.0:1746144883.705726:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3662 00000100:00100000:1.0:1746144883.705733:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174774272:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.706298:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174774272:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 564us (741us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.706304:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3662 00002000:00100000:1.0:1746144883.706309:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258c700 x1830965174774272/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.706316:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258c700 with x1830965174774272 ext(0->4095) 00002000:00010000:1.0:1746144883.706318:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258c700 00000100:00100000:0.0:1746144883.711385:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.711456:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174774400 00000100:00100000:0.0:1746144883.711467:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.711469:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174774400 00000100:00100000:1.0:1746144883.711536:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174774528 00000100:00100000:1.0:1746144883.711539:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174774528 00000100:00100000:1.0:1746144883.711561:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4754 00000100:00100000:1.0:1746144883.711569:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+28:31579:x1830965174774400:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144883.711589:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.711608:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727513b65 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af935c9 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.711639:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513b5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935c2 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.711645:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.711647:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.711651:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727513b65 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935c9 expref: 30 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.711929:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513b5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935c2 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.711941:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513b5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935c2 expref: 5 pid: 20722 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.711953:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172252416:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144883.712116:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144883.714799:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172252416:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144883.714819:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:1.0:1746144883.714833:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727513b65 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935c9 expref: 29 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.714849:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:1.0:1746144883.714903:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099719450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+29:31579:x1830965174774400:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3334us (3526us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.714913:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4754 00000100:00100000:1.0:1746144883.718248:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174774912 00000100:00100000:1.0:1746144883.718259:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174774912 00002000:00100000:1.0:1746144883.718306:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5c380 x1830965174774912/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.718315:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5c380 with x1830965174774912 ext(0->4095) 00010000:00010000:1.0:1746144883.718324:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727513b65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935c9 expref: 29 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.718337:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727513b65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935c9 expref: 29 pid: 20722 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.718344:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5c380 00000100:00100000:1.0:1746144883.718379:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1593 00000100:00100000:1.0:1746144883.718387:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+29:1984:x1830965174774912:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.718571:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+29:1984:x1830965174774912:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 184us (512us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.718578:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1593 00002000:00100000:1.0:1746144883.718583:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5c380 x1830965174774912/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.718590:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5c380 with x1830965174774912 ext(0->4095) 00010000:00010000:1.0:1746144883.718595:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727513b65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935c9 expref: 29 pid: 20722 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.718604:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727513b65 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935c9 expref: 29 pid: 20722 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.718615:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5c380 00000100:00100000:0.0:1746144883.720266:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.720340:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.721005:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174775040 00000100:00100000:1.0:1746144883.721012:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174775040 00000100:00100000:1.0:1746144883.721090:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4756 00000100:00100000:1.0:1746144883.721146:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174775040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144883.721163:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.721178:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513b73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af935d7 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.721204:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935d0 expref: 28 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.721211:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.721213:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.721215:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513b73 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935d7 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.721240:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935d0 expref: 28 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.721251:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af6727513b6c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935d0 expref: 28 pid: 10401 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.721261:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172252800:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144883.721343:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144883.723257:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.723313:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172252800:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144883.723342:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513b73 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935d7 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.723357:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:1.0:1746144883.723410:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174775040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2313us (3069us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.723418:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4756 00000100:00100000:0.0:1746144883.726319:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.726382:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.726392:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174775552 00000100:00100000:1.0:1746144883.726403:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174775552 00000100:00100000:1.0:1746144883.726459:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4757 00000100:00100000:1.0:1746144883.726467:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+29:31565:x1830965174775552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144883.726484:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.726499:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513b7a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af935de expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.726529:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.726535:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513b73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935d7 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.726541:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.726545:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513b7a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935de expref: 29 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.726594:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513b73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935d7 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.726618:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513b73 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935d7 expref: 5 pid: 20722 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.726636:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172252928:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144883.726731:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144883.729683:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172252928:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144883.729716:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513b7a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935de expref: 29 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.729733:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:1.0:1746144883.729803:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+29:31565:x1830965174775552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3335us (3487us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.729811:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4757 00000100:00100000:0.0:1746144883.730323:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.734806:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.739513:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.745600:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.747369:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174776448 00000100:00100000:1.0:1746144883.747382:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174776448 00000100:00100000:1.0:1746144883.747901:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4758 00000100:00100000:1.0:1746144883.747910:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174776448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144883.750013:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.750049:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513b81 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af935e5 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.750088:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513b7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935de expref: 27 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.750096:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.750098:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.750101:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513b81 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935e5 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.750146:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513b7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935de expref: 27 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.750160:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513b7a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935de expref: 27 pid: 20722 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.750172:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172253312:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144883.750284:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144883.754221:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172253312:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144883.754257:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513b81 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935e5 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.754276:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753c00, rc 0) 00000100:00100000:1.0:1746144883.754330:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174776448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6420us (8742us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.754339:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4758 00000100:00100000:0.0:1746144883.758127:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.762944:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.768609:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.768885:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174776832 00000100:00100000:1.0:1746144883.768895:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174776832 00000100:00100000:1.0:1746144883.768954:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4759 00000100:00100000:1.0:1746144883.768963:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31565:x1830965174776832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144883.769228:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:1.0:1746144883.769272:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.769291:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513b88 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af935ec expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.769321:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513b81 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935e5 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.769329:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.769331:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.769334:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513b88 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935ec expref: 31 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.769364:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513b81 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935e5 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.769376:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513b81 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935e5 expref: 6 pid: 20722 timeout: 577 lvb_type: 0 00000100:00100000:1.0:1746144883.769386:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172253568:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144883.769456:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144883.772516:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.774742:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172253568:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144883.774797:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513b88 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935ec expref: 30 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.774817:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:1.0:1746144883.774870:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31565:x1830965174776832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5907us (6271us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.774880:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4759 00000100:00100000:1.0:1746144883.774910:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174777216 00000100:00100000:1.0:1746144883.774915:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174777216 00000100:00100000:1.0:1746144883.774965:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4760 00000100:00100000:1.0:1746144883.774972:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31579:x1830965174777216:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144883.774988:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144883.775003:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513b8f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af935f3 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.775024:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144883.775028:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513b88 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935ec expref: 31 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.775064:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144883.775068:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513b8f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935f3 expref: 31 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.775097:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513b88 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935ec expref: 31 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.775107:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513b8f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af935f3 expref: 31 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144883.775114:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:1.0:1746144883.775132:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31579:x1830965174777216:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 161us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144883.775138:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4760 00000100:00100000:0.0:1746144883.775479:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.780432:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.782833:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.788143:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.788330:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174777984 00000100:00100000:1.0:1746144883.788338:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174777984 00002000:00100000:1.0:1746144883.788376:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e57b80 x1830965174777984/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.788385:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e57b80 with x1830965174777984 ext(0->4095) 00002000:00010000:1.0:1746144883.788391:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e57b80 00000100:00100000:1.0:1746144883.788415:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3665 00000100:00100000:1.0:1746144883.788421:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1985:x1830965174777984:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144883.788571:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1985:x1830965174777984:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 150us (428us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.788576:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3665 00002000:00100000:1.0:1746144883.788580:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e57b80 x1830965174777984/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.788587:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e57b80 with x1830965174777984 ext(0->4095) 00002000:00010000:1.0:1746144883.788589:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e57b80 00000100:00100000:0.0:1746144883.790510:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.794157:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.799196:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.800355:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.805233:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.805281:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.815074:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.815162:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174779136 00000100:00100000:1.0:1746144883.815173:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174779136 00002000:00100000:1.0:1746144883.815710:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167ca80 x1830965174779136/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.815720:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167ca80 with x1830965174779136 ext(0->4095) 00010000:00010000:1.0:1746144883.815728:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513b9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93601 expref: 31 pid: 10401 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.815741:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513b9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93601 expref: 31 pid: 10401 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.815747:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009167ca80 00000100:00100000:1.0:1746144883.815779:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1599 00000100:00100000:1.0:1746144883.815785:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1984:x1830965174779136:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.815954:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1984:x1830965174779136:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 169us (894us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.815958:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1599 00002000:00100000:1.0:1746144883.815963:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167ca80 x1830965174779136/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.815969:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167ca80 with x1830965174779136 ext(0->4095) 00010000:00010000:1.0:1746144883.815973:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513b9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93601 expref: 31 pid: 10401 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.815981:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513b9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93601 expref: 31 pid: 10401 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.815987:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009167ca80 00000100:00100000:0.0:1746144883.822314:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.827048:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.831309:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.834027:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.836952:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.837000:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.844577:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.844617:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174780288 00000100:00100000:0.0:1746144883.844625:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174780288 00000100:00100000:0.0:1746144883.844669:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4766 00000100:00100000:0.0:1746144883.844678:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31579:x1830965174780288:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144883.844698:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144883.844716:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091751200/0x4076af6727513bb9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9361d expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.844745:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144883.844751:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513bb2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93616 expref: 32 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.844757:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144883.844761:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091751200/0x4076af6727513bb9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9361d expref: 32 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.844815:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513bb2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93616 expref: 32 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.844827:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091751200/0x4076af6727513bb9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9361d expref: 32 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.844837:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091751200, rc 0) 00000100:00100000:0.0:1746144883.844872:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+32:31579:x1830965174780288:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 195us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144883.844878:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4766 00000100:00100000:0.0:1746144883.846464:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.852258:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.852566:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174780672 00000100:00100000:1.0:1746144883.852573:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174780672 00002000:00100000:1.0:1746144883.852614:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ed80 x1830965174780672/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.852623:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ed80 with x1830965174780672 ext(0->4095) 00010000:00010000:1.0:1746144883.852631:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513bb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93616 expref: 31 pid: 10401 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.852643:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513bb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93616 expref: 31 pid: 10401 timeout: 577 lvb_type: 0 00002000:00010000:1.0:1746144883.852649:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5ed80 00000100:00100000:1.0:1746144883.852698:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1601 00000100:00100000:1.0:1746144883.852704:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1984:x1830965174780672:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.852885:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1984:x1830965174780672:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 181us (638us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.852891:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1601 00002000:00100000:1.0:1746144883.852896:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ed80 x1830965174780672/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.852903:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ed80 with x1830965174780672 ext(0->4095) 00010000:00010000:1.0:1746144883.852907:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513bb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93616 expref: 31 pid: 10401 timeout: 577 lvb_type: 0 00010000:00010000:1.0:1746144883.852915:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513bb2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93616 expref: 31 pid: 10401 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144883.852921:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5ed80 00000100:00100000:0.0:1746144883.856553:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.860362:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.864631:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.868598:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.872336:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.873696:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.879099:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.879185:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.883641:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.887343:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.891741:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.894153:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.898726:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.903207:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.903328:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.905841:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.907216:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.910805:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.911652:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174783744 00000100:00100000:1.0:1746144883.911659:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174783744 00002000:00100000:1.0:1746144883.911697:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ee680 x1830965174783744/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.911707:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ee680 with x1830965174783744 ext(0->4095) 00010000:00010000:1.0:1746144883.911715:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513bdc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93640 expref: 31 pid: 10401 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144883.911728:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513bdc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93640 expref: 31 pid: 10401 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144883.911740:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ee680 00000100:00100000:1.0:1746144883.911782:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1604 00000100:00100000:1.0:1746144883.911790:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1984:x1830965174783744:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.912513:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1984:x1830965174783744:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 722us (1757us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.912520:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1604 00002000:00100000:1.0:1746144883.912526:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ee680 x1830965174783744/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.912534:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ee680 with x1830965174783744 ext(0->4095) 00010000:00010000:1.0:1746144883.912539:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513bdc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93640 expref: 31 pid: 10401 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144883.912550:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513bdc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93640 expref: 31 pid: 10401 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144883.912556:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ee680 00000100:00100000:0.0:1746144883.914921:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.917612:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.917871:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174784128 00000100:00100000:1.0:1746144883.917877:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174784128 00002000:00100000:1.0:1746144883.917922:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918edf80 x1830965174784128/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.917932:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918edf80 with x1830965174784128 ext(0->4095) 00002000:00010000:1.0:1746144883.917937:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918edf80 00000100:00100000:1.0:1746144883.917956:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3670 00000100:00100000:1.0:1746144883.917964:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965174784128:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144883.918905:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1985:x1830965174784128:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 940us (1299us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.918912:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3670 00002000:00100000:1.0:1746144883.918917:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918edf80 x1830965174784128/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.918925:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918edf80 with x1830965174784128 ext(0->4095) 00002000:00010000:1.0:1746144883.918928:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918edf80 00000100:00100000:0.0:1746144883.921759:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174784256 00000100:00100000:0.0:1746144883.921833:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174784256 00000100:00100000:0.0:1746144883.921921:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4773 00000100:00100000:0.0:1746144883.921929:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174784256:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144883.921946:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144883.921965:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727513bea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9364e expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.921995:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513be3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93647 expref: 29 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.922003:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144883.922005:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144883.922008:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727513bea lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9364e expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.922046:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513be3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93647 expref: 29 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.922065:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513be3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93647 expref: 29 pid: 10401 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1746144883.922076:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800918ec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172257152:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144883.922160:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144883.925047:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.928070:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.931855:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.931936:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.935386:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.941505:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.941572:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174785280 00000100:00100000:1.0:1746144883.941581:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174785280 00002000:00100000:1.0:1746144883.941635:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093255c00 x1830965174785280/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.941645:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093255c00 with x1830965174785280 ext(0->4095) 00010000:00010000:1.0:1746144883.941660:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513bf8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9365c expref: 31 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144883.941675:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513bf8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9365c expref: 31 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144883.941682:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093255c00 00000100:00100000:1.0:1746144883.941715:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1605 00000100:00100000:1.0:1746144883.941722:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965174785280:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144883.942838:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965174785280:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1114us (1343us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.942849:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1605 00002000:00100000:1.0:1746144883.942856:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093255c00 x1830965174785280/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.942864:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093255c00 with x1830965174785280 ext(0->4095) 00010000:00010000:1.0:1746144883.942871:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513bf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9365c expref: 31 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144883.942880:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513bf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9365c expref: 31 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144883.942886:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093255c00 00000100:00100000:0.0:1746144883.945097:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.948436:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.953420:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.953459:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174785792 00000100:00100000:1.0:1746144883.953465:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174785792 00002000:00100000:1.0:1746144883.953501:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093254e00 x1830965174785792/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.953511:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254e00 with x1830965174785792 ext(0->4095) 00010000:00010000:1.0:1746144883.953518:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727513bf1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93655 expref: 30 pid: 10401 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144883.953530:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727513bf1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93655 expref: 30 pid: 10401 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144883.953536:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093254e00 00000100:00100000:1.0:1746144883.953961:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1606 00000100:00100000:1.0:1746144883.953969:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965174785792:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.954132:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965174785792:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 164us (713us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.954137:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1606 00002000:00100000:1.0:1746144883.954142:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093254e00 x1830965174785792/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.954149:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254e00 with x1830965174785792 ext(0->4095) 00010000:00010000:1.0:1746144883.954153:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727513bf1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93655 expref: 30 pid: 10401 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144883.954162:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727513bf1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93655 expref: 30 pid: 10401 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144883.954167:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093254e00 00000100:00100000:0.0:1746144883.956733:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.956940:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.960645:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.964105:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.966598:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.966952:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174786688 00000100:00100000:1.0:1746144883.966958:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174786688 00002000:00100000:1.0:1746144883.966990:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880099a3dc50 x1830965174786688/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.967000:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099a3dc50 with x1830965174786688 ext(0->4095) 00002000:00010000:1.0:1746144883.967005:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099a3dc50 00000100:00100000:1.0:1746144883.967038:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3672 00000100:00100000:1.0:1746144883.967045:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099a3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965174786688:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144883.967204:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099a3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965174786688:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 159us (611us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.967210:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3672 00002000:00100000:1.0:1746144883.967216:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880099a3dc50 x1830965174786688/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.967223:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099a3dc50 with x1830965174786688 ext(0->4095) 00002000:00010000:1.0:1746144883.967226:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099a3dc50 00000100:00100000:0.0:1746144883.970247:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.973282:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.977097:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.977871:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174787200 00000100:00100000:1.0:1746144883.977878:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174787200 00002000:00100000:1.0:1746144883.977916:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093256680 x1830965174787200/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.977925:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256680 with x1830965174787200 ext(0->4095) 00002000:00010000:1.0:1746144883.977929:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093256680 00000100:00100000:1.0:1746144883.977981:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3673 00000100:00100000:1.0:1746144883.977988:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174787200:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144883.978151:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174787200:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 164us (1063us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.978157:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3673 00002000:00100000:1.0:1746144883.978162:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093256680 x1830965174787200/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.978169:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256680 with x1830965174787200 ext(0->4095) 00002000:00010000:1.0:1746144883.978172:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093256680 00000100:00100000:0.0:1746144883.980388:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.982281:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.985383:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.989090:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.992137:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144883.994936:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144883.995036:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174788224 00000100:00100000:1.0:1746144883.995042:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174788224 00002000:00100000:1.0:1746144883.995070:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093257480 x1830965174788224/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/0 e 0 to 0 dl 1746144894 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.995085:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257480 with x1830965174788224 ext(0->4095) 00002000:00010000:1.0:1746144883.995088:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093257480 00000100:00100000:1.0:1746144883.995112:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3674 00000100:00100000:1.0:1746144883.995118:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1982:x1830965174788224:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144883.995242:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1982:x1830965174788224:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 124us (306us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144883.995247:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3674 00002000:00100000:1.0:1746144883.995252:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093257480 x1830965174788224/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:524/0 lens 488/4536 e 0 to 0 dl 1746144894 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144883.995259:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257480 with x1830965174788224 ext(0->4095) 00002000:00010000:1.0:1746144883.995262:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093257480 00000100:00100000:0.0:1746144883.998129:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174788352 00000100:00100000:0.0:1746144883.998137:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174788352 00000100:00100000:0.0:1746144883.998183:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4781 00000100:00100000:0.0:1746144883.998189:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174788352:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144883.998207:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144883.998220:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091751400/0x4076af6727513c22 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93686 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.998242:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513c1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9367f expref: 29 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.998248:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144883.998250:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144883.998253:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091751400/0x4076af6727513c22 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93686 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.998277:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513c1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9367f expref: 29 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144883.998286:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513c1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9367f expref: 29 pid: 8432 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1746144883.998296:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093257800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172259200:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144883.998505:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144884.001733:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.005528:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174788864 00000100:00100000:0.0:1746144884.005533:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174788864 00000100:00100000:0.0:1746144884.005558:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4782 00000100:00100000:0.0:1746144884.005565:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+29:31565:x1830965174788864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144884.005578:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144884.006695:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091751200/0x4076af6727513c29 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9368d expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.006722:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091751400/0x4076af6727513c22 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93686 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.006729:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144884.006731:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144884.006734:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091751200/0x4076af6727513c29 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9368d expref: 30 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.006781:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091751400/0x4076af6727513c22 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93686 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.007210:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091751400/0x4076af6727513c22 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93686 expref: 5 pid: 20722 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1746144884.007222:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093256300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172259456:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144884.007294:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144884.011323:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.012079:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.015585:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.015651:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174789376 00000100:00100000:1.0:1746144884.015657:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174789376 00002000:00100000:1.0:1746144884.015692:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093257100 x1830965174789376/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.015700:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257100 with x1830965174789376 ext(0->4095) 00010000:00010000:1.0:1746144884.015707:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091751200/0x4076af6727513c29 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9368d expref: 31 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.015718:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091751200/0x4076af6727513c29 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9368d expref: 31 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.015724:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093257100 00000100:00100000:1.0:1746144884.015740:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1609 00000100:00100000:1.0:1746144884.015747:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1984:x1830965174789376:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144884.015927:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1984:x1830965174789376:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 180us (341us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.015932:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1609 00002000:00100000:1.0:1746144884.015936:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093257100 x1830965174789376/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.015943:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257100 with x1830965174789376 ext(0->4095) 00010000:00010000:1.0:1746144884.015948:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091751200/0x4076af6727513c29 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9368d expref: 31 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.015956:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091751200/0x4076af6727513c29 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9368d expref: 31 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.015962:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093257100 00000100:00100000:0.0:1746144884.019487:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.023062:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.025350:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.029692:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.032666:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.034188:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.040436:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.040494:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.044686:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.048756:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.051917:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.054510:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.058208:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.062210:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.062385:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.062848:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174791808 00000100:00100000:1.0:1746144884.062853:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174791808 00002000:00100000:1.0:1746144884.062882:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918efb80 x1830965174791808/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.062891:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918efb80 with x1830965174791808 ext(0->4095) 00010000:00010000:1.0:1746144884.062897:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513c4c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af936b0 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.062906:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513c4c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af936b0 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.062916:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918efb80 00000100:00100000:1.0:1746144884.062930:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1611 00000100:00100000:1.0:1746144884.062935:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174791808:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144884.063100:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174791808:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 164us (891us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.063106:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1611 00002000:00100000:1.0:1746144884.063111:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918efb80 x1830965174791808/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.063119:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918efb80 with x1830965174791808 ext(0->4095) 00010000:00010000:1.0:1746144884.063124:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513c4c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af936b0 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.063132:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513c4c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af936b0 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.063137:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918efb80 00000100:00100000:0.0:1746144884.065001:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.067199:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.072544:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.078225:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.081431:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.081685:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174792832 00000100:00100000:1.0:1746144884.081692:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174792832 00002000:00100000:1.0:1746144884.081732:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924d8700 x1830965174792832/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.081741:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d8700 with x1830965174792832 ext(0->4095) 00002000:00010000:1.0:1746144884.081746:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d8700 00000100:00100000:1.0:1746144884.081801:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3679 00000100:00100000:1.0:1746144884.081810:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1985:x1830965174792832:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144884.081979:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1985:x1830965174792832:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 170us (555us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.081985:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3679 00002000:00100000:1.0:1746144884.081990:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924d8700 x1830965174792832/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.081997:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d8700 with x1830965174792832 ext(0->4095) 00002000:00010000:1.0:1746144884.081999:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d8700 00000100:00100000:0.0:1746144884.084268:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.086737:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.093919:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.093964:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.098842:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.102459:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.108243:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.112633:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172262016:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144884.112662:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513c6f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af936d3 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.112680:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5480400, rc 0) 00000100:00100000:0.0:1746144884.112725:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174793984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4125us (4487us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144884.112732:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4792 00000100:00100000:0.0:1746144884.116702:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.127359:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.127422:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174794496 00000100:00100000:1.0:1746144884.127431:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174794496 00002000:00100000:1.0:1746144884.127472:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417fb80 x1830965174794496/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.127483:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417fb80 with x1830965174794496 ext(0->4095) 00002000:00010000:1.0:1746144884.127489:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417fb80 00000100:00100000:1.0:1746144884.127524:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3682 00000100:00100000:1.0:1746144884.127532:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174794496:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144884.127683:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174794496:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 150us (329us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.127689:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3682 00002000:00100000:1.0:1746144884.127694:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417fb80 x1830965174794496/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.127701:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417fb80 with x1830965174794496 ext(0->4095) 00002000:00010000:1.0:1746144884.127705:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417fb80 00000100:00100000:0.0:1746144884.130106:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.136673:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.137308:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.144930:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.146187:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1615 00000100:00100000:1.0:1746144884.146197:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1985:x1830965174795136:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144884.146407:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1985:x1830965174795136:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 211us (1488us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.146414:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1615 00002000:00100000:1.0:1746144884.146419:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417f480 x1830965174795136/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.146427:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417f480 with x1830965174795136 ext(0->4095) 00010000:00010000:1.0:1746144884.146433:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513c76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af936da expref: 33 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.146443:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513c76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af936da expref: 33 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.146448:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417f480 00000100:00100000:0.0:1746144884.149652:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.153617:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.157279:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.159564:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.161902:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.162301:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174796032 00000100:00100000:1.0:1746144884.162310:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174796032 00002000:00100000:1.0:1746144884.162350:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417ce00 x1830965174796032/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.162359:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417ce00 with x1830965174796032 ext(0->4095) 00002000:00010000:1.0:1746144884.162363:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417ce00 00000100:00100000:1.0:1746144884.162624:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3684 00000100:00100000:1.0:1746144884.162636:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174796032:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144884.164101:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.164319:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174796032:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 1682us (2420us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.164327:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3684 00002000:00100000:1.0:1746144884.164335:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417ce00 x1830965174796032/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.164343:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417ce00 with x1830965174796032 ext(0->4095) 00002000:00010000:1.0:1746144884.164347:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417ce00 00000100:00100000:0.0:1746144884.168439:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.170957:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.179540:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.179620:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174796672 00000100:00100000:1.0:1746144884.179628:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174796672 00002000:00100000:1.0:1746144884.179673:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417c000 x1830965174796672/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.179682:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417c000 with x1830965174796672 ext(0->4095) 00010000:00010000:1.0:1746144884.179691:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af6727513c8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af936ef expref: 33 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.179704:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af6727513c8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af936ef expref: 33 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.179711:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417c000 00000100:00100000:1.0:1746144884.179744:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1616 00000100:00100000:1.0:1746144884.179751:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1985:x1830965174796672:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144884.179959:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1985:x1830965174796672:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 209us (425us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.179966:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1616 00002000:00100000:1.0:1746144884.179972:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417c000 x1830965174796672/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.179979:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417c000 with x1830965174796672 ext(0->4095) 00010000:00010000:1.0:1746144884.179984:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af6727513c8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af936ef expref: 33 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.179992:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af6727513c8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af936ef expref: 33 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.179998:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417c000 00000100:00100000:0.0:1746144884.183364:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.191272:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.196460:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.208995:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.210553:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174797312 00000100:00100000:1.0:1746144884.210565:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174797312 00002000:00100000:1.0:1746144884.210614:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008e833480 x1830965174797312/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 496/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.210623:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e833480 with x1830965174797312 ext(0->7) 00010000:00010000:1.0:1746144884.210633:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727513c92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af936f6 expref: 32 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.210647:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727513c92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af936f6 expref: 32 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.210653:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e833480 00000100:00100000:1.0:1746144884.210687:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1617 00000100:00100000:1.0:1746144884.210694:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1985:x1830965174797312:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144884.213458:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1985:x1830965174797312:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 2750us (4454us total) trans 4294967923 rc 0/0 00000100:00100000:1.0:1746144884.213475:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1617 00002000:00100000:1.0:1746144884.213486:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008e833480 x1830965174797312/t4294967923(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 496/448 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.213495:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e833480 with x1830965174797312 ext(0->7) 00010000:00010000:1.0:1746144884.213506:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727513c92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af936f6 expref: 34 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.213522:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727513c92 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af936f6 expref: 34 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.213529:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e833480 00000100:00100000:0.0:1746144884.220648:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.221010:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174797696 00000100:00100000:1.0:1746144884.221018:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174797696 00002000:00100000:1.0:1746144884.221073:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e833800 x1830965174797696/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.221083:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e833800 with x1830965174797696 ext(0->4095) 00002000:00010000:1.0:1746144884.221087:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e833800 00000100:00100000:1.0:1746144884.221115:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3686 00000100:00100000:1.0:1746144884.221122:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965174797696:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144884.221290:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965174797696:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 168us (656us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.221296:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3686 00002000:00100000:1.0:1746144884.221302:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e833800 x1830965174797696/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.221315:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e833800 with x1830965174797696 ext(0->4095) 00002000:00010000:1.0:1746144884.221317:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e833800 00000100:00100000:0.0:1746144884.227557:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.227647:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.227807:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174797952 00000100:00100000:1.0:1746144884.227814:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174797952 00000100:00100000:1.0:1746144884.227852:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4800 00000100:00100000:1.0:1746144884.227860:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+35:31565:x1830965174797952:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144884.227874:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144884.227887:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ca7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9370b expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.227906:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.227911:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513ca0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93704 expref: 36 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.227916:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144884.227919:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ca7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9370b expref: 36 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.227948:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513ca0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93704 expref: 36 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.227960:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ca7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9370b expref: 36 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.227967:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:1.0:1746144884.227984:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+36:31565:x1830965174797952:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 126us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.227990:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4800 00000100:00100000:0.0:1746144884.232269:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.237092:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.240926:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.246984:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.257885:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1619 00000100:00100000:1.0:1746144884.257899:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1984:x1830965174798976:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144884.258255:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1984:x1830965174798976:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 360us (2057us total) trans 4294967924 rc 0/0 00000100:00100000:1.0:1746144884.258262:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1619 00002000:00100000:1.0:1746144884.258269:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880087c5dc00 x1830965174798976/t4294967924(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 496/448 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.258275:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5dc00 with x1830965174798976 ext(0->7) 00010000:00010000:1.0:1746144884.258282:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ca7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9370b expref: 36 pid: 10401 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.258293:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ca7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9370b expref: 36 pid: 10401 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.258299:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5dc00 00000100:00100000:0.0:1746144884.265055:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.271131:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.271667:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.274112:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.275980:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.279428:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.279962:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174800000 00000100:00100000:1.0:1746144884.279968:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174800000 00002000:00100000:1.0:1746144884.280006:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e831180 x1830965174800000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.280016:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e831180 with x1830965174800000 ext(0->4095) 00010000:00010000:1.0:1746144884.280049:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513cb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93719 expref: 37 pid: 8432 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.280063:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513cb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93719 expref: 37 pid: 8432 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.280071:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e831180 00000100:00100000:1.0:1746144884.280131:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1621 00000100:00100000:1.0:1746144884.280138:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+37:1985:x1830965174800000:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144884.280333:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+37:1985:x1830965174800000:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 195us (904us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.280339:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1621 00002000:00100000:1.0:1746144884.280345:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e831180 x1830965174800000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.280352:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e831180 with x1830965174800000 ext(0->4095) 00010000:00010000:1.0:1746144884.280356:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513cb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93719 expref: 37 pid: 8432 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.280365:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513cb5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93719 expref: 37 pid: 8432 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.280371:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e831180 00000100:00100000:0.0:1746144884.283468:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.289259:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.289411:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174800384 00000100:00100000:1.0:1746144884.289420:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174800384 00002000:00100000:1.0:1746144884.289465:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e830a80 x1830965174800384/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.289475:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e830a80 with x1830965174800384 ext(0->4095) 00002000:00010000:1.0:1746144884.289481:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e830a80 00000100:00100000:1.0:1746144884.289516:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3688 00000100:00100000:1.0:1746144884.289523:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+37:1983:x1830965174800384:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144884.289707:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+37:1983:x1830965174800384:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 184us (459us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.289714:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3688 00002000:00100000:1.0:1746144884.289720:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e830a80 x1830965174800384/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.289727:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e830a80 with x1830965174800384 ext(0->4095) 00002000:00010000:1.0:1746144884.289730:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e830a80 00000100:00100000:0.0:1746144884.292123:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.296748:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.299621:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.303188:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.303312:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174801024 00000100:00100000:0.0:1746144884.303319:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174801024 00002000:00100000:0.0:1746144884.303360:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e3b800 x1830965174801024/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144884.303371:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3b800 with x1830965174801024 ext(0->4095) 00010000:00010000:0.0:1746144884.303380:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af6727513cc3 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93727 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.303393:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af6727513cc3 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93727 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:0.0:1746144884.303399:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e3b800 00000100:00100000:0.0:1746144884.304647:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1622 00000100:00100000:0.0:1746144884.304657:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174801024:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144884.304827:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174801024:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 172us (1645us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144884.304835:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1622 00002000:00100000:0.0:1746144884.304841:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e3b800 x1830965174801024/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144884.304850:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3b800 with x1830965174801024 ext(0->4095) 00010000:00010000:0.0:1746144884.304856:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af6727513cc3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93727 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.304866:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af6727513cc3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93727 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:0.0:1746144884.304873:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e3b800 00000100:00100000:0.0:1746144884.308131:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.312499:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.318113:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.323264:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.338097:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.338818:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.339393:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174801792 00000100:00100000:1.0:1746144884.339400:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174801792 00010000:00010000:1.0:1746144884.339429:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513cca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9372e expref: 39 pid: 20722 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1746144884.339630:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10222 00000100:00100000:1.0:1746144884.339637:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1984:x1830965174801792:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144884.339649:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144884.339671:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513cca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9372e expref: 39 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.339684:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513cca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9372e expref: 39 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.339708:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513cca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9372e expref: 39 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.339833:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.339835:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.339843:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727513cd1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93735 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.339850:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727513cd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93735 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.339878:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727513cd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93735 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.339889:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727513cd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93735 expref: 5 pid: 20722 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1746144884.339901:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172265856:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144884.340280:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144884.348647:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.348683:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172265856:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144884.348714:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144884.348799:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1984:x1830965174801792:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 9160us (10711us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.348810:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10222 00000100:00100000:0.0:1746144884.354621:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.354707:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174802304 00000100:00100000:1.0:1746144884.354721:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174802304 00010000:00010000:1.0:1746144884.355070:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727513cd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93735 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1746144884.359823:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10223 00000100:00100000:0.0:1746144884.359839:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965174802304:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144884.359859:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144884.359883:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727513cd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93735 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.359901:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727513cd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93735 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.359920:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727513cd1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93735 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.359944:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144884.359945:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144884.359952:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513cd8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9373c expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.359959:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513cd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9373c expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.359989:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513cd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9373c expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144884.360000:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012a2b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172265984:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144884.360085:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144884.366370:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012a2b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172265984:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144884.366396:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144884.366463:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965174802304:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6628us (11847us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.366476:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10223 00000100:00100000:0.0:1746144884.367293:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.371242:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.377883:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.383747:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.383829:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174802944 00000100:00100000:1.0:1746144884.383842:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174802944 00010000:00010000:1.0:1746144884.383882:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513cd8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9373c expref: 40 pid: 20722 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1746144884.383927:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10224 00000100:00100000:1.0:1746144884.383934:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1983:x1830965174802944:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144884.383948:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144884.383969:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513cd8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9373c expref: 40 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.383981:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513cd8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9373c expref: 40 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.384006:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513cd8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9373c expref: 40 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.384049:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.384051:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.384057:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513cdf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93743 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.384065:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513cdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93743 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.384098:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513cdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93743 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144884.384109:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172266240:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144884.384209:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144884.390061:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172266240:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144884.390084:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144884.390146:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1983:x1830965174802944:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6211us (6403us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.390158:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10224 00000100:00100000:0.0:1746144884.393080:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.394462:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.398268:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.399442:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174803584 00000100:00100000:1.0:1746144884.399448:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174803584 00010000:00010000:1.0:1746144884.399472:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513cdf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93743 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1746144884.399506:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10225 00000100:00100000:1.0:1746144884.399512:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174803584:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144884.399529:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144884.399547:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513cdf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93743 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.399556:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513cdf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93743 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.399574:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513cdf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93743 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.399678:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.399680:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.399685:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727513ce6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9374a expref: 40 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.399693:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727513ce6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9374a expref: 40 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.399719:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727513ce6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9374a expref: 40 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.400832:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727513ce6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9374a expref: 40 pid: 20722 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1746144884.400848:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172266624:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144884.402080:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144884.405950:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.406119:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172266624:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144884.406139:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144884.406181:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae42d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965174803584:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6668us (7919us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.406189:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10225 00000100:00100000:0.0:1746144884.411571:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.411620:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.412407:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174804096 00000100:00100000:1.0:1746144884.412411:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174804096 00010000:00010000:1.0:1746144884.412427:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727513ce6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9374a expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1746144884.412453:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10226 00000100:00100000:1.0:1746144884.412458:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1982:x1830965174804096:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144884.412464:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144884.412480:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727513ce6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9374a expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.412488:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727513ce6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9374a expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.413269:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727513ce6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9374a expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.413284:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144884.413893:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1982:x1830965174804096:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1432us (2271us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144884.413902:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10226 00000100:00100000:0.0:1746144884.416925:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.422892:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.422911:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174804608 00000100:00100000:0.0:1746144884.422914:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174804608 00010000:00010000:0.0:1746144884.422929:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513ced lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93751 expref: 41 pid: 8432 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1746144884.422957:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10227 00000100:00100000:0.0:1746144884.422962:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1982:x1830965174804608:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144884.422972:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144884.422989:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513ced lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93751 expref: 41 pid: 8432 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.422999:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513ced lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93751 expref: 41 pid: 8432 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.423016:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727513ced lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93751 expref: 41 pid: 8432 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.423039:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144884.423041:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144884.423047:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513cf4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93758 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.423058:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513cf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93758 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.423087:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513cf4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93758 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144884.423097:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e82300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172267008:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144884.423151:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144884.426117:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.428619:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.434000:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.435760:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.443948:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.445461:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.449683:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.449796:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174805888 00000100:00100000:1.0:1746144884.449801:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174805888 00002000:00100000:1.0:1746144884.449830:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e83480 x1830965174805888/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.449839:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83480 with x1830965174805888 ext(0->4095) 00010000:00010000:1.0:1746144884.449845:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93766 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.449856:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93766 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.449862:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e83480 00000100:00100000:1.0:1746144884.450060:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1629 00000100:00100000:1.0:1746144884.450067:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174805888:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144884.450179:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174805888:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 113us (496us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.450185:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1629 00002000:00100000:1.0:1746144884.450190:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e83480 x1830965174805888/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.450197:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83480 with x1830965174805888 ext(0->4095) 00010000:00010000:1.0:1746144884.450201:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93766 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.450210:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93766 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.450215:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e83480 00000100:00100000:0.0:1746144884.454005:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.454060:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.459424:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.462417:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.468213:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.468304:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174806784 00000100:00100000:1.0:1746144884.468311:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174806784 00002000:00100000:1.0:1746144884.468343:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e81880 x1830965174806784/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.468359:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e81880 with x1830965174806784 ext(0->4095) 00002000:00010000:1.0:1746144884.468362:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e81880 00000100:00100000:1.0:1746144884.468471:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3693 00000100:00100000:1.0:1746144884.468478:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1985:x1830965174806784:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144884.468811:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1985:x1830965174806784:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 332us (602us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.468816:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3693 00002000:00100000:1.0:1746144884.468822:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e81880 x1830965174806784/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.468827:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e81880 with x1830965174806784 ext(0->4095) 00002000:00010000:1.0:1746144884.468830:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e81880 00000100:00100000:0.0:1746144884.471114:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.471306:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174806912 00000100:00100000:1.0:1746144884.471311:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174806912 00000100:00100000:1.0:1746144884.471351:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4816 00000100:00100000:1.0:1746144884.471357:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174806912:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144884.471370:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144884.471383:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513d17 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9377b expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.471404:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513d10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93774 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.471410:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144884.471412:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144884.471415:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513d17 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9377b expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.471437:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513d10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93774 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.471447:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513d10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93774 expref: 39 pid: 20722 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1746144884.471457:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172268160:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144884.471526:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144884.472901:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172268160:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144884.472917:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513d17 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9377b expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.472928:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:1.0:1746144884.472953:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174806912:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1596us (1844us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.472960:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4816 00000100:00100000:0.0:1746144884.474373:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174807040 00000100:00100000:0.0:1746144884.474380:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174807040 00010000:00010000:0.0:1746144884.474405:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513d10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93774 expref: 40 pid: 20722 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1746144884.474436:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10232 00000100:00100000:0.0:1746144884.474442:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1985:x1830965174807040:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144884.474451:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144884.474468:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513d10 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93774 expref: 40 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.474478:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513d10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93774 expref: 40 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.474496:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513d10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93774 expref: 40 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.474604:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144884.474607:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144884.474613:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513d17 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9377b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.474621:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513d17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9377b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.474646:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513d17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9377b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144884.474656:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e81c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172268288:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144884.474716:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144884.476622:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.476892:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174807296 00000100:00100000:1.0:1746144884.476896:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174807296 00002000:00100000:1.0:1746144884.476921:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e82a00 x1830965174807296/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.476929:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82a00 with x1830965174807296 ext(0->4095) 00002000:00010000:1.0:1746144884.476933:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e82a00 00000100:00100000:1.0:1746144884.476942:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3694 00000100:00100000:1.0:1746144884.476947:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174807296:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144884.477075:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174807296:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 126us (457us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.477081:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3694 00002000:00100000:1.0:1746144884.477085:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e82a00 x1830965174807296/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.477091:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82a00 with x1830965174807296 ext(0->4095) 00002000:00010000:1.0:1746144884.477093:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e82a00 00000100:00100000:1.0:1746144884.478385:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174807424 00000100:00100000:1.0:1746144884.478389:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174807424 00000100:00100000:1.0:1746144884.478419:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4817 00000100:00100000:1.0:1746144884.478425:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+39:31565:x1830965174807424:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144884.478435:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144884.478446:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513d1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93782 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.478466:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513d17 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9377b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.478473:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.478474:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.478477:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513d1e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93782 expref: 40 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.478499:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513d17 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9377b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.478513:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513d17 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9377b expref: 5 pid: 10401 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1746144884.478523:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172268416:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144884.478578:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144884.481357:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172268416:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144884.481381:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513d1e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93782 expref: 40 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.481396:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:1.0:1746144884.481440:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+40:31565:x1830965174807424:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3014us (3324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.481447:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4817 00000100:00100000:0.0:1746144884.483836:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.483883:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.484204:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174807680 00000100:00100000:1.0:1746144884.484208:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174807680 00000100:00100000:1.0:1746144884.484444:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4818 00000100:00100000:1.0:1746144884.484450:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174807680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144884.484463:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144884.484472:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513d25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93789 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.484486:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.484491:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513d1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93782 expref: 39 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.484500:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144884.484503:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513d25 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93789 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.484530:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513d1e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93782 expref: 39 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.484703:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513d25 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93789 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.484712:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:1.0:1746144884.484756:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:31579:x1830965174807680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 305us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.484783:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4818 00000100:00100000:0.0:1746144884.486585:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.491954:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174808064 00000100:00100000:1.0:1746144884.491962:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174808064 00000100:00100000:1.0:1746144884.491998:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4819 00000100:00100000:1.0:1746144884.492006:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+40:31565:x1830965174808064:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144884.492021:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144884.492045:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727513d2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93790 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.492066:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144884.492071:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513d25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93789 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.492081:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144884.492084:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727513d2c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93790 expref: 41 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.492112:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513d25 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93789 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.492125:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727513d2c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93790 expref: 41 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.492134:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:1.0:1746144884.492182:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+41:31565:x1830965174808064:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 176us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.492188:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4819 00000100:00100000:0.0:1746144884.498090:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.498247:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174808448 00000100:00100000:1.0:1746144884.498254:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174808448 00002000:00100000:1.0:1746144884.498288:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e82680 x1830965174808448/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.498297:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82680 with x1830965174808448 ext(0->4095) 00010000:00010000:1.0:1746144884.498304:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513d25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93789 expref: 6 pid: 10401 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.498316:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513d25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93789 expref: 6 pid: 10401 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.498322:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e82680 00000100:00100000:1.0:1746144884.498348:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1632 00000100:00100000:1.0:1746144884.498354:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174808448:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144884.498484:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174808448:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 130us (398us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.498490:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1632 00002000:00100000:1.0:1746144884.498495:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e82680 x1830965174808448/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.498502:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82680 with x1830965174808448 ext(0->4095) 00010000:00010000:1.0:1746144884.498506:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513d25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93789 expref: 6 pid: 10401 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.498513:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513d25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93789 expref: 6 pid: 10401 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.498519:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e82680 00000100:00100000:0.0:1746144884.504393:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.509325:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.511953:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.514215:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.517376:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.518173:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.520748:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.520895:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.524209:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.528201:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.531930:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.532209:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174810368 00000100:00100000:1.0:1746144884.532215:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174810368 00002000:00100000:1.0:1746144884.532246:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea6a00 x1830965174810368/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.532254:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea6a00 with x1830965174810368 ext(0->4095) 00002000:00010000:1.0:1746144884.532258:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea6a00 00000100:00100000:1.0:1746144884.532273:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3697 00000100:00100000:1.0:1746144884.532279:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1982:x1830965174810368:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144884.532406:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1982:x1830965174810368:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 127us (482us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.532412:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3697 00002000:00100000:1.0:1746144884.532417:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea6a00 x1830965174810368/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.532423:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea6a00 with x1830965174810368 ext(0->4095) 00002000:00010000:1.0:1746144884.532426:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea6a00 00000100:00100000:0.0:1746144884.536490:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.539702:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.543231:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.543995:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.545877:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.547053:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.552352:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.552445:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174811520 00000100:00100000:0.0:1746144884.552452:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174811520 00002000:00100000:0.0:1746144884.552489:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e38000 x1830965174811520/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144884.552499:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38000 with x1830965174811520 ext(0->4095) 00010000:00010000:0.0:1746144884.552506:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513d4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937b3 expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.552523:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513d4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937b3 expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:0.0:1746144884.552530:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e38000 00000100:00100000:0.0:1746144884.552545:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1635 00000100:00100000:0.0:1746144884.552551:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1984:x1830965174811520:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144884.552713:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1984:x1830965174811520:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 161us (362us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144884.552719:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1635 00002000:00100000:0.0:1746144884.552725:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e38000 x1830965174811520/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144884.552731:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38000 with x1830965174811520 ext(0->4095) 00010000:00010000:0.0:1746144884.552736:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513d4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937b3 expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.552744:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513d4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937b3 expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:0.0:1746144884.552751:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e38000 00000100:00100000:0.0:1746144884.554221:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.558277:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.558672:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174811904 00000100:00100000:1.0:1746144884.558680:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174811904 00002000:00100000:1.0:1746144884.558721:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258b100 x1830965174811904/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.558730:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258b100 with x1830965174811904 ext(0->4095) 00002000:00010000:1.0:1746144884.558735:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258b100 00000100:00100000:0.0:1746144884.560622:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.563917:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.566986:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.567040:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174812416 00000100:00100000:1.0:1746144884.567046:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174812416 00002000:00100000:1.0:1746144884.567085:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258ea00 x1830965174812416/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.567096:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258ea00 with x1830965174812416 ext(0->4095) 00002000:00010000:1.0:1746144884.567290:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258ea00 00000100:00100000:1.0:1746144884.567321:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3699 00000100:00100000:1.0:1746144884.567328:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174812416:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144884.567835:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174812416:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 507us (850us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.567841:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3699 00002000:00100000:1.0:1746144884.567848:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258ea00 x1830965174812416/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.567854:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258ea00 with x1830965174812416 ext(0->4095) 00002000:00010000:1.0:1746144884.567857:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258ea00 00000100:00100000:0.0:1746144884.568040:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.570835:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.570878:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174812672 00000100:00100000:1.0:1746144884.570886:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174812672 00000100:00100000:1.0:1746144884.571173:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4828 00000100:00100000:1.0:1746144884.571182:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+41:31579:x1830965174812672:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144884.571200:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144884.571217:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513d6b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af937cf expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.571245:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.571252:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d64 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937c8 expref: 42 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.571258:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144884.571262:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513d6b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937cf expref: 42 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.571299:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d64 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937c8 expref: 42 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.571313:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513d6b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937cf expref: 42 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.571323:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:1.0:1746144884.571375:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+42:31579:x1830965174812672:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 193us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.571382:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4828 00000100:00100000:0.0:1746144884.571592:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174812800 00000100:00100000:0.0:1746144884.571596:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174812800 00010000:00010000:0.0:1746144884.571616:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513d5d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937c1 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1746144884.571635:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10243 00000100:00100000:0.0:1746144884.571640:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174812800:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144884.571648:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144884.571671:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513d5d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937c1 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.571682:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513d5d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937c1 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.571902:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144884.571904:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144884.571911:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937c8 expref: 41 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.571923:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937c8 expref: 41 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.571944:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937c8 expref: 41 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.571955:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d64 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937c8 expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1746144884.571966:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172271232:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144884.572035:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144884.574864:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.574919:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174813056 00000100:00100000:1.0:1746144884.574926:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174813056 00002000:00100000:1.0:1746144884.574962:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258df80 x1830965174813056/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.574972:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258df80 with x1830965174813056 ext(0->4095) 00010000:00010000:1.0:1746144884.574979:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937c8 expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.574992:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937c8 expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.574999:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258df80 00000100:00100000:1.0:1746144884.575037:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1636 00000100:00100000:1.0:1746144884.575044:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1985:x1830965174813056:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144884.575213:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1985:x1830965174813056:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 169us (349us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.575219:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1636 00002000:00100000:1.0:1746144884.575224:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258df80 x1830965174813056/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.575231:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258df80 with x1830965174813056 ext(0->4095) 00010000:00010000:1.0:1746144884.575236:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937c8 expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.575250:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937c8 expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.575255:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258df80 00000100:00100000:0.0:1746144884.576700:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.579261:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.582174:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.588114:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.590055:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.590105:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174813952 00000100:00100000:1.0:1746144884.590110:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174813952 00002000:00100000:1.0:1746144884.590143:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258c380 x1830965174813952/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.590151:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258c380 with x1830965174813952 ext(0->4095) 00002000:00010000:1.0:1746144884.590155:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258c380 00000100:00100000:1.0:1746144884.590176:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3701 00000100:00100000:1.0:1746144884.590181:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174813952:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144884.590343:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174813952:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 161us (289us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.590348:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3701 00002000:00100000:1.0:1746144884.590353:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258c380 x1830965174813952/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.590360:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258c380 with x1830965174813952 ext(0->4095) 00002000:00010000:1.0:1746144884.590363:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258c380 00000100:00100000:0.0:1746144884.591091:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.593536:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174814336 00000100:00100000:0.0:1746144884.593541:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174814336 00010000:00010000:0.0:1746144884.593561:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727513d72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937d6 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00000100:00100000:0.0:1746144884.593588:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10246 00000100:00100000:0.0:1746144884.593593:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174814336:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144884.593603:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144884.593621:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727513d72 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937d6 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.593632:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727513d72 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937d6 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.593651:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727513d72 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937d6 expref: 6 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.593670:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144884.593672:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144884.593677:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937dd expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.593685:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937dd expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.593707:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727513d79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937dd expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144884.593715:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172271872:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144884.593759:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144884.596865:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.601341:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.601397:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.606242:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.606350:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174815104 00000100:00100000:1.0:1746144884.606358:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174815104 00002000:00100000:1.0:1746144884.606392:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258ed80 x1830965174815104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.606408:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258ed80 with x1830965174815104 ext(0->4095) 00010000:00010000:1.0:1746144884.606414:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513d80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937e4 expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.606426:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513d80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937e4 expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.606433:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258ed80 00000100:00100000:1.0:1746144884.606448:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1638 00000100:00100000:1.0:1746144884.606454:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1985:x1830965174815104:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144884.606615:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1985:x1830965174815104:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 161us (374us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.606622:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1638 00002000:00100000:1.0:1746144884.606627:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258ed80 x1830965174815104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.606634:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258ed80 with x1830965174815104 ext(0->4095) 00010000:00010000:1.0:1746144884.606638:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513d80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937e4 expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00010000:00010000:1.0:1746144884.606647:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513d80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937e4 expref: 41 pid: 20722 timeout: 578 lvb_type: 0 00002000:00010000:1.0:1746144884.606652:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258ed80 00000100:00100000:0.0:1746144884.608183:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.608978:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.611875:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.613578:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.614046:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.614482:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174815872 00000100:00100000:1.0:1746144884.614487:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174815872 00000100:00100000:1.0:1746144884.614517:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4834 00000100:00100000:1.0:1746144884.614522:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+40:31565:x1830965174815872:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144884.614533:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144884.614545:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513d95 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af937f9 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.614563:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093939000/0x4076af6727513d8e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937f2 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.614570:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.614571:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.614574:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513d95 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937f9 expref: 41 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.614590:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093939000/0x4076af6727513d8e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937f2 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.614599:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093939000/0x4076af6727513d8e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937f2 expref: 5 pid: 20722 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1746144884.614607:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172272768:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144884.614639:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144884.617080:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.617564:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172272768:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144884.617585:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513d95 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937f9 expref: 40 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.617604:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:1.0:1746144884.617630:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+40:31565:x1830965174815872:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3107us (3584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.617636:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4834 00000100:00100000:0.0:1746144884.620609:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.624104:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.626965:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.627100:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174816640 00000100:00100000:1.0:1746144884.627107:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174816640 00000100:00100000:1.0:1746144884.627143:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4835 00000100:00100000:1.0:1746144884.627149:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174816640:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144884.627163:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144884.627181:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513d9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93800 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.627208:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513d95 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937f9 expref: 39 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.627215:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144884.627218:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144884.627221:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513d9c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93800 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.627250:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513d95 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937f9 expref: 39 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.627261:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513d95 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937f9 expref: 39 pid: 10401 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1746144884.627277:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172273024:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144884.628073:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144884.631194:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:1.0:1746144884.631912:0:10401:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513d95 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af937f9 expref: 40 pid: 10401 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1746144884.631940:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172273024:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144884.631975:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513d9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93800 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.631983:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:1.0:1746144884.632037:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174816640:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4867us (5058us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.632045:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4835 00000100:00100000:0.0:1746144884.634281:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.634370:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.634496:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174816896 00000100:00100000:1.0:1746144884.634502:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174816896 00000100:00100000:1.0:1746144884.634683:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4836 00000100:00100000:1.0:1746144884.634690:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+39:31565:x1830965174816896:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144884.634707:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144884.634723:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513da3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93807 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.634746:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513d9c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93800 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.634758:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.634777:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.634782:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513da3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93807 expref: 40 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.634812:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513d9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93800 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.634824:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513d9c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93800 expref: 6 pid: 10401 timeout: 578 lvb_type: 0 00000100:00100000:1.0:1746144884.634834:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172273280:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144884.634880:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144884.634933:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1641 00000100:00100000:0.0:1746144884.634940:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174817152:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144884.635346:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174817152:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 406us (974us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144884.635353:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1641 00002000:00100000:0.0:1746144884.635359:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093f44000 x1830965174817152/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144884.635367:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f44000 with x1830965174817152 ext(0->4095) 00010000:00010000:0.0:1746144884.635372:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513d9c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93800 expref: 6 pid: 10401 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.635383:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727513d9c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93800 expref: 6 pid: 10401 timeout: 578 lvb_type: 0 00002000:00010000:0.0:1746144884.635389:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f44000 00000100:00100000:1.0:1746144884.636468:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172273280:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144884.636494:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513da3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93807 expref: 40 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.636507:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:1.0:1746144884.636581:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+40:31565:x1830965174816896:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1890us (2299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.636588:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4836 00000100:00100000:0.0:1746144884.637639:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.637711:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.637787:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174817280 00000100:00100000:1.0:1746144884.637793:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174817280 00000100:00100000:1.0:1746144884.637835:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4837 00000100:00100000:1.0:1746144884.637842:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+40:31579:x1830965174817280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144884.637857:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144884.637871:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513daa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9380e expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.637891:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.637895:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513da3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93807 expref: 41 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.637901:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144884.637904:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513daa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9380e expref: 41 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.637930:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513da3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93807 expref: 41 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.637940:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513daa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9380e expref: 41 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.637947:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:1.0:1746144884.637968:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+41:31579:x1830965174817280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 127us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.637973:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4837 00000100:00100000:0.0:1746144884.640346:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.643561:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.647608:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.650213:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.655332:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.657727:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.659411:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.666124:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.673494:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.677700:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.682728:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.686268:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.691309:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.691438:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.696230:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.696672:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174819968 00000100:00100000:1.0:1746144884.696681:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174819968 00000100:00100000:1.0:1746144884.696733:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4842 00000100:00100000:1.0:1746144884.696742:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+43:31579:x1830965174819968:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144884.696790:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144884.696810:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513dcd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93831 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.696837:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.696843:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0600/0x4076af6727513dc6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9382a expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.696848:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144884.696851:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513dcd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93831 expref: 44 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144884.696866:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:1.0:1746144884.696885:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0600/0x4076af6727513dc6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9382a expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.696908:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513dcd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93831 expref: 44 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.696917:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:1.0:1746144884.696962:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31579:x1830965174819968:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 221us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.696969:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4842 00000100:00100000:0.0:1746144884.701891:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.704878:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.707618:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.710124:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.714306:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.716707:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.718236:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.719870:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.721474:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.725536:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.728643:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.733011:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.735886:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.740527:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.743621:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.745121:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.749427:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.749976:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4848 00000100:00100000:1.0:1746144884.749986:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+42:31579:x1830965174823040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144884.750000:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144884.750018:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513df7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9385b expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.750054:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.750059:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513df0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93854 expref: 43 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.750065:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144884.750068:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513df7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9385b expref: 43 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.750099:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513df0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93854 expref: 43 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.750111:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513df7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9385b expref: 43 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.750119:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:1.0:1746144884.750143:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099718c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+43:31579:x1830965174823040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 160us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.750148:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4848 00000100:00100000:0.0:1746144884.751104:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.755490:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.759233:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.762890:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.767878:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.776970:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.779913:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.783205:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.787974:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.802160:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.805980:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.806040:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.811173:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.818940:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.819874:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.824211:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.825036:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174826112 00000100:00100000:0.0:1746144884.825042:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174826112 00002000:00100000:0.0:1746144884.825082:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093856680 x1830965174826112/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144884.825091:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093856680 with x1830965174826112 ext(0->4095) 00010000:00010000:0.0:1746144884.825100:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ff1000/0x4076af6727513e13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93877 expref: 6 pid: 8432 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.825112:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ff1000/0x4076af6727513e13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93877 expref: 6 pid: 8432 timeout: 578 lvb_type: 0 00002000:00010000:0.0:1746144884.825119:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093856680 00000100:00100000:0.0:1746144884.825321:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1652 00000100:00100000:0.0:1746144884.825328:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174826112:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144884.825492:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174826112:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 164us (1283us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144884.825498:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1652 00002000:00100000:0.0:1746144884.825502:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093856680 x1830965174826112/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144884.825510:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093856680 with x1830965174826112 ext(0->4095) 00010000:00010000:0.0:1746144884.825514:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ff1000/0x4076af6727513e13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93877 expref: 6 pid: 8432 timeout: 578 lvb_type: 0 00010000:00010000:0.0:1746144884.825523:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ff1000/0x4076af6727513e13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93877 expref: 6 pid: 8432 timeout: 578 lvb_type: 0 00002000:00010000:0.0:1746144884.825529:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093856680 00000100:00100000:0.0:1746144884.830600:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.830710:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.834525:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.837563:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.840141:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.846314:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.855615:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.860441:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.864640:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.864696:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174827648 00000100:00100000:1.0:1746144884.864701:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174827648 00000100:00100000:1.0:1746144884.864753:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4857 00000100:00100000:1.0:1746144884.864782:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+47:31579:x1830965174827648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144884.864795:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144884.864808:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727513e36 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9389a expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.864833:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144884.864838:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf24000/0x4076af6727513e2f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93893 expref: 48 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.864843:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144884.864846:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727513e36 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9389a expref: 48 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.864872:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf24000/0x4076af6727513e2f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93893 expref: 48 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.864885:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727513e36 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9389a expref: 48 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144884.864893:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:1.0:1746144884.864935:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+48:31579:x1830965174827648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 175us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144884.864940:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4857 00000100:00100000:0.0:1746144884.865402:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.868713:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.868782:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174828032 00000100:00100000:1.0:1746144884.868790:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174828032 00002000:00100000:1.0:1746144884.868831:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bae2300 x1830965174828032/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.868840:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae2300 with x1830965174828032 ext(0->4095) 00010000:00010000:1.0:1746144884.868848:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf24000/0x4076af6727513e2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93893 expref: 47 pid: 8432 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144884.868865:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf24000/0x4076af6727513e2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93893 expref: 47 pid: 8432 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144884.868872:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bae2300 00000100:00100000:1.0:1746144884.868900:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1654 00000100:00100000:1.0:1746144884.868906:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+47:1985:x1830965174828032:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144884.869368:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+47:1985:x1830965174828032:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 461us (666us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.869375:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1654 00002000:00100000:1.0:1746144884.869380:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bae2300 x1830965174828032/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.869389:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae2300 with x1830965174828032 ext(0->4095) 00010000:00010000:1.0:1746144884.869394:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf24000/0x4076af6727513e2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93893 expref: 47 pid: 8432 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144884.869403:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf24000/0x4076af6727513e2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93893 expref: 47 pid: 8432 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144884.869409:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bae2300 00000100:00100000:0.0:1746144884.871550:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.878138:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.878176:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174828416 00000100:00100000:1.0:1746144884.878186:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174828416 00002000:00100000:1.0:1746144884.878233:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bae1f80 x1830965174828416/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.878243:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae1f80 with x1830965174828416 ext(0->4095) 00002000:00010000:1.0:1746144884.878248:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae1f80 00000100:00100000:1.0:1746144884.878281:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3714 00000100:00100000:1.0:1746144884.878288:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+47:1985:x1830965174828416:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144884.878471:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+47:1985:x1830965174828416:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 183us (345us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.878476:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3714 00002000:00100000:1.0:1746144884.878481:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bae1f80 x1830965174828416/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.878488:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae1f80 with x1830965174828416 ext(0->4095) 00002000:00010000:1.0:1746144884.878490:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae1f80 00000100:00100000:0.0:1746144884.882301:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.885677:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.886977:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.890849:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174829056 00000100:00100000:1.0:1746144884.890856:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174829056 00002000:00100000:1.0:1746144884.890894:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5e680 x1830965174829056/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.890903:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5e680 with x1830965174829056 ext(0->4095) 00010000:00010000:1.0:1746144884.890912:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727513e3d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938a1 expref: 6 pid: 20722 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144884.890924:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727513e3d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938a1 expref: 6 pid: 20722 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144884.890930:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5e680 00000100:00100000:1.0:1746144884.890944:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1655 00000100:00100000:1.0:1746144884.890950:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174829056:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144884.891276:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172279168:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144884.891301:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513e44 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938a8 expref: 46 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.891314:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5481c00, rc 0) 00000100:00100000:1.0:1746144884.891575:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174829056:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 624us (785us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.891582:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1655 00002000:00100000:1.0:1746144884.891588:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5e680 x1830965174829056/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.891596:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5e680 with x1830965174829056 ext(0->4095) 00010000:00010000:1.0:1746144884.891601:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727513e3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938a1 expref: 6 pid: 20722 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144884.891611:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727513e3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938a1 expref: 6 pid: 20722 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144884.891617:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5e680 00000100:00100000:0.0:1746144884.891666:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+46:31565:x1830965174828800:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3915us (4691us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144884.891673:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4859 00000100:00100000:0.0:1746144884.894729:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.898286:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.898498:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174829440 00000100:00100000:1.0:1746144884.898505:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174829440 00002000:00100000:1.0:1746144884.898541:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4b480 x1830965174829440/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.898550:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b480 with x1830965174829440 ext(0->4095) 00002000:00010000:1.0:1746144884.898555:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4b480 00000100:00100000:1.0:1746144884.898578:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3715 00000100:00100000:1.0:1746144884.898584:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1984:x1830965174829440:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144884.898788:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1984:x1830965174829440:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 203us (502us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.898794:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3715 00002000:00100000:1.0:1746144884.898800:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4b480 x1830965174829440/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.898807:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b480 with x1830965174829440 ext(0->4095) 00002000:00010000:1.0:1746144884.898809:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4b480 00000100:00100000:0.0:1746144884.902004:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.913548:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.913984:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174829696 00000100:00100000:1.0:1746144884.913994:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174829696 00002000:00100000:1.0:1746144884.914057:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009bb4ad80 x1830965174829696/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 496/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.914068:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4ad80 with x1830965174829696 ext(0->7) 00010000:00010000:1.0:1746144884.914079:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513e44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938a8 expref: 46 pid: 20722 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144884.914094:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513e44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938a8 expref: 46 pid: 20722 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144884.914101:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb4ad80 00000100:00100000:1.0:1746144884.914136:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1656 00000100:00100000:1.0:1746144884.914144:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1984:x1830965174829696:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144884.914525:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+48:1984:x1830965174829696:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 381us (989us total) trans 4294967930 rc 0/0 00000100:00100000:1.0:1746144884.914533:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1656 00002000:00100000:1.0:1746144884.914539:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009bb4ad80 x1830965174829696/t4294967930(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 496/448 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.914547:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4ad80 with x1830965174829696 ext(0->7) 00010000:00010000:1.0:1746144884.914552:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513e44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938a8 expref: 48 pid: 20722 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144884.914562:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513e44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938a8 expref: 48 pid: 20722 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144884.914568:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb4ad80 00000100:00100000:0.0:1746144884.924962:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.927097:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.929404:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10276 00000100:00100000:0.0:1746144884.929424:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+49:1985:x1830965174829952:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144884.929445:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144884.929476:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513e44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938a8 expref: 49 pid: 20722 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1746144884.929491:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513e44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938a8 expref: 49 pid: 20722 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1746144884.929522:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513e44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938a8 expref: 49 pid: 20722 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1746144884.933841:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144884.933848:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144884.933865:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727513e4b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938af expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.933876:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727513e4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938af expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.933930:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727513e4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938af expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.933943:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727513e4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938af expref: 5 pid: 20722 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1746144884.933956:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb4a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172279680:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144884.934081:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144884.942539:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.946266:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174830208 00000100:00100000:1.0:1746144884.946282:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174830208 00002000:00100000:1.0:1746144884.946338:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4a300 x1830965174830208/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.946349:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4a300 with x1830965174830208 ext(0->4095) 00010000:00010000:1.0:1746144884.946361:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727513e4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938af expref: 6 pid: 20722 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144884.946375:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727513e4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938af expref: 6 pid: 20722 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144884.946382:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb4a300 00000100:00100000:1.0:1746144884.946420:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1657 00000100:00100000:1.0:1746144884.946427:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174830208:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144884.946632:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174830208:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 204us (4105us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.946638:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1657 00002000:00100000:1.0:1746144884.946643:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4a300 x1830965174830208/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.946651:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4a300 with x1830965174830208 ext(0->4095) 00010000:00010000:1.0:1746144884.946656:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727513e4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938af expref: 6 pid: 20722 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144884.946665:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727513e4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938af expref: 6 pid: 20722 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144884.946670:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb4a300 00000100:00100000:0.0:1746144884.956102:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.958940:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.961329:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.965813:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.977806:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.977912:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.986850:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172280192:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144884.986876:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af6727513e60 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938c4 expref: 50 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144884.986894:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5481c00, rc 0) 00000100:00100000:1.0:1746144884.986950:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174831360 00000100:00100000:1.0:1746144884.986958:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174831360 00002000:00100000:1.0:1746144884.986997:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5fb80 x1830965174831360/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.987006:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5fb80 with x1830965174831360 ext(0->4095) 00010000:00010000:1.0:1746144884.987013:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513e59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938bd expref: 6 pid: 8432 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144884.987035:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513e59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938bd expref: 6 pid: 8432 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144884.987041:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5fb80 00000100:00100000:0.0:1746144884.987352:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+50:31565:x1830965174831104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 8158us (9439us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144884.987360:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4863 00000100:00100000:1.0:1746144884.987411:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1659 00000100:00100000:1.0:1746144884.987419:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174831360:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144884.987726:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174831360:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 308us (941us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.987732:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1659 00002000:00100000:1.0:1746144884.987737:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5fb80 x1830965174831360/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.987750:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5fb80 with x1830965174831360 ext(0->4095) 00010000:00010000:1.0:1746144884.987755:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513e59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938bd expref: 6 pid: 8432 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144884.987788:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513e59 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938bd expref: 6 pid: 8432 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144884.987794:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5fb80 00000100:00100000:0.0:1746144884.992716:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144884.998262:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144884.998447:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174831744 00000100:00100000:1.0:1746144884.998454:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174831744 00002000:00100000:1.0:1746144884.998495:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398df80 x1830965174831744/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/0 e 0 to 0 dl 1746144895 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.998504:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398df80 with x1830965174831744 ext(0->4095) 00002000:00010000:1.0:1746144884.998508:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398df80 00000100:00100000:1.0:1746144884.998537:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3717 00000100:00100000:1.0:1746144884.998543:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1984:x1830965174831744:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144884.998702:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1984:x1830965174831744:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 158us (440us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144884.998707:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3717 00002000:00100000:1.0:1746144884.998712:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398df80 x1830965174831744/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:525/0 lens 488/4536 e 0 to 0 dl 1746144895 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144884.998720:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398df80 with x1830965174831744 ext(0->4095) 00002000:00010000:1.0:1746144884.998722:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398df80 00000100:00100000:0.0:1746144885.003184:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144885.004327:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144885.008523:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144885.009887:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144885.014215:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.019607:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.021673:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174832384 00000100:00100000:1.0:1746144885.021685:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174832384 00002000:00100000:1.0:1746144885.021736:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ed80 x1830965174832384/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.021746:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ed80 with x1830965174832384 ext(0->4095) 00002000:00010000:1.0:1746144885.021751:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398ed80 00000100:00100000:1.0:1746144885.021817:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3718 00000100:00100000:1.0:1746144885.021824:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174832384:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144885.022041:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174832384:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 209us (2434us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.022049:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3718 00002000:00100000:1.0:1746144885.022054:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ed80 x1830965174832384/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.022062:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ed80 with x1830965174832384 ext(0->4095) 00002000:00010000:1.0:1746144885.022065:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398ed80 00000100:00100000:0.0:1746144885.024347:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.026118:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.029479:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.033664:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.037555:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.042287:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.042689:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174833408 00000100:00100000:1.0:1746144885.042696:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174833408 00002000:00100000:1.0:1746144885.042738:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2df80 x1830965174833408/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.042747:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2df80 with x1830965174833408 ext(0->4095) 00002000:00010000:1.0:1746144885.042752:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2df80 00000100:00100000:1.0:1746144885.042803:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3719 00000100:00100000:1.0:1746144885.042810:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+52:1984:x1830965174833408:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144885.042974:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+52:1984:x1830965174833408:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 164us (697us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.042980:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3719 00002000:00100000:1.0:1746144885.042985:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2df80 x1830965174833408/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.042992:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2df80 with x1830965174833408 ext(0->4095) 00002000:00010000:1.0:1746144885.042995:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2df80 00000100:00100000:0.0:1746144885.045646:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.046252:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4867 00000100:00100000:1.0:1746144885.046262:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174833536:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144885.046280:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144885.046297:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513e7c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af938e0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.046326:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727513e75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938d9 expref: 51 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.046333:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144885.046335:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144885.046338:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513e7c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938e0 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.046368:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727513e75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938d9 expref: 51 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.046378:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727513e75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938d9 expref: 51 pid: 20722 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1746144885.046390:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172281216:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144885.046775:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144885.049536:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172281216:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144885.049569:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513e7c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938e0 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.049586:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:1.0:1746144885.049632:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174833536:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3371us (3993us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.049641:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4867 00000100:00100000:0.0:1746144885.050299:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.052516:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.053096:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174833792 00000100:00100000:1.0:1746144885.053105:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174833792 00000100:00100000:1.0:1746144885.053427:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4868 00000100:00100000:1.0:1746144885.053437:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+52:31565:x1830965174833792:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144885.053453:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144885.053471:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513e83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af938e7 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.053499:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513e7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938e0 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.053507:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.053508:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.053511:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513e83 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938e7 expref: 53 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.053541:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513e7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938e0 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.053558:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513e7c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938e0 expref: 5 pid: 10401 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1746144885.053568:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172281472:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144885.053648:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144885.056540:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172281472:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144885.056575:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513e83 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938e7 expref: 53 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.056593:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:1.0:1746144885.056640:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+53:31565:x1830965174833792:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3203us (4129us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.056649:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4868 00000100:00100000:0.0:1746144885.057882:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.061931:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.062714:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174834176 00000100:00100000:1.0:1746144885.062724:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174834176 00000100:00100000:1.0:1746144885.063196:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4869 00000100:00100000:1.0:1746144885.063205:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+52:31579:x1830965174834176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144885.063224:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144885.063241:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513e8a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af938ee expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.063269:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.063274:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513e83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938e7 expref: 53 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.063283:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144885.063286:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513e8a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938ee expref: 53 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.063320:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513e83 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938e7 expref: 53 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.063332:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727513e8a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938ee expref: 53 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.063341:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:1.0:1746144885.063401:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+53:31579:x1830965174834176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 196us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.063407:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4869 00000100:00100000:0.0:1746144885.063606:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.066368:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.066540:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174834560 00000100:00100000:1.0:1746144885.066547:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174834560 00002000:00100000:1.0:1746144885.066585:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2c700 x1830965174834560/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.066595:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2c700 with x1830965174834560 ext(0->4095) 00010000:00010000:1.0:1746144885.066604:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513e83 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938e7 expref: 53 pid: 10401 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.066615:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513e83 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938e7 expref: 53 pid: 10401 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.066622:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2c700 00000100:00100000:1.0:1746144885.066655:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1663 00000100:00100000:1.0:1746144885.066662:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+53:1985:x1830965174834560:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144885.066871:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+53:1985:x1830965174834560:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 209us (512us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.066878:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1663 00002000:00100000:1.0:1746144885.066883:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2c700 x1830965174834560/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.066890:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2c700 with x1830965174834560 ext(0->4095) 00010000:00010000:1.0:1746144885.066894:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513e83 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938e7 expref: 53 pid: 10401 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.066902:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513e83 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938e7 expref: 53 pid: 10401 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.066908:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2c700 00000100:00100000:0.0:1746144885.070534:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.073324:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.076176:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.080124:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.083747:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.084075:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174835456 00000100:00100000:1.0:1746144885.084082:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174835456 00002000:00100000:1.0:1746144885.084121:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2f480 x1830965174835456/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.084130:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2f480 with x1830965174835456 ext(0->4095) 00002000:00010000:1.0:1746144885.084135:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2f480 00000100:00100000:1.0:1746144885.084161:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3721 00000100:00100000:1.0:1746144885.084167:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174835456:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144885.084334:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174835456:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 166us (587us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.084340:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3721 00002000:00100000:1.0:1746144885.084345:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2f480 x1830965174835456/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.084352:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2f480 with x1830965174835456 ext(0->4095) 00002000:00010000:1.0:1746144885.084355:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2f480 00000100:00100000:0.0:1746144885.084595:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.087941:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.088046:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174835712 00000100:00100000:1.0:1746144885.088054:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174835712 00000100:00100000:1.0:1746144885.088109:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4872 00000100:00100000:1.0:1746144885.088117:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+53:31579:x1830965174835712:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144885.088132:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144885.088146:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513e9f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93903 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.088606:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.088613:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513e98 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938fc expref: 53 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.088619:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144885.088623:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513e9f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93903 expref: 53 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.088801:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513e98 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af938fc expref: 53 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.088813:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513e9f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93903 expref: 53 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.088825:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:1.0:1746144885.088845:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+53:31579:x1830965174835712:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 729us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.088850:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4872 00000100:00100000:0.0:1746144885.088957:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.093062:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.096884:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.103625:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.103800:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174836480 00000100:00100000:1.0:1746144885.103809:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174836480 00002000:00100000:1.0:1746144885.103853:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b4fa300 x1830965174836480/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.103863:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4fa300 with x1830965174836480 ext(0->4095) 00002000:00010000:1.0:1746144885.103868:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4fa300 00000100:00100000:1.0:1746144885.103893:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3722 00000100:00100000:1.0:1746144885.103899:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+52:1985:x1830965174836480:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144885.104098:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+52:1985:x1830965174836480:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 198us (481us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.104105:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3722 00002000:00100000:1.0:1746144885.104110:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b4fa300 x1830965174836480/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.104117:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4fa300 with x1830965174836480 ext(0->4095) 00002000:00010000:1.0:1746144885.104119:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4fa300 00000100:00100000:0.0:1746144885.106083:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.106850:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174836608 00000100:00100000:1.0:1746144885.106859:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174836608 00000100:00100000:1.0:1746144885.106982:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4873 00000100:00100000:1.0:1746144885.106991:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174836608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144885.107009:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144885.107038:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ea6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9390a expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.107068:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513e9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93903 expref: 51 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.107075:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144885.107077:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144885.107080:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ea6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9390a expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.107113:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513e9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93903 expref: 51 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.107126:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513e9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93903 expref: 51 pid: 10401 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1746144885.107139:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172282752:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144885.107776:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144885.109788:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172282752:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144885.109820:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ea6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9390a expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.109837:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:1.0:1746144885.109882:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174836608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2892us (3806us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.109893:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4873 00000100:00100000:0.0:1746144885.110838:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.112826:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.113246:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174836864 00000100:00100000:1.0:1746144885.113252:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174836864 00000100:00100000:1.0:1746144885.113293:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4874 00000100:00100000:1.0:1746144885.113300:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+52:31565:x1830965174836864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144885.113314:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144885.113328:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513ead lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93911 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.113349:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ea6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9390a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.113356:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.113357:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.113360:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513ead lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93911 expref: 53 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.113378:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ea6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9390a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.113388:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727513ea6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9390a expref: 5 pid: 10401 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1746144885.113396:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172283008:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144885.113446:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144885.115403:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.115629:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172283008:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144885.115653:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513ead lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93911 expref: 52 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.115667:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753c00, rc 0) 00000100:00100000:1.0:1746144885.115699:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+52:31565:x1830965174836864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2400us (2874us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.115705:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4874 00000100:00100000:0.0:1746144885.120443:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.124510:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.124592:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174837504 00000100:00100000:1.0:1746144885.124600:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174837504 00002000:00100000:1.0:1746144885.124644:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac84000 x1830965174837504/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.124654:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac84000 with x1830965174837504 ext(0->4095) 00002000:00010000:1.0:1746144885.124658:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac84000 00000100:00100000:1.0:1746144885.124935:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3723 00000100:00100000:1.0:1746144885.124943:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+52:1985:x1830965174837504:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144885.125126:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+52:1985:x1830965174837504:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 184us (624us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.125132:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3723 00002000:00100000:1.0:1746144885.125137:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac84000 x1830965174837504/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.125144:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac84000 with x1830965174837504 ext(0->4095) 00002000:00010000:1.0:1746144885.125147:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac84000 00000100:00100000:0.0:1746144885.138268:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.138391:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174837632 00000100:00100000:1.0:1746144885.138402:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174837632 00000100:00100000:1.0:1746144885.138462:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4875 00000100:00100000:1.0:1746144885.138470:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174837632:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144885.138490:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144885.138508:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513eb4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93918 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.138541:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513ead lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93911 expref: 51 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.138549:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144885.138551:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144885.138555:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513eb4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93918 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.138587:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513ead lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93911 expref: 51 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.138599:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93911 expref: 51 pid: 10401 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1746144885.138612:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172283264:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144885.138707:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144885.140246:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172283264:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144885.140273:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513eb4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93918 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.140288:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:1.0:1746144885.142924:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174837632:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4440us (4652us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.142936:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4875 00000100:00100000:0.0:1746144885.147069:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174837888 00000100:00100000:0.0:1746144885.147074:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174837888 00002000:00100000:0.0:1746144885.147110:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880087c5ce00 x1830965174837888/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 496/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144885.147120:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ce00 with x1830965174837888 ext(0->7) 00010000:00010000:0.0:1746144885.147127:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93911 expref: 53 pid: 10401 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1746144885.147145:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93911 expref: 53 pid: 10401 timeout: 579 lvb_type: 0 00002000:00010000:0.0:1746144885.147151:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5ce00 00000100:00100000:0.0:1746144885.147174:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1666 00000100:00100000:0.0:1746144885.147181:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+53:1985:x1830965174837888:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746144885.147506:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+55:1985:x1830965174837888:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 324us (621us total) trans 4294967933 rc 0/0 00000100:00100000:0.0:1746144885.147512:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1666 00002000:00100000:0.0:1746144885.147517:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880087c5ce00 x1830965174837888/t4294967933(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 496/448 e 0 to 0 dl 1746144896 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144885.147524:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ce00 with x1830965174837888 ext(0->7) 00010000:00010000:0.0:1746144885.147529:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93911 expref: 55 pid: 10401 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1746144885.147537:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727513ead lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93911 expref: 55 pid: 10401 timeout: 579 lvb_type: 0 00002000:00010000:0.0:1746144885.147542:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5ce00 00000100:00100000:0.0:1746144885.150070:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.154363:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.154473:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174838272 00000100:00100000:1.0:1746144885.154482:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174838272 00002000:00100000:1.0:1746144885.154526:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac86680 x1830965174838272/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.154537:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac86680 with x1830965174838272 ext(0->4095) 00010000:00010000:1.0:1746144885.154546:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513eb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93918 expref: 6 pid: 10401 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.154559:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513eb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93918 expref: 6 pid: 10401 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.154565:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac86680 00000100:00100000:1.0:1746144885.154594:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1667 00000100:00100000:1.0:1746144885.154601:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174838272:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144885.154958:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174838272:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 356us (597us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.154965:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1667 00002000:00100000:1.0:1746144885.154970:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac86680 x1830965174838272/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.154977:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac86680 with x1830965174838272 ext(0->4095) 00010000:00010000:1.0:1746144885.154982:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513eb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93918 expref: 6 pid: 10401 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.154995:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727513eb4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93918 expref: 6 pid: 10401 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.155000:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac86680 00000100:00100000:0.0:1746144885.157333:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.161284:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.179603:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.204879:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.210399:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.215712:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.218906:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.223302:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.228028:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.231934:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.238573:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.243504:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.250209:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.255051:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.260926:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.269752:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.276055:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.278969:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.283405:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.288276:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.291600:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.300309:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.308886:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.322699:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.323991:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.328112:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.332901:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.336515:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.341095:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.342760:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.345387:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.348629:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.350887:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.352350:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.354364:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.358000:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.361158:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.361617:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.365340:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.369634:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.369688:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.373663:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.377849:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.382123:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.385579:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.391915:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.405204:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.405257:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.410380:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.419309:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.419992:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.439136:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.451606:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.468740:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.472123:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.502383:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172288128 00000100:00100000:0.0:1746144885.502386:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172288128 00000100:00100000:0.0:1746144885.502406:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172288256 00000100:00100000:0.0:1746144885.502408:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172288256 00000100:00100000:0.0:1746144885.502424:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1746144885.502428:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1830965172288128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144885.502455:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1830965172288128:12345-0@lo:400:kworker.0 Request processed in 28us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144885.502462:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1746144885.502471:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1746144885.502475:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1830965172288256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144885.502490:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1830965172288256:12345-0@lo:400:kworker.0 Request processed in 15us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144885.502494:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1746144885.502560:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2566f13b-362a-4e88-b0dd-c558bbe87895:3307:1830965172288000:0@lo:400:kworker.0 00000100:00100000:1.0:1746144885.502589:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144885.502619:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1830965172288512:0@lo:400:kworker.0 00000100:00100000:1.0:1746144885.502636:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144885.502646:0:3307:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746144885.502650:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172288384:0@lo:400:kworker.0 00000100:00100000:1.0:1746144885.502663:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144885.502677:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172288384 00000100:00100000:1.0:1746144885.502679:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172288384 00000100:00100000:1.0:1746144885.502697:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1746144885.502701:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172288384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746144885.502720:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172288384:12345-0@lo:400:kworker.0 Request processed in 19us (55us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.502724:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1746144885.502738:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172288384:0@lo:400:kworker.0 00000100:00100000:0.0:1746144885.502785:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172288000 00000100:00100000:0.0:1746144885.502788:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172288000 00000100:00100000:0.0:1746144885.502805:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1746144885.502809:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2566f13b-362a-4e88-b0dd-c558bbe87895+18:3307:x1830965172288000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144885.502839:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2566f13b-362a-4e88-b0dd-c558bbe87895+18:3307:x1830965172288000:12345-0@lo:400:kworker.0 Request processed in 30us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144885.502845:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1746144885.502862:0:21078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172288512 00000100:00100000:0.0:1746144885.502864:0:21078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172288512 00000100:00100000:0.0:1746144885.502877:0:21078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1746144885.502880:0:21078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1830965172288512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144885.502897:0:21078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1830965172288512:12345-0@lo:400:kworker.0 Request processed in 16us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144885.502901:0:21078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1746144885.502956:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2566f13b-362a-4e88-b0dd-c558bbe87895:3307:1830965172288000:0@lo:400:kworker.0 00000100:00100000:1.0:1746144885.502964:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1830965172288512:0@lo:400:kworker.0 00000100:00100000:0.0:1746144885.507607:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.512393:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.513523:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174847872 00000100:00100000:0.0:1746144885.513530:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174847872 00000100:00100000:0.0:1746144885.513574:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4894 00000100:00100000:0.0:1746144885.513580:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31565:x1830965174847872:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144885.513592:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144885.513609:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091750400/0x4076af6727513f39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9399d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144885.513633:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144885.513639:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513f32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93996 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144885.513644:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746144885.513648:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091750400/0x4076af6727513f39 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9399d expref: 67 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144885.513682:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727513f32 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93996 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144885.513693:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091750400/0x4076af6727513f39 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9399d expref: 67 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144885.513703:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091750400, rc 0) 00000100:00100000:0.0:1746144885.513728:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099718850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+67:31565:x1830965174847872:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 149us (1337us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144885.513734:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4894 00000100:00100000:0.0:1746144885.515139:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.518202:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.520845:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.524444:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.527515:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.528988:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.532141:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.534487:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.534532:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.534584:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174849408 00000100:00100000:1.0:1746144885.534588:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174849408 00000100:00100000:1.0:1746144885.534631:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4896 00000100:00100000:1.0:1746144885.534637:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013619b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31579:x1830965174849408:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144885.534649:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144885.534666:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513f4e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af939b2 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.534723:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.534727:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf25c00/0x4076af6727513f47 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939ab expref: 68 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.534733:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144885.534735:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513f4e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939b2 expref: 68 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.534780:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf25c00/0x4076af6727513f47 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939ab expref: 68 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.534817:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727513f4e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939b2 expref: 68 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.534825:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:1.0:1746144885.534856:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013619b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+68:31579:x1830965174849408:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 219us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.534862:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4896 00000100:00100000:0.0:1746144885.537196:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.545938:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.549081:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172289792 00000100:00100000:0.0:1746144885.549088:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172289792 00000100:00100000:0.0:1746144885.549121:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1746144885.549128:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1830965172289792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746144885.549160:0:8435:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 680984576 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1746144885.549210:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1830965172289792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144885.549215:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1746144885.549894:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.559673:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.563737:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.567208:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.574379:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.574793:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.578112:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.579057:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.581077:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.584916:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.588563:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.590219:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.595759:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.601040:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.601342:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.601508:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174852480 00000100:00100000:1.0:1746144885.601512:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174852480 00000100:00100000:1.0:1746144885.601542:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4903 00000100:00100000:1.0:1746144885.601548:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+67:31565:x1830965174852480:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144885.601634:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144885.601641:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513f78 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af939dc expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.601653:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.601657:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f71 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939d5 expref: 68 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.601662:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144885.601665:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513f78 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939dc expref: 68 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.601686:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f71 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939d5 expref: 68 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.601698:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513f78 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939dc expref: 68 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.601706:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:1.0:1746144885.601740:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+68:31565:x1830965174852480:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 191us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.601747:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4903 00000100:00100000:0.0:1746144885.603106:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.605348:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.605426:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174852864 00000100:00100000:1.0:1746144885.605432:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174852864 00002000:00100000:1.0:1746144885.605466:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa3b80 x1830965174852864/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.605476:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa3b80 with x1830965174852864 ext(0->4095) 00010000:00010000:1.0:1746144885.605483:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f71 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939d5 expref: 67 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.605495:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f71 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939d5 expref: 67 pid: 8430 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.605501:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa3b80 00000100:00100000:1.0:1746144885.606688:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1686 00000100:00100000:1.0:1746144885.606706:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1985:x1830965174852864:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144885.607371:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1985:x1830965174852864:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 671us (2026us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.607379:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1686 00002000:00100000:1.0:1746144885.607386:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa3b80 x1830965174852864/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.607395:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa3b80 with x1830965174852864 ext(0->4095) 00010000:00010000:1.0:1746144885.607403:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939d5 expref: 67 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.607415:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939d5 expref: 67 pid: 8430 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.607421:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa3b80 00000100:00100000:0.0:1746144885.610886:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.615913:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174853376 00000100:00100000:1.0:1746144885.615921:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174853376 00002000:00100000:1.0:1746144885.615957:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417ed80 x1830965174853376/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.615967:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417ed80 with x1830965174853376 ext(0->4095) 00010000:00010000:1.0:1746144885.615975:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513f78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939dc expref: 66 pid: 8432 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.615987:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513f78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939dc expref: 66 pid: 8432 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.615992:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417ed80 00000100:00100000:1.0:1746144885.616007:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1687 00000100:00100000:1.0:1746144885.616025:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965174853376:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144885.616608:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965174853376:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 594us (854us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.616615:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1687 00002000:00100000:1.0:1746144885.616621:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417ed80 x1830965174853376/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.616629:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417ed80 with x1830965174853376 ext(0->4095) 00010000:00010000:1.0:1746144885.616633:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513f78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939dc expref: 66 pid: 8432 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.616642:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727513f78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939dc expref: 66 pid: 8432 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.616653:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417ed80 00000100:00100000:0.0:1746144885.618969:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.619061:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.624581:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.624877:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174853888 00000100:00100000:1.0:1746144885.624886:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174853888 00002000:00100000:1.0:1746144885.624936:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa1c00 x1830965174853888/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.624946:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1c00 with x1830965174853888 ext(0->4095) 00010000:00010000:1.0:1746144885.624955:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727513f7f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939e3 expref: 6 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.624969:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727513f7f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939e3 expref: 6 pid: 8430 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.624976:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa1c00 00000100:00100000:1.0:1746144885.624999:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1688 00000100:00100000:1.0:1746144885.625007:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174853888:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144885.625200:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174853888:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 192us (628us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.625206:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1688 00002000:00100000:1.0:1746144885.625211:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa1c00 x1830965174853888/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.625218:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1c00 with x1830965174853888 ext(0->4095) 00010000:00010000:1.0:1746144885.625222:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727513f7f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939e3 expref: 6 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.625235:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727513f7f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939e3 expref: 6 pid: 8430 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.625239:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa1c00 00000100:00100000:0.0:1746144885.628570:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.633722:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a417d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172291968:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144885.633756:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144885.634075:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965174854016:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4188us (5513us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144885.634087:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10321 00000100:00100000:0.0:1746144885.637050:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.643122:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174854528 00000100:00100000:0.0:1746144885.643476:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174854528 00010000:00010000:0.0:1746144885.643511:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727513f86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939ea expref: 66 pid: 8430 timeout: 579 lvb_type: 0 00000100:00100000:0.0:1746144885.643549:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10322 00000100:00100000:0.0:1746144885.643556:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965174854528:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144885.643569:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144885.643591:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727513f86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939ea expref: 66 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1746144885.643603:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727513f86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939ea expref: 66 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1746144885.643627:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727513f86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939ea expref: 66 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:0.0:1746144885.643653:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144885.643655:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144885.643663:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727513f8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144885.643671:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727513f8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144885.643702:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727513f8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144885.643715:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093fa2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172292224:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144885.643809:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144885.647273:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093fa2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172292224:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144885.647292:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144885.647347:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965174854528:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3791us (4294us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144885.647356:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10322 00000100:00100000:0.0:1746144885.648070:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.648475:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174854912 00000100:00100000:1.0:1746144885.648481:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174854912 00002000:00100000:1.0:1746144885.648513:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa2d80 x1830965174854912/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.648527:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa2d80 with x1830965174854912 ext(0->4095) 00010000:00010000:1.0:1746144885.648535:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727513f8d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f1 expref: 6 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.648545:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727513f8d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f1 expref: 6 pid: 8430 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.648551:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa2d80 00000100:00100000:1.0:1746144885.648581:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1689 00000100:00100000:1.0:1746144885.648757:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174854912:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144885.648958:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174854912:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 369us (887us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.648964:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1689 00002000:00100000:1.0:1746144885.648970:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa2d80 x1830965174854912/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.648977:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa2d80 with x1830965174854912 ext(0->4095) 00010000:00010000:1.0:1746144885.648982:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727513f8d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f1 expref: 6 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.648990:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727513f8d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f1 expref: 6 pid: 8430 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.648996:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa2d80 00000100:00100000:0.0:1746144885.657506:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.659389:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.659490:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174855168 00000100:00100000:1.0:1746144885.659495:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174855168 00010000:00010000:1.0:1746144885.659517:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727513f8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f1 expref: 6 pid: 8430 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1746144885.659537:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10323 00000100:00100000:1.0:1746144885.659542:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174855168:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144885.659552:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144885.659572:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727513f8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f1 expref: 6 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.659582:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727513f8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f1 expref: 6 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.659601:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727513f8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f1 expref: 6 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.659628:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.659630:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.659636:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f8 expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.659647:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f8 expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.659670:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f8 expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.659680:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f8 expref: 66 pid: 8430 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1746144885.659693:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172292608:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144885.659754:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144885.661966:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172292608:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144885.661988:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144885.662180:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965174855168:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2635us (2789us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.662192:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10323 00000100:00100000:0.0:1746144885.662340:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.662656:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174855424 00000100:00100000:1.0:1746144885.662663:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174855424 00002000:00100000:1.0:1746144885.662698:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa2680 x1830965174855424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.662707:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa2680 with x1830965174855424 ext(0->4095) 00010000:00010000:1.0:1746144885.662715:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f8 expref: 67 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.662726:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f8 expref: 67 pid: 8430 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.662733:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa2680 00000100:00100000:1.0:1746144885.662759:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1690 00000100:00100000:1.0:1746144885.662784:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1982:x1830965174855424:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144885.662944:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1982:x1830965174855424:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 160us (604us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.662950:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1690 00002000:00100000:1.0:1746144885.662954:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa2680 x1830965174855424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.662961:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa2680 with x1830965174855424 ext(0->4095) 00010000:00010000:1.0:1746144885.662965:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f8 expref: 67 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.662974:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f8 expref: 67 pid: 8430 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.662980:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa2680 00000100:00100000:0.0:1746144885.666393:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.666489:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174855552 00000100:00100000:1.0:1746144885.666497:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174855552 00010000:00010000:1.0:1746144885.666532:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f8 expref: 67 pid: 8430 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1746144885.666570:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10324 00000100:00100000:1.0:1746144885.666578:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1985:x1830965174855552:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144885.666593:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144885.666617:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f8 expref: 67 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.666628:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f8 expref: 67 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.666652:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727513f94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939f8 expref: 67 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.666684:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.666686:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.666693:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727513f9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939ff expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.666700:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727513f9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939ff expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.666745:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727513f9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939ff expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144885.666799:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172292736:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144885.666890:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144885.673794:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.673921:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172292736:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144885.673945:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144885.673991:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1985:x1830965174855552:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7412us (7606us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.674002:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10324 00000100:00100000:0.0:1746144885.678533:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.695123:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.701483:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.701726:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174856192 00000100:00100000:1.0:1746144885.701736:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174856192 00010000:00010000:1.0:1746144885.701794:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727513f9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939ff expref: 68 pid: 8430 timeout: 579 lvb_type: 0 00000100:00100000:1.0:1746144885.701827:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10325 00000100:00100000:1.0:1746144885.701834:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+68:1982:x1830965174856192:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144885.701847:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746144885.701866:0:9812:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 1746144885 -> 1746144886 00002000:00010000:1.0:1746144885.701869:0:9812:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 1746144885 -> 1746144886 00010000:00010000:1.0:1746144885.701874:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727513f9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939ff expref: 68 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.701885:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727513f9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939ff expref: 68 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.701907:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727513f9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af939ff expref: 68 pid: 8430 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.701935:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.701937:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.701944:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727513fa2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a06 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.701951:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727513fa2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a06 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.701982:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727513fa2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a06 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144885.701994:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172292992:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144885.705529:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.708288:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.708325:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174856576 00000100:00100000:0.0:1746144885.708329:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174856576 00000100:00100000:1.0:1746144885.708341:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00002000:00100000:0.0:1746144885.708361:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167dc00 x1830965174856576/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144885.708371:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167dc00 with x1830965174856576 ext(0->4095) 00000100:00100000:1.0:1746144885.708376:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172292992:192.168.202.16@tcp:105: 00002000:00010000:0.0:1746144885.708376:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167dc00 00000100:00100000:0.0:1746144885.708403:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3740 00000100:00100000:0.0:1746144885.708409:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174856576:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00010000:00010000:1.0:1746144885.708450:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144885.708496:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+68:1982:x1830965174856192:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6662us (7024us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.708504:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10325 00000100:00100000:0.0:1746144885.708579:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174856576:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 170us (292us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144885.708585:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3740 00002000:00100000:0.0:1746144885.708590:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167dc00 x1830965174856576/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144885.708597:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167dc00 with x1830965174856576 ext(0->4095) 00002000:00010000:0.0:1746144885.708599:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167dc00 00000100:00100000:0.0:1746144885.712597:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.713929:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.717875:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.721676:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.724866:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.727380:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.732206:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.737614:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.738422:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.743570:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.745375:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.749418:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.752802:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.757205:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.759518:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.763726:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.767262:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.768256:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.770522:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.772327:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.777627:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.777893:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174860160 00000100:00100000:1.0:1746144885.777901:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174860160 00002000:00100000:1.0:1746144885.777944:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181f480 x1830965174860160/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.777954:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181f480 with x1830965174860160 ext(0->4095) 00010000:00010000:1.0:1746144885.777963:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727513fd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a37 expref: 69 pid: 20722 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.777979:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727513fd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a37 expref: 69 pid: 20722 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.777985:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181f480 00000100:00100000:1.0:1746144885.778003:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1694 00000100:00100000:1.0:1746144885.778009:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+69:1984:x1830965174860160:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144885.778524:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+69:1984:x1830965174860160:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 513us (905us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.778530:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1694 00002000:00100000:1.0:1746144885.778535:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181f480 x1830965174860160/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.778542:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181f480 with x1830965174860160 ext(0->4095) 00010000:00010000:1.0:1746144885.778547:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727513fd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a37 expref: 69 pid: 20722 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.778556:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727513fd3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a37 expref: 69 pid: 20722 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.778562:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181f480 00000100:00100000:0.0:1746144885.783470:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.787860:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.787930:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174860544 00000100:00100000:1.0:1746144885.787937:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174860544 00002000:00100000:1.0:1746144885.787982:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181f100 x1830965174860544/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.787992:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181f100 with x1830965174860544 ext(0->4095) 00002000:00010000:1.0:1746144885.787997:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009181f100 00000100:00100000:1.0:1746144885.788032:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3745 00000100:00100000:1.0:1746144885.788040:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+68:1985:x1830965174860544:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144885.788246:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+68:1985:x1830965174860544:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 207us (387us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.788252:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3745 00002000:00100000:1.0:1746144885.788259:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181f100 x1830965174860544/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.788265:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181f100 with x1830965174860544 ext(0->4095) 00002000:00010000:1.0:1746144885.788268:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009181f100 00000100:00100000:0.0:1746144885.790860:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.793271:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.798827:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.800905:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174861184 00000100:00100000:1.0:1746144885.800911:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174861184 00002000:00100000:1.0:1746144885.800952:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38fb80 x1830965174861184/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.801281:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38fb80 with x1830965174861184 ext(0->4095) 00010000:00010000:1.0:1746144885.801290:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513fe1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a45 expref: 6 pid: 20722 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.801302:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513fe1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a45 expref: 6 pid: 20722 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.801308:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f38fb80 00000100:00100000:1.0:1746144885.801754:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1695 00000100:00100000:1.0:1746144885.801797:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174861184:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144885.801971:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174861184:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 209us (1373us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.801977:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1695 00002000:00100000:1.0:1746144885.801982:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38fb80 x1830965174861184/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.801989:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38fb80 with x1830965174861184 ext(0->4095) 00010000:00010000:1.0:1746144885.801994:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513fe1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a45 expref: 6 pid: 20722 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.802004:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727513fe1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a45 expref: 6 pid: 20722 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.802010:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f38fb80 00000100:00100000:0.0:1746144885.804053:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.804160:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.808749:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.813235:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.817059:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.821874:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.826657:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.830223:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.833388:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174862720 00000100:00100000:1.0:1746144885.833394:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174862720 00002000:00100000:1.0:1746144885.833427:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5f100 x1830965174862720/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.833436:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5f100 with x1830965174862720 ext(0->4095) 00010000:00010000:1.0:1746144885.833442:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513ff6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a5a expref: 6 pid: 20722 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.833452:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513ff6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a5a expref: 6 pid: 20722 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.833458:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5f100 00000100:00100000:1.0:1746144885.833472:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1697 00000100:00100000:1.0:1746144885.833477:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174862720:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144885.833629:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174862720:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 151us (760us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.833635:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1697 00002000:00100000:1.0:1746144885.833640:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5f100 x1830965174862720/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.833647:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5f100 with x1830965174862720 ext(0->4095) 00010000:00010000:1.0:1746144885.833652:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513ff6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a5a expref: 6 pid: 20722 timeout: 579 lvb_type: 0 00010000:00010000:1.0:1746144885.833660:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727513ff6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a5a expref: 6 pid: 20722 timeout: 579 lvb_type: 0 00002000:00010000:1.0:1746144885.833665:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5f100 00000100:00100000:0.0:1746144885.837736:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.842329:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.855305:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.864960:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.867031:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.868941:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174863488 00000100:00100000:1.0:1746144885.868952:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174863488 00002000:00100000:1.0:1746144885.869001:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009230c380 x1830965174863488/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 496/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.869021:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230c380 with x1830965174863488 ext(0->7) 00010000:00010000:1.0:1746144885.869031:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513ffd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a61 expref: 69 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144885.869045:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513ffd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a61 expref: 69 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144885.869052:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230c380 00000100:00100000:1.0:1746144885.869085:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1698 00000100:00100000:1.0:1746144885.869094:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+69:1984:x1830965174863488:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144885.869447:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+71:1984:x1830965174863488:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 353us (2433us total) trans 4294967941 rc 0/0 00000100:00100000:1.0:1746144885.869454:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1698 00002000:00100000:1.0:1746144885.869460:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009230c380 x1830965174863488/t4294967941(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 496/448 e 0 to 0 dl 1746144896 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.869471:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230c380 with x1830965174863488 ext(0->7) 00010000:00010000:1.0:1746144885.869475:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513ffd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a61 expref: 71 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144885.869483:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727513ffd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a61 expref: 71 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144885.869488:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230c380 00000100:00100000:0.0:1746144885.872949:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.881145:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.884397:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.888383:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.888720:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174864256 00000100:00100000:1.0:1746144885.888729:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174864256 00002000:00100000:1.0:1746144885.888794:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230f800 x1830965174864256/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.888804:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230f800 with x1830965174864256 ext(0->4095) 00002000:00010000:1.0:1746144885.888808:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230f800 00000100:00100000:1.0:1746144885.888832:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3748 00000100:00100000:1.0:1746144885.888838:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1982:x1830965174864256:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144885.889023:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1982:x1830965174864256:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 174us (634us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.889029:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3748 00002000:00100000:1.0:1746144885.889034:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230f800 x1830965174864256/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.889041:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230f800 with x1830965174864256 ext(0->4095) 00002000:00010000:1.0:1746144885.889044:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230f800 00000100:00100000:1.0:1746144885.913826:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174864384 00000100:00100000:1.0:1746144885.913835:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174864384 00000100:00100000:1.0:1746144885.913881:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4925 00000100:00100000:1.0:1746144885.913888:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174864384:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144885.913907:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144885.913925:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514012 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93a76 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.913954:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099aff600/0x4076af672751400b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a6f expref: 69 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.913961:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144885.913963:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144885.913966:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514012 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a76 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.913993:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099aff600/0x4076af672751400b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a6f expref: 69 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.914004:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099aff600/0x4076af672751400b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a6f expref: 69 pid: 20722 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144885.914026:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172296960:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144885.914102:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144885.915045:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172296960:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144885.915064:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514012 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a76 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.915078:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:1.0:1746144885.915117:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174864384:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1229us (1381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.915124:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4925 00000100:00100000:0.0:1746144885.916840:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.934611:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.935899:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10341 00000100:00100000:1.0:1746144885.935912:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1982:x1830965174864640:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144885.935928:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144885.935956:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099aff600/0x4076af672751400b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a6f expref: 72 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144885.935970:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099aff600/0x4076af672751400b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a6f expref: 72 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144885.935993:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099aff600/0x4076af672751400b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a6f expref: 72 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144885.936034:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.936037:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.936044:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514012 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a76 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.936063:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514012 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a76 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.936099:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514012 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a76 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144885.936113:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172297088:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144885.936198:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144885.939647:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172297088:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144885.939674:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144885.939719:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+71:1982:x1830965174864640:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3809us (5116us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.939730:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10341 00000100:00100000:0.0:1746144885.940573:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.940662:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174864896 00000100:00100000:1.0:1746144885.940669:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174864896 00002000:00100000:1.0:1746144885.940711:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230f100 x1830965174864896/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.940720:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230f100 with x1830965174864896 ext(0->4095) 00002000:00010000:1.0:1746144885.940724:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230f100 00000100:00100000:1.0:1746144885.940754:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3749 00000100:00100000:1.0:1746144885.940986:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174864896:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144885.941902:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174864896:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 1139us (1329us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.941909:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3749 00002000:00100000:1.0:1746144885.941915:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230f100 x1830965174864896/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.941922:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230f100 with x1830965174864896 ext(0->4095) 00002000:00010000:1.0:1746144885.941926:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230f100 00000100:00100000:0.0:1746144885.944629:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.944740:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174865024 00000100:00100000:1.0:1746144885.944748:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174865024 00000100:00100000:1.0:1746144885.946062:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4926 00000100:00100000:1.0:1746144885.946074:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+71:31579:x1830965174865024:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144885.946095:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144885.946113:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514019 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93a7d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.946142:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514012 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a76 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.946149:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.946151:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144885.946154:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514019 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a7d expref: 72 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.946183:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514012 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a76 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.946194:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514012 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a76 expref: 5 pid: 8432 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144885.946205:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172297216:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144885.946275:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144885.947852:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172297216:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144885.947894:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514019 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a7d expref: 72 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.947917:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:1.0:1746144885.947958:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+72:31579:x1830965174865024:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1886us (3336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.947967:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4926 00000100:00100000:0.0:1746144885.950266:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.954255:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.954386:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174865408 00000100:00100000:1.0:1746144885.954393:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174865408 00002000:00100000:1.0:1746144885.954431:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230e300 x1830965174865408/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/0 e 0 to 0 dl 1746144896 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.954442:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230e300 with x1830965174865408 ext(0->4095) 00002000:00010000:1.0:1746144885.954446:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230e300 00000100:00100000:1.0:1746144885.954470:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3750 00000100:00100000:1.0:1746144885.954476:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1983:x1830965174865408:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144885.954631:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1983:x1830965174865408:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 155us (379us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144885.954637:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3750 00002000:00100000:1.0:1746144885.954662:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230e300 x1830965174865408/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:526/0 lens 488/4536 e 0 to 0 dl 1746144896 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144885.954670:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230e300 with x1830965174865408 ext(0->4095) 00002000:00010000:1.0:1746144885.954672:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230e300 00000100:00100000:0.0:1746144885.958163:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.958254:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174865536 00000100:00100000:1.0:1746144885.958264:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174865536 00000100:00100000:1.0:1746144885.958321:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4927 00000100:00100000:1.0:1746144885.958328:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174865536:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144885.958347:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144885.958366:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514020 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93a84 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.958395:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514019 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a7d expref: 71 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.958402:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144885.958404:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144885.958407:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514020 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a84 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.958439:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514019 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a7d expref: 71 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.958450:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514019 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a7d expref: 71 pid: 8432 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144885.958461:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172297472:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144885.958545:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144885.961184:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172297472:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144885.961219:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514020 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a84 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.961237:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:1.0:1746144885.961279:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174865536:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2951us (3126us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.961290:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4927 00000100:00100000:0.0:1746144885.966867:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.966920:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144885.967182:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174865792 00000100:00100000:1.0:1746144885.967186:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174865792 00000100:00100000:1.0:1746144885.967225:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4928 00000100:00100000:1.0:1746144885.967230:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+73:31565:x1830965174865792:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144885.967249:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144885.967262:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514027 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93a8b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.967286:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144885.967292:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514020 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a84 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.967298:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144885.967301:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514027 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a8b expref: 74 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.967337:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514020 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a84 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.967350:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514027 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a8b expref: 74 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144885.967361:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:1.0:1746144885.967405:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+74:31565:x1830965174865792:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 174us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144885.967411:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4928 00000100:00100000:0.0:1746144885.975371:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.980185:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.986103:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144885.995335:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.012575:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.012650:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174866688 00000100:00100000:1.0:1746144886.012661:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174866688 00002000:00100000:1.0:1746144886.012710:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880092587100 x1830965174866688/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 496/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.012719:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092587100 with x1830965174866688 ext(0->7) 00010000:00010000:1.0:1746144886.012729:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514027 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a8b expref: 72 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.012744:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514027 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a8b expref: 72 pid: 8432 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.012750:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092587100 00000100:00100000:1.0:1746144886.012811:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1702 00000100:00100000:1.0:1746144886.012819:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1984:x1830965174866688:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144886.013189:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+74:1984:x1830965174866688:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 370us (624us total) trans 4294967943 rc 0/0 00000100:00100000:1.0:1746144886.013197:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1702 00002000:00100000:1.0:1746144886.013203:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880092587100 x1830965174866688/t4294967943(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 496/448 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.013210:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092587100 with x1830965174866688 ext(0->7) 00010000:00010000:1.0:1746144886.013215:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514027 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a8b expref: 74 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.013224:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514027 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a8b expref: 74 pid: 8432 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.013234:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092587100 00000100:00100000:0.0:1746144886.033557:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.037458:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.042923:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.042957:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174867200 00000100:00100000:0.0:1746144886.042964:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174867200 00002000:00100000:0.0:1746144886.043024:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092585c00 x1830965174867200/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144886.043035:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092585c00 with x1830965174867200 ext(0->4095) 00010000:00010000:0.0:1746144886.043045:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093939800/0x4076af672751402e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a92 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:0.0:1746144886.043058:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093939800/0x4076af672751402e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a92 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:0.0:1746144886.043064:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092585c00 00000100:00100000:0.0:1746144886.043083:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1703 00000100:00100000:0.0:1746144886.043090:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965174867200:12345-192.168.202.16@tcp:3:ldlm_bl.0 00000100:00100000:0.0:1746144886.043261:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965174867200:12345-192.168.202.16@tcp:3:ldlm_bl.0 Request processed in 171us (345us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144886.043267:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1703 00002000:00100000:0.0:1746144886.043272:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092585c00 x1830965174867200/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144886.043279:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092585c00 with x1830965174867200 ext(0->4095) 00010000:00010000:0.0:1746144886.043284:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093939800/0x4076af672751402e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a92 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:0.0:1746144886.043293:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093939800/0x4076af672751402e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93a92 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:0.0:1746144886.043298:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092585c00 00000100:00100000:0.0:1746144886.047350:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.051724:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.052226:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174867584 00000100:00100000:1.0:1746144886.052234:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174867584 00002000:00100000:1.0:1746144886.052274:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092587800 x1830965174867584/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.052284:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092587800 with x1830965174867584 ext(0->4095) 00002000:00010000:1.0:1746144886.052288:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092587800 00000100:00100000:1.0:1746144886.052305:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3752 00000100:00100000:1.0:1746144886.052310:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+74:1983:x1830965174867584:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144886.052478:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+74:1983:x1830965174867584:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 168us (765us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.052485:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3752 00002000:00100000:1.0:1746144886.052490:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092587800 x1830965174867584/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.052496:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092587800 with x1830965174867584 ext(0->4095) 00002000:00010000:1.0:1746144886.052499:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092587800 00000100:00100000:0.0:1746144886.055261:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.058578:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.067557:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.072322:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.072712:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.074655:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.074691:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.078047:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.081936:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.084949:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.085116:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174869248 00000100:00100000:1.0:1746144886.085123:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174869248 00002000:00100000:1.0:1746144886.085162:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093855880 x1830965174869248/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.085171:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093855880 with x1830965174869248 ext(0->4095) 00002000:00010000:1.0:1746144886.085385:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093855880 00000100:00100000:1.0:1746144886.085413:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3753 00000100:00100000:1.0:1746144886.085424:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965174869248:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144886.085629:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965174869248:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 204us (679us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.085635:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3753 00002000:00100000:1.0:1746144886.085640:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093855880 x1830965174869248/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.085647:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093855880 with x1830965174869248 ext(0->4095) 00002000:00010000:1.0:1746144886.085649:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093855880 00000100:00100000:0.0:1746144886.088290:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.097462:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.098165:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.102491:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.102719:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174869888 00000100:00100000:1.0:1746144886.102726:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174869888 00002000:00100000:1.0:1746144886.102784:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358eed80 x1830965174869888/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.102794:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358eed80 with x1830965174869888 ext(0->4095) 00010000:00010000:1.0:1746144886.102802:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514051 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ab5 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.102815:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514051 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ab5 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.102822:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801358eed80 00000100:00100000:1.0:1746144886.102992:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1707 00000100:00100000:1.0:1746144886.102999:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174869888:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144886.103185:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174869888:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 185us (697us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.103195:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1707 00002000:00100000:1.0:1746144886.103200:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358eed80 x1830965174869888/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.103207:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358eed80 with x1830965174869888 ext(0->4095) 00010000:00010000:1.0:1746144886.103211:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514051 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ab5 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.103220:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514051 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ab5 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.103226:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801358eed80 00000100:00100000:0.0:1746144886.106098:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.110379:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.116793:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.125912:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.126343:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174870528 00000100:00100000:1.0:1746144886.126350:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174870528 00002000:00100000:1.0:1746144886.126394:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880093f46300 x1830965174870528/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 496/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.126403:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f46300 with x1830965174870528 ext(0->7) 00010000:00010000:1.0:1746144886.126409:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514058 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93abc expref: 76 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.126421:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514058 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93abc expref: 76 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.126427:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f46300 00000100:00100000:1.0:1746144886.126451:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1708 00000100:00100000:1.0:1746144886.126458:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1985:x1830965174870528:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144886.126822:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1985:x1830965174870528:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 364us (921us total) trans 4294967945 rc 0/0 00000100:00100000:1.0:1746144886.126829:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1708 00002000:00100000:1.0:1746144886.126835:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880093f46300 x1830965174870528/t4294967945(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 496/448 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.126841:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f46300 with x1830965174870528 ext(0->7) 00010000:00010000:1.0:1746144886.126845:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514058 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93abc expref: 78 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.126854:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514058 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93abc expref: 78 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.126859:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f46300 00000100:00100000:0.0:1746144886.139714:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.141328:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.146729:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.151562:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.154080:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.154179:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174871424 00000100:00100000:1.0:1746144886.154186:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174871424 00002000:00100000:1.0:1746144886.154230:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ed180 x1830965174871424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.154239:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ed180 with x1830965174871424 ext(0->4095) 00002000:00010000:1.0:1746144886.154243:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ed180 00000100:00100000:1.0:1746144886.154275:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3755 00000100:00100000:1.0:1746144886.154282:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1982:x1830965174871424:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144886.154461:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1982:x1830965174871424:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 178us (388us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.154467:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3755 00002000:00100000:1.0:1746144886.154472:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ed180 x1830965174871424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.154479:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ed180 with x1830965174871424 ext(0->4095) 00002000:00010000:1.0:1746144886.154482:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ed180 00000100:00100000:0.0:1746144886.160298:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.180890:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.191858:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.191913:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.204320:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.204420:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174872192 00000100:00100000:1.0:1746144886.204430:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174872192 00002000:00100000:1.0:1746144886.204484:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ef480 x1830965174872192/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.204495:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ef480 with x1830965174872192 ext(0->4095) 00010000:00010000:1.0:1746144886.204505:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751406d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ad1 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.204519:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751406d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ad1 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.204526:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ef480 00000100:00100000:1.0:1746144886.204562:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1711 00000100:00100000:1.0:1746144886.204570:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174872192:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144886.204759:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174872192:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 189us (451us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.204796:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1711 00002000:00100000:1.0:1746144886.204802:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ef480 x1830965174872192/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.204809:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ef480 with x1830965174872192 ext(0->4095) 00010000:00010000:1.0:1746144886.204813:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751406d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ad1 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.204823:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751406d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ad1 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.204829:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ef480 00000100:00100000:0.0:1746144886.208818:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.215907:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.227238:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.230363:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174872704 00000100:00100000:1.0:1746144886.230378:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174872704 00000100:00100000:1.0:1746144886.230440:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4940 00000100:00100000:1.0:1746144886.230450:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174872704:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144886.230470:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144886.230491:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751407b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93adf expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.230524:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514074 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ad8 expref: 79 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.230532:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144886.230534:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144886.230537:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751407b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93adf expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.230572:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514074 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ad8 expref: 79 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.230583:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514074 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ad8 expref: 79 pid: 20722 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144886.230595:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172300800:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144886.230700:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144886.235552:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172300800:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144886.235583:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751407b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93adf expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.235601:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:1.0:1746144886.235656:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174872704:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5207us (8429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.235665:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4940 00000100:00100000:0.0:1746144886.245648:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.247026:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174872832 00000100:00100000:1.0:1746144886.247039:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174872832 00000100:00100000:0.0:1746144886.252128:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.257648:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174872960 00000100:00100000:1.0:1746144886.257661:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174872960 00002000:00100000:1.0:1746144886.257714:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800918ec380 x1830965174872960/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 496/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.257725:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec380 with x1830965174872960 ext(0->7) 00010000:00010000:1.0:1746144886.257736:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514074 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ad8 expref: 81 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.257750:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514074 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ad8 expref: 81 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.257756:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ec380 00000100:00100000:1.0:1746144886.257795:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1712 00000100:00100000:1.0:1746144886.257803:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+81:1985:x1830965174872960:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144886.258197:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1985:x1830965174872960:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 394us (6079us total) trans 4294967947 rc 0/0 00000100:00100000:1.0:1746144886.258205:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1712 00002000:00100000:1.0:1746144886.258212:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800918ec380 x1830965174872960/t4294967947(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 496/448 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.258218:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec380 with x1830965174872960 ext(0->7) 00010000:00010000:1.0:1746144886.258222:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514074 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ad8 expref: 83 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.258232:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514074 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ad8 expref: 83 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.258237:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ec380 00000100:00100000:1.0:1746144886.258259:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4941 00000100:00100000:1.0:1746144886.258266:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+82:31565:x1830965174872832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144886.258275:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144886.258289:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514082 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93ae6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.258362:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144886.258367:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751407b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93adf expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.258372:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144886.258375:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514082 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ae6 expref: 83 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.258411:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751407b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93adf expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.258422:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514082 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ae6 expref: 83 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.258432:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:1.0:1746144886.258447:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099718450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+83:31565:x1830965174872832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 183us (12811us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.258452:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4941 00000100:00100000:0.0:1746144886.269579:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.273711:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.278194:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.282553:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.282791:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174873728 00000100:00100000:1.0:1746144886.282797:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174873728 00002000:00100000:1.0:1746144886.282835:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ec700 x1830965174873728/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.282846:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec700 with x1830965174873728 ext(0->4095) 00002000:00010000:1.0:1746144886.282850:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ec700 00000100:00100000:1.0:1746144886.282876:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3757 00000100:00100000:1.0:1746144886.282882:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1982:x1830965174873728:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144886.283968:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1982:x1830965174873728:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 1082us (1421us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.283975:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3757 00002000:00100000:1.0:1746144886.283982:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ec700 x1830965174873728/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.283990:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec700 with x1830965174873728 ext(0->4095) 00002000:00010000:1.0:1746144886.283993:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ec700 00000100:00100000:0.0:1746144886.289223:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.321645:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.323826:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.323888:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174873984 00000100:00100000:1.0:1746144886.323894:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174873984 00002000:00100000:1.0:1746144886.323930:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800918ef100 x1830965174873984/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 496/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.323939:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ef100 with x1830965174873984 ext(0->7) 00010000:00010000:1.0:1746144886.323946:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ae6 expref: 83 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.323957:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ae6 expref: 83 pid: 8432 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.323963:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ef100 00000100:00100000:1.0:1746144886.323985:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1714 00000100:00100000:1.0:1746144886.323990:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1985:x1830965174873984:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144886.324294:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965174873984:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 304us (475us total) trans 4294967948 rc 0/0 00000100:00100000:1.0:1746144886.324300:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1714 00002000:00100000:1.0:1746144886.324305:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800918ef100 x1830965174873984/t4294967948(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 496/448 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.324312:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ef100 with x1830965174873984 ext(0->7) 00010000:00010000:1.0:1746144886.324317:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ae6 expref: 85 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.324325:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514082 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ae6 expref: 85 pid: 8432 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.324331:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ef100 00000100:00100000:0.0:1746144886.333194:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.341106:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.344329:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.349596:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.352266:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174874880 00000100:00100000:1.0:1746144886.352279:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174874880 00002000:00100000:1.0:1746144886.352347:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924d9180 x1830965174874880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.352358:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d9180 with x1830965174874880 ext(0->4095) 00002000:00010000:1.0:1746144886.352363:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d9180 00000100:00100000:1.0:1746144886.352396:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3758 00000100:00100000:1.0:1746144886.352403:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1982:x1830965174874880:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144886.352607:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1982:x1830965174874880:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 204us (3014us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.352613:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3758 00002000:00100000:1.0:1746144886.352618:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924d9180 x1830965174874880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.352625:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d9180 with x1830965174874880 ext(0->4095) 00002000:00010000:1.0:1746144886.352628:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d9180 00000100:00100000:0.0:1746144886.359755:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.359890:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174875008 00000100:00100000:1.0:1746144886.359901:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174875008 00000100:00100000:1.0:1746144886.360001:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4944 00000100:00100000:1.0:1746144886.360017:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174875008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144886.360040:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144886.360060:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727514097 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93afb expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.360094:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514090 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93af4 expref: 83 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.360106:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144886.360108:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144886.360111:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727514097 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93afb expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.360148:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514090 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93af4 expref: 83 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.360160:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514090 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93af4 expref: 83 pid: 20722 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144886.360171:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172301824:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144886.361439:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144886.374288:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172301824:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144886.374324:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727514097 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93afb expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.374344:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:1.0:1746144886.374408:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174875008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 14398us (14664us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.374417:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4944 00000100:00100000:0.0:1746144886.376821:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.382903:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.385947:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.385974:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174875520 00000100:00100000:1.0:1746144886.385981:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174875520 00000100:00100000:1.0:1746144886.386031:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4945 00000100:00100000:1.0:1746144886.386039:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31565:x1830965174875520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144886.386058:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144886.386075:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751409e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93b02 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.386102:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727514097 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93afb expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.386109:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.386111:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.386114:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751409e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b02 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.386145:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727514097 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93afb expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.386156:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727514097 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93afb expref: 5 pid: 8432 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144886.386168:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172302080:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144886.386227:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144886.391683:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a893240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144886.392280:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172301952:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144886.392302:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144886.392603:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1984:x1830965174875264:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 9494us (9711us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144886.392614:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10360 00000100:00100000:1.0:1746144886.394617:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.394815:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174875648 00000100:00100000:0.0:1746144886.394823:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174875648 00002000:00100000:0.0:1746144886.394863:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e3bb80 x1830965174875648/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144886.394879:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3bb80 with x1830965174875648 ext(0->4095) 00010000:00010000:0.0:1746144886.394886:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727514097 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93afb expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:0.0:1746144886.394898:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727514097 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93afb expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00002000:00010000:0.0:1746144886.394903:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e3bb80 00000100:00100000:0.0:1746144886.394931:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1717 00000100:00100000:0.0:1746144886.394937:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174875648:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144886.395133:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174875648:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 195us (516us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144886.395139:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1717 00002000:00100000:0.0:1746144886.395145:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e3bb80 x1830965174875648/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144886.395152:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3bb80 with x1830965174875648 ext(0->4095) 00010000:00010000:0.0:1746144886.395156:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727514097 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93afb expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:0.0:1746144886.395165:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727514097 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93afb expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00002000:00010000:0.0:1746144886.395170:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e3bb80 00000100:00100000:0.0:1746144886.397204:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.402188:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.405713:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.409850:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.417634:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.427514:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.433738:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.433803:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174876800 00000100:00100000:0.0:1746144886.433811:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174876800 00002000:00100000:0.0:1746144886.433855:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093254700 x1830965174876800/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144886.433866:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254700 with x1830965174876800 ext(0->4095) 00010000:00010000:0.0:1746144886.433874:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275140a5 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b09 expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:0.0:1746144886.433887:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275140a5 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b09 expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00002000:00010000:0.0:1746144886.433893:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093254700 00000100:00100000:0.0:1746144886.433910:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1719 00000100:00100000:0.0:1746144886.433917:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174876800:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144886.436103:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174876800:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 2174us (2363us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144886.436117:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1719 00002000:00100000:0.0:1746144886.436129:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093254700 x1830965174876800/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144886.436138:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254700 with x1830965174876800 ext(0->4095) 00010000:00010000:0.0:1746144886.436150:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275140a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b09 expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:0.0:1746144886.436165:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275140a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b09 expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00002000:00010000:0.0:1746144886.436171:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093254700 00000100:00100000:0.0:1746144886.442311:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.447598:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.447798:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174877184 00000100:00100000:1.0:1746144886.447806:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174877184 00002000:00100000:1.0:1746144886.447847:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093254380 x1830965174877184/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.447857:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254380 with x1830965174877184 ext(0->4095) 00002000:00010000:1.0:1746144886.447862:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093254380 00000100:00100000:1.0:1746144886.447893:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3760 00000100:00100000:1.0:1746144886.447900:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965174877184:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144886.448080:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965174877184:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 179us (482us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.448086:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3760 00002000:00100000:1.0:1746144886.448091:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093254380 x1830965174877184/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.448098:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254380 with x1830965174877184 ext(0->4095) 00002000:00010000:1.0:1746144886.448101:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093254380 00000100:00100000:0.0:1746144886.465727:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.473449:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.479546:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.490181:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.496296:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174877952 00000100:00100000:0.0:1746144886.496303:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174877952 00002000:00100000:0.0:1746144886.496341:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38f800 x1830965174877952/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144886.496350:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38f800 with x1830965174877952 ext(0->4095) 00010000:00010000:0.0:1746144886.496358:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af67275140b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b17 expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:0.0:1746144886.496371:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af67275140b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b17 expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00002000:00010000:0.0:1746144886.496376:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f38f800 00000100:00100000:0.0:1746144886.496401:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1721 00000100:00100000:0.0:1746144886.496407:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174877952:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144886.496593:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174877952:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 185us (431us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144886.496598:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1721 00002000:00100000:0.0:1746144886.496604:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38f800 x1830965174877952/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144886.496611:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38f800 with x1830965174877952 ext(0->4095) 00010000:00010000:0.0:1746144886.496615:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af67275140b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b17 expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:0.0:1746144886.496623:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af67275140b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b17 expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00002000:00010000:0.0:1746144886.496628:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f38f800 00000100:00100000:0.0:1746144886.499207:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.503341:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.503475:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174878336 00000100:00100000:1.0:1746144886.503482:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174878336 00002000:00100000:1.0:1746144886.503521:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093256300 x1830965174878336/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.503531:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256300 with x1830965174878336 ext(0->4095) 00002000:00010000:1.0:1746144886.503535:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093256300 00000100:00100000:1.0:1746144886.503560:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3761 00000100:00100000:1.0:1746144886.503565:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965174878336:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144886.504225:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965174878336:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 656us (886us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.504233:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3761 00002000:00100000:1.0:1746144886.504239:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093256300 x1830965174878336/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.504246:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256300 with x1830965174878336 ext(0->4095) 00002000:00010000:1.0:1746144886.504249:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093256300 00000100:00100000:0.0:1746144886.506720:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.510272:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.516252:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174878848 00000100:00100000:0.0:1746144886.516256:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174878848 00002000:00100000:0.0:1746144886.516286:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5e300 x1830965174878848/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144886.516295:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5e300 with x1830965174878848 ext(0->4095) 00010000:00010000:0.0:1746144886.516300:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c400/0x4076af67275140c1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b25 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:0.0:1746144886.516310:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c400/0x4076af67275140c1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b25 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:0.0:1746144886.516317:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5e300 00000100:00100000:0.0:1746144886.516337:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1722 00000100:00100000:0.0:1746144886.516343:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174878848:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144886.516501:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174878848:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 157us (907us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144886.516507:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1722 00002000:00100000:0.0:1746144886.516513:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5e300 x1830965174878848/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144886.518425:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5e300 with x1830965174878848 ext(0->4095) 00010000:00010000:0.0:1746144886.518439:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c400/0x4076af67275140c1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b25 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:0.0:1746144886.518451:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c400/0x4076af67275140c1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b25 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:0.0:1746144886.518458:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5e300 00000100:00100000:0.0:1746144886.521966:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.522268:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.530411:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.530651:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174879488 00000100:00100000:1.0:1746144886.530658:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174879488 00002000:00100000:1.0:1746144886.530699:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5f100 x1830965174879488/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.530709:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5f100 with x1830965174879488 ext(0->4095) 00010000:00010000:1.0:1746144886.530718:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275140c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b2c expref: 91 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.530730:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275140c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b2c expref: 91 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.530736:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5f100 00000100:00100000:0.0:1746144886.531182:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1723 00000100:00100000:0.0:1746144886.531190:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1985:x1830965174879488:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144886.531360:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1985:x1830965174879488:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 171us (962us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144886.531369:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1723 00002000:00100000:0.0:1746144886.531374:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5f100 x1830965174879488/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144886.531382:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5f100 with x1830965174879488 ext(0->4095) 00010000:00010000:0.0:1746144886.531387:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275140c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b2c expref: 91 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:0.0:1746144886.532113:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275140c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b2c expref: 91 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:0.0:1746144886.532121:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5f100 00000100:00100000:0.0:1746144886.541524:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.548423:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.548696:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174879872 00000100:00100000:1.0:1746144886.548706:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174879872 00002000:00100000:1.0:1746144886.548755:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ca80 x1830965174879872/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.548780:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ca80 with x1830965174879872 ext(0->4095) 00002000:00010000:1.0:1746144886.548786:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ca80 00000100:00100000:1.0:1746144886.549327:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3762 00000100:00100000:1.0:1746144886.549336:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1985:x1830965174879872:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144886.550054:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965174879872:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 718us (1644us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.550062:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3762 00002000:00100000:1.0:1746144886.550067:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ca80 x1830965174879872/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.550080:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ca80 with x1830965174879872 ext(0->4095) 00002000:00010000:1.0:1746144886.550084:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ca80 00000100:00100000:0.0:1746144886.553533:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.557605:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.557717:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.558092:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174880256 00000100:00100000:0.0:1746144886.558097:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174880256 00010000:00010000:0.0:1746144886.558119:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275140cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b33 expref: 91 pid: 20722 timeout: 580 lvb_type: 0 00000100:00100000:0.0:1746144886.558138:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10369 00000100:00100000:0.0:1746144886.558143:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1985:x1830965174880256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144886.558155:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144886.558674:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275140cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b33 expref: 92 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:0.0:1746144886.558691:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275140cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b33 expref: 92 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:0.0:1746144886.558710:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275140cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b33 expref: 92 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:0.0:1746144886.558913:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144886.558955:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1985:x1830965174880256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 811us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144886.558962:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10369 00000100:00100000:0.0:1746144886.561999:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.562484:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174880512 00000100:00100000:1.0:1746144886.562491:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174880512 00002000:00100000:1.0:1746144886.562533:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5f800 x1830965174880512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.562543:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5f800 with x1830965174880512 ext(0->4095) 00010000:00010000:1.0:1746144886.562551:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275140d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b3a expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.562565:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275140d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b3a expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.562570:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5f800 00000100:00100000:1.0:1746144886.562595:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1724 00000100:00100000:1.0:1746144886.562600:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174880512:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144886.562798:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174880512:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 197us (805us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.562804:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1724 00002000:00100000:1.0:1746144886.562809:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5f800 x1830965174880512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.562816:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5f800 with x1830965174880512 ext(0->4095) 00010000:00010000:1.0:1746144886.562821:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275140d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b3a expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.562829:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275140d6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b3a expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.562835:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5f800 00000100:00100000:0.0:1746144886.567068:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.570241:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.570331:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174880896 00000100:00100000:1.0:1746144886.570338:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174880896 00002000:00100000:1.0:1746144886.570376:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ed80 x1830965174880896/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.570386:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ed80 with x1830965174880896 ext(0->4095) 00002000:00010000:1.0:1746144886.570390:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ed80 00000100:00100000:1.0:1746144886.570406:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3763 00000100:00100000:1.0:1746144886.570412:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1982:x1830965174880896:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144886.570566:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1982:x1830965174880896:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 155us (326us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.570572:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3763 00002000:00100000:1.0:1746144886.570576:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ed80 x1830965174880896/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.570583:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ed80 with x1830965174880896 ext(0->4095) 00002000:00010000:1.0:1746144886.570585:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ed80 00000100:00100000:0.0:1746144886.586861:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.610608:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.624388:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.627935:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.630710:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.632013:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174881664 00000100:00100000:1.0:1746144886.632022:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174881664 00002000:00100000:1.0:1746144886.632059:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5d180 x1830965174881664/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.632068:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5d180 with x1830965174881664 ext(0->4095) 00010000:00010000:1.0:1746144886.632076:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275140e4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b48 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.632089:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275140e4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b48 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.632095:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5d180 00000100:00100000:1.0:1746144886.632109:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1726 00000100:00100000:1.0:1746144886.632114:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174881664:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144886.632277:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174881664:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 162us (1574us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.632283:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1726 00002000:00100000:1.0:1746144886.632295:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5d180 x1830965174881664/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.632301:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5d180 with x1830965174881664 ext(0->4095) 00010000:00010000:1.0:1746144886.632306:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275140e4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b48 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.632314:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275140e4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b48 expref: 6 pid: 20722 timeout: 580 lvb_type: 0 00002000:00010000:1.0:1746144886.632325:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5d180 00000100:00100000:0.0:1746144886.636968:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.641450:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.647453:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.653253:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.657920:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.661281:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.661367:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.671212:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.671642:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.676283:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.681610:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.686430:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172305792:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144886.686455:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144886.687030:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1982:x1830965174883456:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4832us (5434us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144886.687042:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10375 00000100:00100000:0.0:1746144886.689612:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.693632:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.693725:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174883968 00000100:00100000:1.0:1746144886.693730:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174883968 00010000:00010000:1.0:1746144886.693754:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514100 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b64 expref: 94 pid: 20722 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144886.693797:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10376 00000100:00100000:1.0:1746144886.693803:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1984:x1830965174883968:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144886.693816:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144886.693835:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514100 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b64 expref: 94 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.693846:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514100 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b64 expref: 94 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.693867:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514100 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b64 expref: 94 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.694482:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.694485:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.694494:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514107 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b6b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.694501:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514107 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b6b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.694535:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514107 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b6b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144886.694550:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172306048:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144886.695293:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144886.697272:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.697374:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172306048:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144886.697395:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144886.697447:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1984:x1830965174883968:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3643us (3814us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.697458:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10376 00000100:00100000:0.0:1746144886.698801:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.703158:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.704297:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.704489:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174884608 00000100:00100000:1.0:1746144886.704494:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174884608 00010000:00010000:1.0:1746144886.704516:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514107 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b6b expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144886.704570:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10377 00000100:00100000:1.0:1746144886.704576:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174884608:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144886.704586:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144886.704607:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514107 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b6b expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.704618:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514107 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b6b expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.704635:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514107 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b6b expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.705040:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.705043:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.705052:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751410e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b72 expref: 94 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.705060:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751410e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b72 expref: 94 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.705089:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751410e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b72 expref: 94 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.705104:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751410e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b72 expref: 94 pid: 8432 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144886.705116:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e38700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172306432:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144886.705236:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144886.706737:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e38700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172306432:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144886.706755:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144886.707228:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.707254:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174884864 00000100:00100000:0.0:1746144886.707258:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174884864 00002000:00100000:0.0:1746144886.707302:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932ab480 x1830965174884864/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144886.707311:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932ab480 with x1830965174884864 ext(0->4095) 00010000:00010000:0.0:1746144886.707319:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751410e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b72 expref: 95 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:0.0:1746144886.707331:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751410e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b72 expref: 95 pid: 8432 timeout: 580 lvb_type: 0 00002000:00010000:0.0:1746144886.707337:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932ab480 00000100:00100000:0.0:1746144886.707368:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1729 00000100:00100000:0.0:1746144886.707376:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1984:x1830965174884864:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144886.707466:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965174884608:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2241us (2521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.707475:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10377 00000100:00100000:0.0:1746144886.707535:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1984:x1830965174884864:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 160us (308us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144886.707541:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1729 00002000:00100000:0.0:1746144886.707546:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932ab480 x1830965174884864/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144886.707553:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932ab480 with x1830965174884864 ext(0->4095) 00010000:00010000:0.0:1746144886.707557:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751410e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b72 expref: 95 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:0.0:1746144886.707566:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751410e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b72 expref: 95 pid: 8432 timeout: 580 lvb_type: 0 00002000:00010000:0.0:1746144886.707572:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932ab480 00000100:00100000:0.0:1746144886.712432:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.712820:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174884992 00000100:00100000:1.0:1746144886.712831:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174884992 00010000:00010000:1.0:1746144886.712867:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751410e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b72 expref: 95 pid: 8432 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144886.712905:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10378 00000100:00100000:1.0:1746144886.712913:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1985:x1830965174884992:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144886.712929:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144886.712952:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751410e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b72 expref: 95 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.712964:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751410e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b72 expref: 95 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.712989:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751410e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b72 expref: 95 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.713031:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.713033:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.713039:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514115 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b79 expref: 94 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.713047:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514115 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b79 expref: 94 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.713081:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514115 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b79 expref: 94 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144886.713093:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172306560:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144886.713757:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144886.719020:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.719125:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172306560:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144886.719150:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144886.719201:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1985:x1830965174884992:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6288us (6780us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.719216:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10378 00000100:00100000:0.0:1746144886.722914:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.727159:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.727740:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.727962:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174885504 00000100:00100000:1.0:1746144886.727971:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174885504 00010000:00010000:1.0:1746144886.728000:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514115 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b79 expref: 94 pid: 20722 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144886.728033:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10379 00000100:00100000:1.0:1746144886.728039:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1985:x1830965174885504:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144886.728050:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144886.728072:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514115 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b79 expref: 94 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.728083:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514115 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b79 expref: 94 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.728104:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514115 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b79 expref: 94 pid: 20722 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.728133:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.728134:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.728141:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751411c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b80 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.728149:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751411c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b80 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.728178:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751411c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b80 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144886.728189:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172306816:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144886.728255:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144886.731641:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172306816:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144886.731667:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144886.731709:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1985:x1830965174885504:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3669us (4553us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.731720:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10379 00000100:00100000:0.0:1746144886.732283:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.735996:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.736958:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174886016 00000100:00100000:1.0:1746144886.736967:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174886016 00010000:00010000:1.0:1746144886.737015:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751411c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b80 expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144886.737048:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10380 00000100:00100000:1.0:1746144886.737056:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093441c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174886016:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144886.737070:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144886.737092:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751411c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b80 expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.737104:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751411c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b80 expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.737127:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751411c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b80 expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.737652:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.737656:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.737664:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af6727514123 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b87 expref: 93 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.737673:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af6727514123 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b87 expref: 93 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.737709:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af6727514123 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b87 expref: 93 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144886.737721:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172307072:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144886.738250:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144886.740682:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.740795:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172307072:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144886.740816:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144886.740855:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093441c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965174886016:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3800us (4870us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.740865:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10380 00000100:00100000:0.0:1746144886.746566:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.749299:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.760059:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.760741:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174886656 00000100:00100000:1.0:1746144886.760751:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174886656 00010000:00010000:1.0:1746144886.760804:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af6727514123 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b87 expref: 96 pid: 8432 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144886.760839:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10381 00000100:00100000:1.0:1746144886.760845:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093443100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+96:1983:x1830965174886656:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144886.760862:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144886.760881:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af6727514123 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b87 expref: 96 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.760897:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af6727514123 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b87 expref: 96 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.760918:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af6727514123 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b87 expref: 96 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.760943:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.760944:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.760951:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751412a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b8e expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.760958:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751412a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b8e expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.760988:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751412a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b8e expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144886.760999:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172307328:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144886.761098:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144886.762810:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.765301:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172307328:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144886.765325:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144886.765376:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093443100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+97:1983:x1830965174886656:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4529us (5327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.765388:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10381 00000100:00100000:0.0:1746144886.766369:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.769313:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.769394:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174887168 00000100:00100000:1.0:1746144886.769403:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174887168 00010000:00010000:1.0:1746144886.769434:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751412a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b8e expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144886.769469:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10382 00000100:00100000:1.0:1746144886.769475:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174887168:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144886.769487:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144886.769503:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751412a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b8e expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.769512:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751412a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b8e expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.769531:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751412a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b8e expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.769737:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.769739:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.769747:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af6727514131 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b95 expref: 95 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.769754:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af6727514131 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b95 expref: 95 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.769818:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af6727514131 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b95 expref: 95 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144886.769828:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172307584:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144886.769902:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144886.772222:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172307584:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144886.772248:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144886.772288:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965174887168:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2812us (2982us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.772298:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10382 00000100:00100000:0.0:1746144886.773100:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.790415:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.798802:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.805630:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.805724:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174887808 00000100:00100000:1.0:1746144886.805733:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174887808 00010000:00010000:1.0:1746144886.805795:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af6727514131 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b95 expref: 98 pid: 8432 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144886.805822:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10383 00000100:00100000:1.0:1746144886.805828:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+98:1982:x1830965174887808:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144886.805844:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144886.805865:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af6727514131 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b95 expref: 98 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.805878:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af6727514131 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b95 expref: 98 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.805901:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af6727514131 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b95 expref: 98 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.805930:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.805932:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.805939:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514138 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b9c expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.805953:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514138 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b9c expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.805983:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514138 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b9c expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144886.805994:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172307840:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144886.806197:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144886.809558:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172307840:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144886.809584:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144886.809629:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+97:1982:x1830965174887808:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3799us (4007us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.809639:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10383 00000100:00100000:0.0:1746144886.812890:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.816856:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.822418:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.823029:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.823087:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174888448 00000100:00100000:1.0:1746144886.823096:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174888448 00010000:00010000:1.0:1746144886.823131:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514138 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b9c expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144886.823153:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10384 00000100:00100000:1.0:1746144886.823160:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174888448:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144886.823174:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144886.823196:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514138 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b9c expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.823207:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514138 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b9c expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.823231:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514138 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93b9c expref: 6 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.823984:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.823988:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.823997:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751413f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ba3 expref: 98 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.824016:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751413f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ba3 expref: 98 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.824054:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751413f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ba3 expref: 98 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144886.824067:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172308096:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144886.824891:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144886.829456:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172308096:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144886.829483:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144886.829542:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965174888448:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6379us (6511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.829553:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10384 00000100:00100000:0.0:1746144886.830875:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.835718:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.836355:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174888832 00000100:00100000:1.0:1746144886.836365:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174888832 00010000:00010000:1.0:1746144886.836397:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751413f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ba3 expref: 99 pid: 8432 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144886.836432:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10385 00000100:00100000:1.0:1746144886.836440:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+99:1985:x1830965174888832:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144886.836453:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144886.836471:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751413f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ba3 expref: 99 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.836482:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751413f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ba3 expref: 99 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.836500:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751413f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ba3 expref: 99 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.837134:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.837136:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.837142:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514146 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93baa expref: 98 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.837150:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514146 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93baa expref: 98 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.837178:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514146 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93baa expref: 98 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144886.837188:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172308352:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144886.837260:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144886.840156:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172308352:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144886.840175:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144886.840217:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+98:1985:x1830965174888832:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3777us (4505us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.840226:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10385 00000100:00100000:0.0:1746144886.840840:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.841632:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174889088 00000100:00100000:1.0:1746144886.841640:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174889088 00002000:00100000:1.0:1746144886.841674:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612ce00 x1830965174889088/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.841683:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ce00 with x1830965174889088 ext(0->4095) 00002000:00010000:1.0:1746144886.841687:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612ce00 00000100:00100000:1.0:1746144886.841713:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3772 00000100:00100000:1.0:1746144886.841720:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+98:1985:x1830965174889088:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144886.841884:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+98:1985:x1830965174889088:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 164us (1044us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.841891:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3772 00002000:00100000:1.0:1746144886.841896:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612ce00 x1830965174889088/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.841902:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ce00 with x1830965174889088 ext(0->4095) 00002000:00010000:1.0:1746144886.841904:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612ce00 00000100:00100000:0.0:1746144886.844725:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.848388:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.848488:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174889344 00000100:00100000:1.0:1746144886.848494:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174889344 00010000:00010000:1.0:1746144886.848517:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514146 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93baa expref: 98 pid: 8432 timeout: 580 lvb_type: 0 00000100:00100000:1.0:1746144886.848540:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10386 00000100:00100000:1.0:1746144886.848546:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+98:1985:x1830965174889344:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144886.848557:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144886.848574:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514146 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93baa expref: 98 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.848587:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514146 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93baa expref: 98 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.848604:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514146 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93baa expref: 98 pid: 8432 timeout: 580 lvb_type: 0 00010000:00010000:1.0:1746144886.848746:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.848747:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.848754:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af672751414d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bb1 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.848760:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af672751414d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bb1 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.849055:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af672751414d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bb1 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144886.849066:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172308608:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144886.849131:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144886.850875:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172308608:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144886.850891:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144886.850920:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+97:1985:x1830965174889344:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2373us (2533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.850928:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10386 00000100:00100000:0.0:1746144886.852075:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.852173:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.856911:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.857066:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.857932:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174889984 00000100:00100000:1.0:1746144886.857936:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174889984 00010000:00010000:1.0:1746144886.857953:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af672751414d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bb1 expref: 6 pid: 8432 timeout: 581 lvb_type: 0 00000100:00100000:1.0:1746144886.857969:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10387 00000100:00100000:1.0:1746144886.857974:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965174889984:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144886.857982:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144886.857999:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af672751414d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bb1 expref: 6 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.858017:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af672751414d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bb1 expref: 6 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.858034:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af672751414d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bb1 expref: 6 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.858054:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.858056:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.858060:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514154 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bb8 expref: 98 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.858067:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514154 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bb8 expref: 98 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.858090:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514154 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bb8 expref: 98 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.858100:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514154 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bb8 expref: 98 pid: 8432 timeout: 581 lvb_type: 0 00000100:00100000:1.0:1746144886.858110:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172308992:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144886.858164:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144886.861236:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.861979:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172308992:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144886.861994:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144886.862032:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965174889984:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4056us (4964us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.862038:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10387 00000100:00100000:0.0:1746144886.864529:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.864864:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174890368 00000100:00100000:1.0:1746144886.864871:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174890368 00010000:00010000:1.0:1746144886.864898:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514154 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bb8 expref: 99 pid: 8432 timeout: 581 lvb_type: 0 00000100:00100000:1.0:1746144886.864916:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10388 00000100:00100000:1.0:1746144886.864922:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+99:1983:x1830965174890368:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144886.864932:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144886.864946:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514154 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bb8 expref: 99 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.864959:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514154 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bb8 expref: 99 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.864975:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514154 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bb8 expref: 99 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.865138:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.865140:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.865145:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751415b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bbf expref: 98 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.865152:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751415b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bbf expref: 98 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.865175:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751415b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bbf expref: 98 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144886.865184:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172309120:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144886.865481:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144886.869000:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.869270:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172309120:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144886.869287:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144886.869322:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+99:1983:x1830965174890368:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4401us (4802us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.869330:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10388 00000100:00100000:0.0:1746144886.872063:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.876974:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.877231:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174890880 00000100:00100000:1.0:1746144886.877238:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174890880 00010000:00010000:1.0:1746144886.877264:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751415b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bbf expref: 98 pid: 20722 timeout: 581 lvb_type: 0 00000100:00100000:1.0:1746144886.877293:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10389 00000100:00100000:1.0:1746144886.877299:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+98:1985:x1830965174890880:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144886.877310:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144886.877327:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751415b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bbf expref: 98 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.877337:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751415b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bbf expref: 98 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.877356:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751415b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bbf expref: 98 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.877381:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.877382:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.877388:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514162 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bc6 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.877394:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514162 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bc6 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.877421:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514162 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bc6 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144886.877431:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172309376:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144886.877499:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144886.880414:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.880811:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.881731:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172309376:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144886.881745:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144886.881760:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+99:1985:x1830965174890880:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4462us (4791us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144886.881783:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10389 00000100:00100000:0.0:1746144886.884430:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.888431:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.888503:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174891520 00000100:00100000:1.0:1746144886.888511:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174891520 00010000:00010000:1.0:1746144886.888537:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514162 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bc6 expref: 6 pid: 8432 timeout: 581 lvb_type: 0 00000100:00100000:1.0:1746144886.888557:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10390 00000100:00100000:1.0:1746144886.888563:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174891520:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144886.888575:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144886.888591:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514162 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bc6 expref: 6 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.888601:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514162 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bc6 expref: 6 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.888618:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514162 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bc6 expref: 6 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.888804:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.888806:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144886.888812:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514169 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bcd expref: 98 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.888822:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514169 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bcd expref: 98 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.888849:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514169 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bcd expref: 98 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144886.888859:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514169 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bcd expref: 98 pid: 8432 timeout: 581 lvb_type: 0 00000100:00100000:1.0:1746144886.888869:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172309760:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144886.889363:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144886.892923:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.896962:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.899868:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.902445:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.906960:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.910181:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.910371:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174892672 00000100:00100000:1.0:1746144886.910376:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174892672 00002000:00100000:1.0:1746144886.910410:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b463480 x1830965174892672/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.910418:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463480 with x1830965174892672 ext(0->4095) 00002000:00010000:1.0:1746144886.910422:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b463480 00000100:00100000:1.0:1746144886.910451:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3776 00000100:00100000:1.0:1746144886.910457:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174892672:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144886.910850:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.911183:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174892672:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 725us (1008us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.911189:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3776 00002000:00100000:1.0:1746144886.911194:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b463480 x1830965174892672/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.911201:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463480 with x1830965174892672 ext(0->4095) 00010000:00010000:1.0:1746144886.911205:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514177 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bdb expref: 6 pid: 8430 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.911214:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514177 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bdb expref: 6 pid: 8430 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144886.911219:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b463480 00000100:00100000:0.0:1746144886.917245:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.924966:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.925083:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174893312 00000100:00100000:1.0:1746144886.925089:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174893312 00002000:00100000:1.0:1746144886.925120:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b461500 x1830965174893312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.925129:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b461500 with x1830965174893312 ext(0->4095) 00010000:00010000:1.0:1746144886.925136:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af672751417e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93be2 expref: 99 pid: 8430 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.925147:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af672751417e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93be2 expref: 99 pid: 8430 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144886.925153:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b461500 00000100:00100000:1.0:1746144886.925179:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1738 00000100:00100000:1.0:1746144886.925185:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+99:1984:x1830965174893312:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144886.925307:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+99:1984:x1830965174893312:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 122us (343us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.925312:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1738 00002000:00100000:1.0:1746144886.925318:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b461500 x1830965174893312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.925324:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b461500 with x1830965174893312 ext(0->4095) 00010000:00010000:1.0:1746144886.925328:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af672751417e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93be2 expref: 99 pid: 8430 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.925337:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af672751417e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93be2 expref: 99 pid: 8430 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144886.925342:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b461500 00000100:00100000:0.0:1746144886.932086:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.937216:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.942985:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.947486:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.948159:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.952423:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.952742:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174894336 00000100:00100000:1.0:1746144886.952748:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174894336 00002000:00100000:1.0:1746144886.952798:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b462680 x1830965174894336/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.952808:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b462680 with x1830965174894336 ext(0->4095) 00010000:00010000:1.0:1746144886.952815:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5da00/0x4076af672751418c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bf0 expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.952826:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5da00/0x4076af672751418c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bf0 expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144886.952832:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b462680 00000100:00100000:1.0:1746144886.952854:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1739 00000100:00100000:1.0:1746144886.952860:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174894336:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144886.952986:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174894336:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 126us (564us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.952995:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1739 00002000:00100000:1.0:1746144886.952999:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b462680 x1830965174894336/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.953016:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b462680 with x1830965174894336 ext(0->4095) 00010000:00010000:1.0:1746144886.953020:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5da00/0x4076af672751418c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bf0 expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.953033:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5da00/0x4076af672751418c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bf0 expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144886.953039:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b462680 00000100:00100000:0.0:1746144886.955373:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.958813:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.960143:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174894720 00000100:00100000:1.0:1746144886.960156:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174894720 00002000:00100000:1.0:1746144886.960195:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d366680 x1830965174894720/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.960205:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d366680 with x1830965174894720 ext(0->4095) 00002000:00010000:1.0:1746144886.960209:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d366680 00000100:00100000:1.0:1746144886.960242:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3778 00000100:00100000:1.0:1746144886.960249:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d366680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+98:1985:x1830965174894720:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144886.960397:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d366680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+98:1985:x1830965174894720:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 149us (1585us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.960404:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3778 00002000:00100000:1.0:1746144886.960409:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d366680 x1830965174894720/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.960422:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d366680 with x1830965174894720 ext(0->4095) 00002000:00010000:1.0:1746144886.960424:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d366680 00000100:00100000:0.0:1746144886.962242:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.966199:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.966262:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174894976 00000100:00100000:1.0:1746144886.966270:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174894976 00002000:00100000:1.0:1746144886.966305:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88012d364e00 x1830965174894976/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 496/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.966314:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d364e00 with x1830965174894976 ext(0->7) 00010000:00010000:1.0:1746144886.966321:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af6727514193 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bf7 expref: 98 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.966332:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af6727514193 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bf7 expref: 98 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144886.966338:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d364e00 00000100:00100000:1.0:1746144886.967238:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1740 00000100:00100000:1.0:1746144886.967246:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+98:1983:x1830965174894976:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144886.967588:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+100:1983:x1830965174894976:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 342us (1395us total) trans 4294967956 rc 0/0 00000100:00100000:1.0:1746144886.967595:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1740 00002000:00100000:1.0:1746144886.967601:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88012d364e00 x1830965174894976/t4294967956(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 496/448 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.967608:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d364e00 with x1830965174894976 ext(0->7) 00010000:00010000:1.0:1746144886.967614:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af6727514193 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bf7 expref: 100 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.967628:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5cc00/0x4076af6727514193 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bf7 expref: 100 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144886.967633:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d364e00 00000100:00100000:0.0:1746144886.971218:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.975950:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.975995:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174895360 00000100:00100000:1.0:1746144886.976014:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174895360 00000100:00100000:0.0:1746144886.976041:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00002000:00100000:1.0:1746144886.976733:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d367b80 x1830965174895360/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.976742:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d367b80 with x1830965174895360 ext(0->4095) 00010000:00010000:1.0:1746144886.976748:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af672751419a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bfe expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.976758:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af672751419a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bfe expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144886.976797:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d367b80 00000100:00100000:1.0:1746144886.976813:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1741 00000100:00100000:1.0:1746144886.976819:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d367b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174895360:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144886.977010:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d367b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174895360:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 183us (1059us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.977016:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1741 00002000:00100000:1.0:1746144886.977021:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d367b80 x1830965174895360/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.977027:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d367b80 with x1830965174895360 ext(0->4095) 00010000:00010000:1.0:1746144886.977032:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af672751419a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bfe expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.977040:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af672751419a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93bfe expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144886.977045:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d367b80 00000100:00100000:0.0:1746144886.979635:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.980125:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.982758:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.982913:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174896000 00000100:00100000:1.0:1746144886.982938:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174896000 00002000:00100000:1.0:1746144886.982964:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d365180 x1830965174896000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.982973:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d365180 with x1830965174896000 ext(0->4095) 00010000:00010000:1.0:1746144886.982979:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af67275141a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c05 expref: 101 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.982990:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af67275141a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c05 expref: 101 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144886.982996:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d365180 00000100:00100000:1.0:1746144886.983028:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1742 00000100:00100000:1.0:1746144886.983035:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1985:x1830965174896000:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144886.983348:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1985:x1830965174896000:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 312us (594us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.983354:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1742 00002000:00100000:1.0:1746144886.983359:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d365180 x1830965174896000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.983373:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d365180 with x1830965174896000 ext(0->4095) 00010000:00010000:1.0:1746144886.983377:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af67275141a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c05 expref: 101 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144886.983386:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af67275141a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c05 expref: 101 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144886.983391:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d365180 00000100:00100000:0.0:1746144886.984888:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.987446:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.987498:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174896384 00000100:00100000:1.0:1746144886.987503:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174896384 00002000:00100000:1.0:1746144886.987531:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d364700 x1830965174896384/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.987540:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d364700 with x1830965174896384 ext(0->4095) 00002000:00010000:1.0:1746144886.987543:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d364700 00000100:00100000:0.0:1746144886.989195:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.992787:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144886.995623:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144886.995727:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174896896 00000100:00100000:1.0:1746144886.995733:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174896896 00002000:00100000:1.0:1746144886.995785:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d367480 x1830965174896896/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/0 e 0 to 0 dl 1746144897 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.995794:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d367480 with x1830965174896896 ext(0->4095) 00002000:00010000:1.0:1746144886.995798:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d367480 00000100:00100000:1.0:1746144886.995817:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3780 00000100:00100000:1.0:1746144886.995823:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174896896:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144886.996575:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174896896:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 751us (951us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144886.996583:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3780 00002000:00100000:1.0:1746144886.996588:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d367480 x1830965174896896/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:527/0 lens 488/4536 e 0 to 0 dl 1746144897 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144886.996594:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d367480 with x1830965174896896 ext(0->4095) 00002000:00010000:1.0:1746144886.996597:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d367480 00000100:00100000:0.0:1746144886.999278:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.001252:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:0.0:1746144887.001780:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144887.002378:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:1.0:1746144887.002566:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144887.006072:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.009719:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.015065:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.015092:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174897920 00000100:00100000:0.0:1746144887.015099:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174897920 00002000:00100000:0.0:1746144887.015143:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181ce00 x1830965174897920/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144887.015152:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181ce00 with x1830965174897920 ext(0->4095) 00002000:00010000:0.0:1746144887.015157:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009181ce00 00000100:00100000:0.0:1746144887.015174:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3781 00000100:00100000:0.0:1746144887.015180:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+100:1985:x1830965174897920:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144887.015373:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+100:1985:x1830965174897920:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 192us (313us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144887.015380:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3781 00002000:00100000:0.0:1746144887.015386:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181ce00 x1830965174897920/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144887.015392:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181ce00 with x1830965174897920 ext(0->4095) 00002000:00010000:0.0:1746144887.015394:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009181ce00 00000100:00100000:0.0:1746144887.016854:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.020632:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.025461:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.025539:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.025608:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174898560 00000100:00100000:1.0:1746144887.025617:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174898560 00002000:00100000:1.0:1746144887.025656:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181dc00 x1830965174898560/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.025663:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181dc00 with x1830965174898560 ext(0->4095) 00010000:00010000:1.0:1746144887.025671:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af67275141c4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c28 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.025682:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af67275141c4 lrc: 7/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c28 expref: 6 pid: 8430 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.025687:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181dc00 00000100:00100000:1.0:1746144887.025704:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1744 00000100:00100000:1.0:1746144887.025709:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174898560:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144887.025908:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174898560:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 198us (368us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.025915:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1744 00002000:00100000:1.0:1746144887.025925:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181dc00 x1830965174898560/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.025932:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181dc00 with x1830965174898560 ext(0->4095) 00010000:00010000:1.0:1746144887.025936:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af67275141c4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c28 expref: 6 pid: 8430 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.025945:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af67275141c4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c28 expref: 6 pid: 8430 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.025954:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181dc00 00000100:00100000:0.0:1746144887.029881:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.029964:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.034597:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.034737:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174899072 00000100:00100000:1.0:1746144887.034744:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174899072 00002000:00100000:1.0:1746144887.034797:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181d880 x1830965174899072/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.034807:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181d880 with x1830965174899072 ext(0->4095) 00010000:00010000:1.0:1746144887.034815:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275141cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c2f expref: 101 pid: 8430 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.034828:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275141cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c2f expref: 101 pid: 8430 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.034835:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181d880 00000100:00100000:1.0:1746144887.034862:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1745 00000100:00100000:1.0:1746144887.034869:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1985:x1830965174899072:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144887.035028:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1985:x1830965174899072:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 158us (438us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.035034:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1745 00002000:00100000:1.0:1746144887.035040:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181d880 x1830965174899072/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.035047:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181d880 with x1830965174899072 ext(0->4095) 00010000:00010000:1.0:1746144887.035052:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275141cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c2f expref: 101 pid: 8430 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.035061:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275141cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c2f expref: 101 pid: 8430 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.035067:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181d880 00000100:00100000:0.0:1746144887.038013:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.040720:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.043302:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.045314:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.049100:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.049152:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174899968 00000100:00100000:1.0:1746144887.049158:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174899968 00002000:00100000:1.0:1746144887.049188:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925ab480 x1830965174899968/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.049196:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab480 with x1830965174899968 ext(0->4095) 00002000:00010000:1.0:1746144887.049200:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925ab480 00000100:00100000:1.0:1746144887.049226:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3783 00000100:00100000:1.0:1746144887.049232:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174899968:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144887.049363:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174899968:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 131us (265us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.049367:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3783 00002000:00100000:1.0:1746144887.049370:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925ab480 x1830965174899968/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.049375:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab480 with x1830965174899968 ext(0->4095) 00002000:00010000:1.0:1746144887.049377:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925ab480 00000100:00100000:0.0:1746144887.052392:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.052461:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.052553:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174900096 00000100:00100000:1.0:1746144887.052559:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174900096 00000100:00100000:1.0:1746144887.052596:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174900224 00000100:00100000:1.0:1746144887.052598:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174900224 00000100:00100000:1.0:1746144887.052611:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4991 00000100:00100000:1.0:1746144887.052617:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+100:31579:x1830965174900096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.052631:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.052645:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275141e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93c44 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.052713:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144887.052716:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af67275141e7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c4b expref: 102 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.052720:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.052723:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275141e0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c44 expref: 102 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.052779:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af67275141e7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c4b expref: 102 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.052791:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275141e0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c44 expref: 102 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.052799:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:1.0:1746144887.052832:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+102:31579:x1830965174900096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 214us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.052838:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4991 00000100:00100000:1.0:1746144887.052880:0:3307:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746144887.052890:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172314112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746144887.052920:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144887.052944:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172314112 00000100:00100000:1.0:1746144887.052947:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172314112 00000100:00100000:1.0:1746144887.052980:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1746144887.052984:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172314112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1746144887.052995:0:8434:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 292880384 pending 80084992 free 3855613952 avail 3853516800 00000100:00100000:1.0:1746144887.053033:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172314112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.053038:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1746144887.053064:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b033100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172314112:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1746144887.053076:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144887.057235:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.059672:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.059727:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174900608 00000100:00100000:1.0:1746144887.059732:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174900608 00002000:00100000:1.0:1746144887.059787:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b033b80 x1830965174900608/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.059796:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033b80 with x1830965174900608 ext(0->4095) 00010000:00010000:1.0:1746144887.059803:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af67275141e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c4b expref: 101 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.059814:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af67275141e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c4b expref: 101 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.059820:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b033b80 00000100:00100000:1.0:1746144887.059841:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1746 00000100:00100000:1.0:1746144887.059847:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1984:x1830965174900608:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144887.059976:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1984:x1830965174900608:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 128us (305us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.059982:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1746 00002000:00100000:1.0:1746144887.059987:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b033b80 x1830965174900608/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.059994:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033b80 with x1830965174900608 ext(0->4095) 00010000:00010000:1.0:1746144887.059998:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af67275141e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c4b expref: 101 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.060018:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af67275141e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c4b expref: 101 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.060024:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b033b80 00000100:00100000:0.0:1746144887.062701:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.065876:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.065949:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174900992 00000100:00100000:1.0:1746144887.065956:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174900992 00002000:00100000:1.0:1746144887.065989:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b031f80 x1830965174900992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.065998:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031f80 with x1830965174900992 ext(0->4095) 00002000:00010000:1.0:1746144887.066013:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b031f80 00000100:00100000:1.0:1746144887.066038:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3784 00000100:00100000:1.0:1746144887.066044:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1984:x1830965174900992:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144887.066901:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1984:x1830965174900992:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 854us (1028us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.066907:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3784 00002000:00100000:1.0:1746144887.066913:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b031f80 x1830965174900992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.066920:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031f80 with x1830965174900992 ext(0->4095) 00002000:00010000:1.0:1746144887.066923:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b031f80 00000100:00100000:0.0:1746144887.069891:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.072430:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.074798:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.074822:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174901504 00000100:00100000:1.0:1746144887.074827:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174901504 00002000:00100000:1.0:1746144887.074853:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013619aa00 x1830965174901504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.074862:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013619aa00 with x1830965174901504 ext(0->4095) 00002000:00010000:1.0:1746144887.074866:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013619aa00 00000100:00100000:1.0:1746144887.074889:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3785 00000100:00100000:1.0:1746144887.074896:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013619aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174901504:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144887.075676:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013619aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174901504:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 778us (876us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.075682:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3785 00002000:00100000:1.0:1746144887.075687:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013619aa00 x1830965174901504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.075694:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013619aa00 with x1830965174901504 ext(0->4095) 00002000:00010000:1.0:1746144887.075697:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013619aa00 00000100:00100000:0.0:1746144887.079473:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.081899:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.084233:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.087473:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.087678:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174902144 00000100:00100000:1.0:1746144887.087684:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174902144 00002000:00100000:1.0:1746144887.087715:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea9c00 x1830965174902144/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.087723:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea9c00 with x1830965174902144 ext(0->4095) 00010000:00010000:1.0:1746144887.087730:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af67275141f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c59 expref: 101 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.087741:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af67275141f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c59 expref: 101 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.087746:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea9c00 00000100:00100000:1.0:1746144887.087785:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1747 00000100:00100000:1.0:1746144887.087791:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1984:x1830965174902144:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144887.087923:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1984:x1830965174902144:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 131us (450us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.087928:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1747 00002000:00100000:1.0:1746144887.087933:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea9c00 x1830965174902144/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.087939:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea9c00 with x1830965174902144 ext(0->4095) 00010000:00010000:1.0:1746144887.087943:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af67275141f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c59 expref: 101 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.087951:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af67275141f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c59 expref: 101 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.087956:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea9c00 00000100:00100000:0.0:1746144887.089869:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.093091:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.096259:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.101254:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.103384:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.104479:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.104786:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174903168 00000100:00100000:1.0:1746144887.104790:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174903168 00002000:00100000:1.0:1746144887.104810:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b0a80 x1830965174903168/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.104824:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b0a80 with x1830965174903168 ext(0->4095) 00010000:00010000:1.0:1746144887.104833:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727514203 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c67 expref: 6 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.104842:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727514203 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c67 expref: 6 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.104847:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012a2b0a80 00000100:00100000:1.0:1746144887.104864:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1748 00000100:00100000:1.0:1746144887.104869:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174903168:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144887.104982:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174903168:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 113us (503us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.104988:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1748 00002000:00100000:1.0:1746144887.104992:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b0a80 x1830965174903168/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.105007:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b0a80 with x1830965174903168 ext(0->4095) 00010000:00010000:1.0:1746144887.105011:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727514203 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c67 expref: 6 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.105019:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727514203 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c67 expref: 6 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.105025:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012a2b0a80 00000100:00100000:0.0:1746144887.107647:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.107680:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.110729:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.113674:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.116941:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.121604:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.121675:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174904192 00000100:00100000:1.0:1746144887.121682:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174904192 00000100:00100000:1.0:1746144887.121716:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4999 00000100:00100000:1.0:1746144887.121723:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174904192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.121738:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.121752:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514218 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93c7c expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.121794:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727514211 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c75 expref: 99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.121800:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.121802:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.121805:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514218 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c7c expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.121831:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727514211 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c75 expref: 99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.121840:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727514211 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c75 expref: 99 pid: 10401 timeout: 581 lvb_type: 0 00000100:00100000:1.0:1746144887.121851:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172316032:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144887.122590:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144887.124400:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172316032:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144887.124424:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514218 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c7c expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.124441:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:1.0:1746144887.124486:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174904192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2763us (2888us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.124493:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4999 00000100:00100000:0.0:1746144887.125372:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.129026:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.129536:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.129833:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174904448 00000100:00100000:1.0:1746144887.129838:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174904448 00000100:00100000:1.0:1746144887.129874:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5000 00000100:00100000:1.0:1746144887.129880:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+100:31565:x1830965174904448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.129893:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.129905:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751421f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93c83 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.129925:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514218 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c7c expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.129931:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144887.129932:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144887.129936:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751421f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c83 expref: 101 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.129955:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514218 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c7c expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.129964:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727514218 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c7c expref: 5 pid: 8432 timeout: 581 lvb_type: 0 00000100:00100000:1.0:1746144887.129977:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172316288:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144887.130672:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144887.133253:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172316288:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144887.133276:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751421f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c83 expref: 100 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.133290:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:1.0:1746144887.133332:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+100:31565:x1830965174904448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3451us (4310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.133338:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5000 00000100:00100000:1.0:1746144887.134581:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174904832 00000100:00100000:1.0:1746144887.134587:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174904832 00000100:00100000:1.0:1746144887.134617:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5001 00000100:00100000:1.0:1746144887.134622:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+100:31579:x1830965174904832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.134635:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.134645:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727514226 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93c8a expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.134661:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144887.134665:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751421f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c83 expref: 101 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.134670:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.134672:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727514226 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c8a expref: 101 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.134698:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751421f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c83 expref: 101 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.134707:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727514226 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c8a expref: 101 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.134714:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753c00, rc 0) 00000100:00100000:1.0:1746144887.134742:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+101:31579:x1830965174904832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 120us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.134746:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5001 00000100:00100000:0.0:1746144887.135404:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.139142:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.143462:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.146460:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.148857:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.152490:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.156460:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174906112 00000100:00100000:0.0:1746144887.156466:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174906112 00002000:00100000:0.0:1746144887.156496:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5c700 x1830965174906112/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144887.156505:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5c700 with x1830965174906112 ext(0->4095) 00002000:00010000:0.0:1746144887.156508:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5c700 00000100:00100000:0.0:1746144887.156535:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3789 00000100:00100000:0.0:1746144887.156541:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174906112:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144887.156689:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174906112:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 147us (329us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144887.156698:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3789 00002000:00100000:0.0:1746144887.156703:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5c700 x1830965174906112/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144887.156710:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5c700 with x1830965174906112 ext(0->4095) 00002000:00010000:0.0:1746144887.156713:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5c700 00000100:00100000:0.0:1746144887.157288:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.158996:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.159059:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174906368 00000100:00100000:1.0:1746144887.159063:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174906368 00000100:00100000:1.0:1746144887.159090:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5004 00000100:00100000:1.0:1746144887.159095:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+101:31579:x1830965174906368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.159104:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.159113:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751423b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93c9f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.159130:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144887.159134:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727514234 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c98 expref: 102 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.159139:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.159142:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751423b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c9f expref: 102 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.159165:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727514234 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c98 expref: 102 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.159175:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751423b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c9f expref: 102 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.159183:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:1.0:1746144887.159205:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+102:31579:x1830965174906368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 110us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.159210:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5004 00000100:00100000:0.0:1746144887.162382:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.166878:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.168099:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174906752 00000100:00100000:1.0:1746144887.168105:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174906752 00002000:00100000:1.0:1746144887.168143:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398dc00 x1830965174906752/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.168152:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398dc00 with x1830965174906752 ext(0->4095) 00010000:00010000:1.0:1746144887.168158:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727514234 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c98 expref: 101 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.168169:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727514234 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c98 expref: 101 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.168175:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398dc00 00000100:00100000:1.0:1746144887.168194:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1752 00000100:00100000:1.0:1746144887.168200:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1984:x1830965174906752:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144887.168317:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+101:1984:x1830965174906752:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 117us (1445us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.168322:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1752 00002000:00100000:1.0:1746144887.168326:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398dc00 x1830965174906752/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.168333:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398dc00 with x1830965174906752 ext(0->4095) 00010000:00010000:1.0:1746144887.168337:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727514234 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c98 expref: 101 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.168344:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727514234 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93c98 expref: 101 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.168349:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398dc00 00000100:00100000:0.0:1746144887.170932:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.175871:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.179703:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.185024:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.186383:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.188881:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.189412:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174907776 00000100:00100000:1.0:1746144887.189418:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174907776 00002000:00100000:1.0:1746144887.189444:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac86300 x1830965174907776/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.189452:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac86300 with x1830965174907776 ext(0->4095) 00010000:00010000:1.0:1746144887.189458:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727514242 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ca6 expref: 6 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.189468:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727514242 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ca6 expref: 6 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.189474:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac86300 00000100:00100000:1.0:1746144887.189684:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1753 00000100:00100000:1.0:1746144887.189692:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174907776:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144887.189860:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174907776:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 168us (979us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.189866:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1753 00002000:00100000:1.0:1746144887.189871:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac86300 x1830965174907776/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.189877:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac86300 with x1830965174907776 ext(0->4095) 00010000:00010000:1.0:1746144887.189882:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727514242 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ca6 expref: 6 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.189891:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727514242 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ca6 expref: 6 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.189897:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac86300 00000100:00100000:0.0:1746144887.192156:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.196708:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.208987:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.215471:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.215835:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174908416 00000100:00100000:1.0:1746144887.215845:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174908416 00002000:00100000:1.0:1746144887.215891:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009bae1c00 x1830965174908416/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 496/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.215901:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae1c00 with x1830965174908416 ext(0->7) 00010000:00010000:1.0:1746144887.215911:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727514249 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93cad expref: 100 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.215924:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727514249 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93cad expref: 100 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.215931:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bae1c00 00000100:00100000:1.0:1746144887.215959:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1754 00000100:00100000:1.0:1746144887.215966:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+100:1985:x1830965174908416:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746144887.216292:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.217355:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+103:1985:x1830965174908416:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 1388us (1894us total) trans 4294967957 rc 0/0 00000100:00100000:1.0:1746144887.217364:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1754 00002000:00100000:1.0:1746144887.217371:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009bae1c00 x1830965174908416/t4294967957(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 496/448 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.217380:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae1c00 with x1830965174908416 ext(0->7) 00010000:00010000:1.0:1746144887.217385:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727514249 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93cad expref: 103 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.217396:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af6727514249 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93cad expref: 103 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.217402:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bae1c00 00000100:00100000:0.0:1746144887.218900:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.222470:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.223329:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174908928 00000100:00100000:0.0:1746144887.223337:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174908928 00002000:00100000:0.0:1746144887.223378:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4b800 x1830965174908928/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144887.223392:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b800 with x1830965174908928 ext(0->4095) 00010000:00010000:0.0:1746144887.223400:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727514250 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93cb4 expref: 6 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:0.0:1746144887.223412:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727514250 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93cb4 expref: 6 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:0.0:1746144887.223418:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb4b800 00000100:00100000:0.0:1746144887.223637:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1755 00000100:00100000:0.0:1746144887.223645:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174908928:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144887.224072:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174908928:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 426us (1602us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144887.224079:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1755 00002000:00100000:0.0:1746144887.224085:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4b800 x1830965174908928/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144887.224092:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b800 with x1830965174908928 ext(0->4095) 00010000:00010000:0.0:1746144887.224097:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727514250 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93cb4 expref: 6 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:0.0:1746144887.224106:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af6727514250 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93cb4 expref: 6 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:0.0:1746144887.224111:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb4b800 00000100:00100000:0.0:1746144887.227164:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.231237:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.232831:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174909312 00000100:00100000:1.0:1746144887.232842:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174909312 00002000:00100000:1.0:1746144887.232887:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4aa00 x1830965174909312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.232896:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4aa00 with x1830965174909312 ext(0->4095) 00002000:00010000:1.0:1746144887.232901:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4aa00 00000100:00100000:1.0:1746144887.232937:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3792 00000100:00100000:1.0:1746144887.232944:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+102:1985:x1830965174909312:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144887.233135:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+102:1985:x1830965174909312:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 191us (1909us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.233145:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3792 00002000:00100000:1.0:1746144887.233151:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4aa00 x1830965174909312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.233158:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4aa00 with x1830965174909312 ext(0->4095) 00002000:00010000:1.0:1746144887.233160:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4aa00 00000100:00100000:0.0:1746144887.237756:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.242568:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.245117:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.251607:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.261012:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.265383:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.265414:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174910336 00000100:00100000:0.0:1746144887.265420:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174910336 00002000:00100000:0.0:1746144887.265463:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc4e00 x1830965174910336/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144887.265473:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4e00 with x1830965174910336 ext(0->4095) 00002000:00010000:0.0:1746144887.265478:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc4e00 00000100:00100000:0.0:1746144887.265504:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3793 00000100:00100000:0.0:1746144887.265512:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+102:1983:x1830965174910336:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:0.0:1746144887.265684:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+102:1983:x1830965174910336:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 172us (302us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144887.265690:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3793 00002000:00100000:0.0:1746144887.265695:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc4e00 x1830965174910336/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144887.265703:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4e00 with x1830965174910336 ext(0->4095) 00002000:00010000:0.0:1746144887.265705:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc4e00 00000100:00100000:0.0:1746144887.273024:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.281666:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.289961:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.290518:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.294818:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.295094:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174911104 00000100:00100000:1.0:1746144887.295101:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174911104 00002000:00100000:1.0:1746144887.295144:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d366d80 x1830965174911104/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.295154:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d366d80 with x1830965174911104 ext(0->4095) 00010000:00010000:1.0:1746144887.295163:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5da00/0x4076af672751426c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93cd0 expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.295177:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5da00/0x4076af672751426c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93cd0 expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.295184:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d366d80 00000100:00100000:1.0:1746144887.295215:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1758 00000100:00100000:1.0:1746144887.295222:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174911104:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144887.295403:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174911104:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 181us (586us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.295410:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1758 00002000:00100000:1.0:1746144887.295415:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d366d80 x1830965174911104/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.295423:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d366d80 with x1830965174911104 ext(0->4095) 00010000:00010000:1.0:1746144887.295428:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5da00/0x4076af672751426c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93cd0 expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.295437:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5da00/0x4076af672751426c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93cd0 expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.295449:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d366d80 00000100:00100000:0.0:1746144887.299056:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.305268:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172319488:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144887.305296:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144887.305356:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965174911232:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5325us (6311us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144887.305367:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10428 00000100:00100000:1.0:1746144887.305477:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.308309:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.314282:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.315577:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.318854:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.325863:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.328826:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.332071:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.339257:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.347223:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.347469:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.351117:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.354727:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.358070:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.358569:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174913664 00000100:00100000:1.0:1746144887.358576:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174913664 00002000:00100000:1.0:1746144887.358613:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093255c00 x1830965174913664/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.358622:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093255c00 with x1830965174913664 ext(0->4095) 00002000:00010000:1.0:1746144887.358627:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093255c00 00000100:00100000:1.0:1746144887.358652:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3796 00000100:00100000:1.0:1746144887.358658:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+106:1983:x1830965174913664:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144887.358850:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+106:1983:x1830965174913664:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 192us (790us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.358856:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3796 00002000:00100000:1.0:1746144887.358861:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093255c00 x1830965174913664/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.358875:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093255c00 with x1830965174913664 ext(0->4095) 00002000:00010000:1.0:1746144887.358878:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093255c00 00000100:00100000:0.0:1746144887.367392:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.382961:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.383022:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.385692:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.393490:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.394403:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174914432 00000100:00100000:1.0:1746144887.394413:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174914432 00002000:00100000:1.0:1746144887.394459:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ece00 x1830965174914432/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.394468:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ece00 with x1830965174914432 ext(0->4095) 00010000:00010000:1.0:1746144887.394478:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727514296 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93cfa expref: 6 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.394491:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727514296 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93cfa expref: 6 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.394497:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ece00 00000100:00100000:1.0:1746144887.394523:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1763 00000100:00100000:1.0:1746144887.394530:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174914432:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144887.394738:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174914432:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 206us (1255us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.394744:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1763 00002000:00100000:1.0:1746144887.394750:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ece00 x1830965174914432/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.394757:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ece00 with x1830965174914432 ext(0->4095) 00010000:00010000:1.0:1746144887.394776:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727514296 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93cfa expref: 6 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.394785:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727514296 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93cfa expref: 6 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.394790:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ece00 00000100:00100000:0.0:1746144887.397746:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.403638:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.413433:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.434571:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.434803:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174915200 00000100:00100000:1.0:1746144887.434813:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174915200 00002000:00100000:1.0:1746144887.434859:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800924d9c00 x1830965174915200/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 496/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.434868:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d9c00 with x1830965174915200 ext(0->7) 00010000:00010000:1.0:1746144887.434878:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af672751429d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d01 expref: 108 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.434892:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af672751429d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d01 expref: 108 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.434897:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924d9c00 00000100:00100000:0.0:1746144887.436469:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.437861:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1764 00000100:00100000:1.0:1746144887.437876:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+109:1985:x1830965174915200:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144887.441627:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+112:1985:x1830965174915200:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 3743us (7054us total) trans 4294967961 rc 0/0 00000100:00100000:1.0:1746144887.441641:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1764 00002000:00100000:1.0:1746144887.441654:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800924d9c00 x1830965174915200/t4294967961(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 496/448 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.441664:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d9c00 with x1830965174915200 ext(0->7) 00010000:00010000:1.0:1746144887.441675:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af672751429d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d01 expref: 112 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.441690:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312800/0x4076af672751429d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d01 expref: 112 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.441697:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924d9c00 00000100:00100000:0.0:1746144887.446659:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.453115:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.454021:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174915584 00000100:00100000:1.0:1746144887.454030:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174915584 00002000:00100000:1.0:1746144887.454068:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230ea00 x1830965174915584/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.454077:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230ea00 with x1830965174915584 ext(0->4095) 00010000:00010000:1.0:1746144887.454085:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af67275142a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d08 expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.454098:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af67275142a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d08 expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.454104:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230ea00 00000100:00100000:1.0:1746144887.454194:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1765 00000100:00100000:1.0:1746144887.454201:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174915584:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144887.454894:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174915584:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 691us (1785us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.454899:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1765 00002000:00100000:1.0:1746144887.454904:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230ea00 x1830965174915584/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.454913:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230ea00 with x1830965174915584 ext(0->4095) 00010000:00010000:1.0:1746144887.454920:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af67275142a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d08 expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.454927:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af67275142a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d08 expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.454931:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230ea00 00000100:00100000:0.0:1746144887.458636:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.464303:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174915968 00000100:00100000:1.0:1746144887.464311:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174915968 00002000:00100000:1.0:1746144887.464424:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5c380 x1830965174915968/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.464434:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5c380 with x1830965174915968 ext(0->4095) 00002000:00010000:1.0:1746144887.464438:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5c380 00000100:00100000:1.0:1746144887.464598:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3798 00000100:00100000:1.0:1746144887.464605:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+110:1984:x1830965174915968:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144887.464822:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+110:1984:x1830965174915968:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 216us (654us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.464829:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3798 00002000:00100000:1.0:1746144887.464834:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5c380 x1830965174915968/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.464841:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5c380 with x1830965174915968 ext(0->4095) 00002000:00010000:1.0:1746144887.464844:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5c380 00000100:00100000:0.0:1746144887.477099:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.493399:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.517814:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.518241:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174916608 00000100:00100000:1.0:1746144887.518250:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174916608 00002000:00100000:1.0:1746144887.518296:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230ce00 x1830965174916608/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.518306:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230ce00 with x1830965174916608 ext(0->4095) 00002000:00010000:1.0:1746144887.518312:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230ce00 00000100:00100000:1.0:1746144887.518348:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3799 00000100:00100000:1.0:1746144887.518355:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174916608:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144887.518544:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174916608:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 188us (740us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.518550:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3799 00002000:00100000:1.0:1746144887.518556:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230ce00 x1830965174916608/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.518564:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230ce00 with x1830965174916608 ext(0->4095) 00002000:00010000:1.0:1746144887.518567:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230ce00 00000100:00100000:0.0:1746144887.522072:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.523977:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.524093:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174916864 00000100:00100000:1.0:1746144887.524097:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174916864 00000100:00100000:1.0:1746144887.524117:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5023 00000100:00100000:1.0:1746144887.524122:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+112:31579:x1830965174916864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.524140:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.524157:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275142b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93d24 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.524186:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5da00/0x4076af67275142b2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d16 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.524197:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144887.524199:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144887.524203:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275142b9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d24 expref: 113 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.524231:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5da00/0x4076af67275142b2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d16 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.524242:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5da00/0x4076af67275142b2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d16 expref: 5 pid: 20722 timeout: 581 lvb_type: 0 00000100:00100000:1.0:1746144887.524253:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172321920:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144887.524334:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144887.527603:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:1.0:1746144887.528396:0:8432:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5da00/0x4076af67275142b2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d16 expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00000100:00100000:1.0:1746144887.528412:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e39180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172321920:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144887.528433:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275142b9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d24 expref: 113 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.528440:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275142b9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d24 expref: 113 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.528448:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:1.0:1746144887.528469:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+113:31579:x1830965174916864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4346us (4492us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.528476:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5023 00000100:00100000:0.0:1746144887.531379:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.535844:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174917376 00000100:00100000:1.0:1746144887.535854:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174917376 00000100:00100000:1.0:1746144887.535990:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5024 00000100:00100000:1.0:1746144887.536009:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174917376:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.536029:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.536045:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275142c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93d2b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.536074:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.536080:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af67275142c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d1d expref: 112 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.536085:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144887.536088:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275142c7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d2b expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.536122:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af67275142c0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d1d expref: 112 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.536135:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275142c7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d2b expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.536144:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:1.0:1746144887.537677:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174917376:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1672us (2978us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.537685:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5024 00000100:00100000:0.0:1746144887.538134:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.542501:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.542555:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174917760 00000100:00100000:1.0:1746144887.542563:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174917760 00002000:00100000:1.0:1746144887.542601:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092585880 x1830965174917760/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.542611:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092585880 with x1830965174917760 ext(0->4095) 00010000:00010000:1.0:1746144887.542619:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af67275142c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d1d expref: 112 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.542631:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af67275142c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d1d expref: 112 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.542637:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092585880 00000100:00100000:1.0:1746144887.542668:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1768 00000100:00100000:1.0:1746144887.542675:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+112:1984:x1830965174917760:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144887.543161:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+112:1984:x1830965174917760:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 485us (661us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.543167:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1768 00002000:00100000:1.0:1746144887.543173:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092585880 x1830965174917760/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.543179:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092585880 with x1830965174917760 ext(0->4095) 00010000:00010000:1.0:1746144887.543184:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af67275142c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d1d expref: 112 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.543193:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099313800/0x4076af67275142c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d1d expref: 112 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.543203:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092585880 00000100:00100000:0.0:1746144887.544688:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.544800:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.544869:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174918016 00000100:00100000:1.0:1746144887.544877:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174918016 00000100:00100000:1.0:1746144887.544925:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5025 00000100:00100000:1.0:1746144887.544931:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+112:31565:x1830965174918016:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.544944:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.544959:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275142ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93d32 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.544983:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.544988:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275142c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d2b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.544994:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144887.545006:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275142ce lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d32 expref: 113 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.545040:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275142c7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d2b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.545052:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275142ce lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d32 expref: 113 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.545061:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:1.0:1746144887.545097:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+113:31565:x1830965174918016:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 166us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.545106:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5025 00000100:00100000:0.0:1746144887.547039:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.547195:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174918272 00000100:00100000:1.0:1746144887.547201:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174918272 00002000:00100000:1.0:1746144887.547232:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092584380 x1830965174918272/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.547241:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092584380 with x1830965174918272 ext(0->4095) 00010000:00010000:1.0:1746144887.547248:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275142c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d2b expref: 6 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.547259:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275142c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d2b expref: 6 pid: 8432 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.547265:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092584380 00000100:00100000:1.0:1746144887.547289:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1769 00000100:00100000:1.0:1746144887.547295:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174918272:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144887.547504:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174918272:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 208us (464us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.547511:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1769 00002000:00100000:1.0:1746144887.547516:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092584380 x1830965174918272/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.547523:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092584380 with x1830965174918272 ext(0->4095) 00010000:00010000:1.0:1746144887.547527:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275142c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d2b expref: 6 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.547539:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275142c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d2b expref: 6 pid: 8432 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.547544:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092584380 00000100:00100000:0.0:1746144887.550312:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.553568:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.553798:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174918656 00000100:00100000:1.0:1746144887.553806:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174918656 00002000:00100000:1.0:1746144887.554451:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417d180 x1830965174918656/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.554462:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417d180 with x1830965174918656 ext(0->4095) 00002000:00010000:1.0:1746144887.554467:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417d180 00000100:00100000:1.0:1746144887.554494:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3800 00000100:00100000:1.0:1746144887.554501:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+112:1985:x1830965174918656:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144887.554694:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+112:1985:x1830965174918656:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 193us (1134us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.554700:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3800 00002000:00100000:1.0:1746144887.554706:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417d180 x1830965174918656/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.554713:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417d180 with x1830965174918656 ext(0->4095) 00002000:00010000:1.0:1746144887.554716:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417d180 00000100:00100000:0.0:1746144887.558004:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.560457:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.565032:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.565109:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.565176:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174919168 00000100:00100000:1.0:1746144887.565184:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174919168 00002000:00100000:1.0:1746144887.565228:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa0a80 x1830965174919168/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.565244:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0a80 with x1830965174919168 ext(0->4095) 00002000:00010000:1.0:1746144887.565249:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa0a80 00000100:00100000:1.0:1746144887.566099:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1770 00000100:00100000:1.0:1746144887.566108:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174919168:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144887.566283:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174919168:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 176us (1253us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.566290:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1770 00002000:00100000:1.0:1746144887.566296:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa0a80 x1830965174919168/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.566304:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0a80 with x1830965174919168 ext(0->4095) 00010000:00010000:1.0:1746144887.566309:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275142d5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d39 expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.566319:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275142d5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d39 expref: 6 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.566324:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa0a80 00000100:00100000:0.0:1746144887.568385:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.568479:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.572213:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.574439:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.578818:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.581472:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.584142:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.588727:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.589949:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.591152:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.592825:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.596036:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.600470:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.600919:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10447 00000100:00100000:0.0:1746144887.600928:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+113:1983:x1830965174921472:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144887.600941:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144887.600962:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275142f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d55 expref: 113 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:0.0:1746144887.600974:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275142f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d55 expref: 113 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:0.0:1746144887.601007:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275142f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d55 expref: 113 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:0.0:1746144887.601036:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144887.601038:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144887.601045:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af67275142f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d5c expref: 112 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.601053:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af67275142f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d5c expref: 112 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.601090:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af67275142f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d5c expref: 112 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144887.601106:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172324352:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144887.601439:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144887.603158:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.604954:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.611685:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174922240 00000100:00100000:0.0:1746144887.611692:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174922240 00002000:00100000:0.0:1746144887.611735:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5d880 x1830965174922240/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144887.611744:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5d880 with x1830965174922240 ext(0->4095) 00002000:00010000:0.0:1746144887.611748:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5d880 00000100:00100000:0.0:1746144887.611803:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3805 00000100:00100000:0.0:1746144887.611914:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174922240:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144887.613203:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174922240:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1389us (1925us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144887.613212:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3805 00002000:00100000:0.0:1746144887.613219:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5d880 x1830965174922240/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144887.613227:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5d880 with x1830965174922240 ext(0->4095) 00002000:00010000:0.0:1746144887.613230:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5d880 00000100:00100000:0.0:1746144887.615523:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.619794:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.622284:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.625257:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.625553:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174922880 00000100:00100000:1.0:1746144887.625560:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174922880 00002000:00100000:1.0:1746144887.625594:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258d500 x1830965174922880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.625604:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258d500 with x1830965174922880 ext(0->4095) 00010000:00010000:1.0:1746144887.625612:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af6727514306 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d6a expref: 113 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.625624:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af6727514306 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d6a expref: 113 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.625629:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258d500 00000100:00100000:1.0:1746144887.625646:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1773 00000100:00100000:1.0:1746144887.625652:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+113:1985:x1830965174922880:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144887.625840:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+113:1985:x1830965174922880:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 188us (584us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.625846:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1773 00002000:00100000:1.0:1746144887.625850:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258d500 x1830965174922880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.625856:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258d500 with x1830965174922880 ext(0->4095) 00010000:00010000:1.0:1746144887.625860:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af6727514306 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d6a expref: 113 pid: 20722 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.625868:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5ca00/0x4076af6727514306 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d6a expref: 113 pid: 20722 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.625874:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258d500 00000100:00100000:0.0:1746144887.629633:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.636774:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.640439:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.640585:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174923392 00000100:00100000:1.0:1746144887.640594:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174923392 00000100:00100000:1.0:1746144887.640647:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5035 00000100:00100000:1.0:1746144887.640655:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009969bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174923392:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.640672:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.640690:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514314 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93d78 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.640721:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af672751430d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d71 expref: 111 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.640729:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.640730:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.640734:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514314 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d78 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.640796:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af672751430d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d71 expref: 111 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.640807:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af672751430d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d71 expref: 111 pid: 10401 timeout: 581 lvb_type: 0 00000100:00100000:1.0:1746144887.640817:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172325248:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144887.641835:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144887.643568:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172325248:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144887.643599:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514314 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d78 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.643617:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:1.0:1746144887.643659:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009969bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174923392:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3004us (3227us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.644413:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5035 00000100:00100000:0.0:1746144887.645533:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.649377:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174923648 00000100:00100000:0.0:1746144887.649384:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174923648 00000100:00100000:0.0:1746144887.649433:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5036 00000100:00100000:0.0:1746144887.649440:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+112:31565:x1830965174923648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144887.649459:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144887.649477:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af672751431b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93d7f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.649509:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514314 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d78 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.649517:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144887.649519:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144887.649522:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af672751431b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d7f expref: 113 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.649553:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514314 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d78 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.649565:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514314 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d78 expref: 5 pid: 8432 timeout: 581 lvb_type: 0 00000100:00100000:0.0:1746144887.649575:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801391d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172325504:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144887.649658:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144887.651192:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.651273:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801391d1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172325504:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144887.651290:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af672751431b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d7f expref: 113 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.651303:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091750200, rc 0) 00000100:00100000:0.0:1746144887.651322:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+112:31565:x1830965174923648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1883us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144887.651329:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5036 00000100:00100000:1.0:1746144887.651468:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174923904 00000100:00100000:1.0:1746144887.651473:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174923904 00002000:00100000:1.0:1746144887.651850:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea7100 x1830965174923904/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.651859:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea7100 with x1830965174923904 ext(0->4095) 00010000:00010000:1.0:1746144887.651865:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514314 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d78 expref: 6 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.651876:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514314 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d78 expref: 6 pid: 8432 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.651882:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea7100 00000100:00100000:1.0:1746144887.651895:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1774 00000100:00100000:1.0:1746144887.651901:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174923904:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144887.653735:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174923904:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1824us (2538us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.653746:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1774 00002000:00100000:1.0:1746144887.653755:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea7100 x1830965174923904/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.653797:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea7100 with x1830965174923904 ext(0->4095) 00010000:00010000:1.0:1746144887.653805:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514314 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d78 expref: 6 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.653822:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514314 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d78 expref: 6 pid: 8432 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.653829:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea7100 00000100:00100000:0.0:1746144887.657219:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.662410:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174924288 00000100:00100000:1.0:1746144887.662417:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174924288 00002000:00100000:1.0:1746144887.662460:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092585f80 x1830965174924288/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.662469:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092585f80 with x1830965174924288 ext(0->4095) 00002000:00010000:1.0:1746144887.662474:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092585f80 00000100:00100000:1.0:1746144887.662493:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3807 00000100:00100000:1.0:1746144887.662500:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+112:1984:x1830965174924288:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144887.663619:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+112:1984:x1830965174924288:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 1117us (1373us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.663630:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3807 00002000:00100000:1.0:1746144887.663637:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092585f80 x1830965174924288/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.663644:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092585f80 with x1830965174924288 ext(0->4095) 00002000:00010000:1.0:1746144887.663648:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092585f80 00000100:00100000:0.0:1746144887.670362:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.687826:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.689843:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.689908:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174924672 00000100:00100000:1.0:1746144887.689913:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174924672 00002000:00100000:1.0:1746144887.689951:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880135ea4a80 x1830965174924672/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 496/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.689967:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4a80 with x1830965174924672 ext(0->7) 00010000:00010000:1.0:1746144887.689975:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af672751431b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d7f expref: 113 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.689988:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af672751431b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d7f expref: 113 pid: 8432 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.690003:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea4a80 00000100:00100000:1.0:1746144887.690029:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1775 00000100:00100000:1.0:1746144887.690034:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+113:1984:x1830965174924672:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144887.690353:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+115:1984:x1830965174924672:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 318us (515us total) trans 4294967963 rc 0/0 00000100:00100000:1.0:1746144887.690358:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1775 00002000:00100000:1.0:1746144887.690363:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880135ea4a80 x1830965174924672/t4294967963(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 496/448 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.690370:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4a80 with x1830965174924672 ext(0->7) 00010000:00010000:1.0:1746144887.690374:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af672751431b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d7f expref: 115 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.690382:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af672751431b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d7f expref: 115 pid: 8432 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.690388:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea4a80 00000100:00100000:0.0:1746144887.694412:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.702373:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.704874:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.711699:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.711805:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174925440 00000100:00100000:1.0:1746144887.711815:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174925440 00002000:00100000:1.0:1746144887.711861:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea5180 x1830965174925440/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.711871:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5180 with x1830965174925440 ext(0->4095) 00002000:00010000:1.0:1746144887.711877:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea5180 00000100:00100000:1.0:1746144887.711911:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3808 00000100:00100000:1.0:1746144887.711919:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+114:1984:x1830965174925440:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144887.712117:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+114:1984:x1830965174925440:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 198us (427us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.712124:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3808 00002000:00100000:1.0:1746144887.712141:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea5180 x1830965174925440/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.712148:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5180 with x1830965174925440 ext(0->4095) 00002000:00010000:1.0:1746144887.712151:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea5180 00000100:00100000:0.0:1746144887.728406:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.746318:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.757483:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.761478:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.763624:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.765874:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.768884:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.774386:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.775344:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174926720 00000100:00100000:1.0:1746144887.775355:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174926720 00002000:00100000:1.0:1746144887.775402:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258a680 x1830965174926720/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.775413:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258a680 with x1830965174926720 ext(0->4095) 00010000:00010000:1.0:1746144887.775422:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727514337 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93da2 expref: 117 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.775435:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727514337 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93da2 expref: 117 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.775446:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258a680 00000100:00100000:1.0:1746144887.775846:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1778 00000100:00100000:1.0:1746144887.775854:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+117:1982:x1830965174926720:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144887.776188:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+117:1982:x1830965174926720:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 335us (1813us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.776194:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1778 00002000:00100000:1.0:1746144887.776199:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258a680 x1830965174926720/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.776207:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258a680 with x1830965174926720 ext(0->4095) 00010000:00010000:1.0:1746144887.776212:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727514337 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93da2 expref: 117 pid: 10401 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.776221:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af6727514337 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93da2 expref: 117 pid: 10401 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.776226:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258a680 00000100:00100000:0.0:1746144887.778008:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.778071:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.782878:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.783017:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174927232 00000100:00100000:1.0:1746144887.783024:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174927232 00002000:00100000:1.0:1746144887.783063:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e82d80 x1830965174927232/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.783073:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82d80 with x1830965174927232 ext(0->4095) 00010000:00010000:1.0:1746144887.783082:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751433e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d9b expref: 116 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.783100:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751433e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d9b expref: 116 pid: 8432 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.783106:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e82d80 00000100:00100000:1.0:1746144887.783409:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1779 00000100:00100000:1.0:1746144887.783416:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+116:1985:x1830965174927232:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144887.783592:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+116:1985:x1830965174927232:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 176us (715us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.783598:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1779 00002000:00100000:1.0:1746144887.783603:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e82d80 x1830965174927232/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.783610:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82d80 with x1830965174927232 ext(0->4095) 00010000:00010000:1.0:1746144887.783615:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751433e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d9b expref: 116 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:1.0:1746144887.783623:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751433e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d9b expref: 116 pid: 8432 timeout: 581 lvb_type: 0 00002000:00010000:1.0:1746144887.783628:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e82d80 00000100:00100000:0.0:1746144887.786457:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.787496:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174927488 00000100:00100000:0.0:1746144887.787500:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174927488 00010000:00010000:0.0:1746144887.787515:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751433e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d9b expref: 117 pid: 8432 timeout: 581 lvb_type: 0 00000100:00100000:0.0:1746144887.787730:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10458 00000100:00100000:0.0:1746144887.787736:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+117:1985:x1830965174927488:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144887.787745:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144887.787781:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751433e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d9b expref: 117 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:0.0:1746144887.787790:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751433e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d9b expref: 117 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:0.0:1746144887.787807:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751433e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93d9b expref: 117 pid: 8432 timeout: 581 lvb_type: 0 00010000:00010000:0.0:1746144887.787820:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144887.787821:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144887.787827:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727514345 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93da9 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.787834:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727514345 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93da9 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.787851:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727514345 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93da9 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.787865:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099313e00/0x4076af6727514345 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93da9 expref: 5 pid: 10401 timeout: 581 lvb_type: 0 00000100:00100000:0.0:1746144887.787874:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e80e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172327296:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144887.787931:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144887.792114:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.795492:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.800046:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a417df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172327424:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144887.800080:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144887.800128:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965174927872:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3806us (4642us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144887.800139:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10459 00000100:00100000:1.0:1746144887.800359:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174928128 00000100:00100000:1.0:1746144887.800366:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174928128 00002000:00100000:1.0:1746144887.800406:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa0e00 x1830965174928128/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.800415:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0e00 with x1830965174928128 ext(0->4095) 00002000:00010000:1.0:1746144887.800421:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa0e00 00000100:00100000:1.0:1746144887.800449:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3810 00000100:00100000:1.0:1746144887.800455:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+116:1985:x1830965174928128:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144887.800615:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+116:1985:x1830965174928128:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 160us (1025us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.800620:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3810 00002000:00100000:1.0:1746144887.800624:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa0e00 x1830965174928128/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.800631:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0e00 with x1830965174928128 ext(0->4095) 00002000:00010000:1.0:1746144887.800634:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa0e00 00000100:00100000:0.0:1746144887.803130:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.806708:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.809596:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.809824:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.816960:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.819357:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.823790:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.826760:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.834654:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174929664 00000100:00100000:1.0:1746144887.834663:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174929664 00002000:00100000:1.0:1746144887.834709:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa1180 x1830965174929664/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.834718:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1180 with x1830965174929664 ext(0->4095) 00002000:00010000:1.0:1746144887.834723:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa1180 00000100:00100000:1.0:1746144887.834755:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3811 00000100:00100000:1.0:1746144887.834787:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+116:1985:x1830965174929664:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144887.834986:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+116:1985:x1830965174929664:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 224us (1278us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.835001:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3811 00002000:00100000:1.0:1746144887.835006:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa1180 x1830965174929664/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.835018:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1180 with x1830965174929664 ext(0->4095) 00002000:00010000:1.0:1746144887.835020:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa1180 00000100:00100000:0.0:1746144887.836902:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.836942:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.836967:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.836991:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174929792 00000100:00100000:0.0:1746144887.837008:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174929792 00000100:00100000:0.0:1746144887.837044:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 369 00000100:00100000:0.0:1746144887.837051:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4574b85-29c1-4863-b96a-3fe350afea52+12:1984:x1830965174929792:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144887.837345:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4574b85-29c1-4863-b96a-3fe350afea52+12:1984:x1830965174929792:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 294us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144887.837352:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 369 00000100:00080000:1.0:1746144887.838125:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746144887.838130:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144887.838223:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.838264:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174930432 00000100:00100000:1.0:1746144887.838268:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174930432 00000100:00100000:1.0:1746144887.838287:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5047 00000100:00100000:1.0:1746144887.838292:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174930432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.838303:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.838320:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727514368 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93dcc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.838345:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727514361 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dc5 expref: 115 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.838352:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.838354:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.838357:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727514368 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dcc expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.838384:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727514361 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dc5 expref: 115 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.838395:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af6727514361 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dc5 expref: 115 pid: 10401 timeout: 581 lvb_type: 0 00000100:00100000:1.0:1746144887.838406:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172328320:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144887.838458:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144887.845617:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172328320:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144887.845655:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727514368 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dcc expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.845681:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753c00, rc 0) 00000100:00100000:1.0:1746144887.845740:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174930432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7446us (7516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.845750:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5047 00000100:00100000:0.0:1746144887.846058:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.853811:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.853895:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.853970:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174930688 00000100:00100000:1.0:1746144887.853973:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174930688 00000100:00100000:1.0:1746144887.854018:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5048 00000100:00100000:1.0:1746144887.854026:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+119:31565:x1830965174930688:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.854043:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.854056:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751436f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93dd3 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.854077:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.854082:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727514368 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dcc expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.854088:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144887.854091:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751436f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dd3 expref: 120 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.854594:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727514368 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dcc expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.854609:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753c00/0x4076af6727514368 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dcc expref: 5 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144887.854621:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172328576:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144887.854690:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144887.856225:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172328576:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144887.856247:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751436f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dd3 expref: 119 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.856259:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:1.0:1746144887.856303:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+119:31565:x1830965174930688:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2276us (2539us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.856310:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5048 00000100:00100000:0.0:1746144887.857343:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.863491:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.869841:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.876129:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.876403:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174931584 00000100:00100000:1.0:1746144887.876413:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174931584 00000100:00100000:1.0:1746144887.876597:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5049 00000100:00100000:1.0:1746144887.876607:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174931584:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.876626:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.876644:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514376 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93dda expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.876673:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751436f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dd3 expref: 117 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.876990:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.877002:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.877007:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514376 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dda expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.877039:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751436f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dd3 expref: 117 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.877051:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751436f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dd3 expref: 117 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144887.877063:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172328832:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144887.877181:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144887.879066:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172328832:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144887.879096:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514376 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dda expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.879434:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:1.0:1746144887.879881:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174931584:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3273us (4129us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.879889:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5049 00000100:00100000:0.0:1746144887.881936:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.882003:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.882285:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174931712 00000100:00100000:1.0:1746144887.882289:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174931712 00000100:00100000:1.0:1746144887.882313:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5050 00000100:00100000:1.0:1746144887.882318:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+119:31565:x1830965174931712:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.882335:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.882346:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751437d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93de1 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.882365:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514376 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dda expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.882372:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144887.882373:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144887.882376:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751437d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de1 expref: 119 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.882589:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dda expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.882601:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514376 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dda expref: 5 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144887.882613:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172328960:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144887.882831:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144887.887982:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174932096 00000100:00100000:0.0:1746144887.888002:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174932096 00002000:00100000:0.0:1746144887.888051:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa2300 x1830965174932096/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144887.888060:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa2300 with x1830965174932096 ext(0->4095) 00010000:00010000:0.0:1746144887.888070:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514376 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dda expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:0.0:1746144887.888083:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514376 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dda expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:0.0:1746144887.888089:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa2300 00000100:00100000:0.0:1746144887.888111:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1785 00000100:00100000:0.0:1746144887.888118:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174932096:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144887.888339:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172328960:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144887.888362:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751437d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de1 expref: 118 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.888376:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:0.0:1746144887.888506:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174932096:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 387us (599us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144887.888512:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1785 00002000:00100000:0.0:1746144887.888517:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa2300 x1830965174932096/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144887.888523:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa2300 with x1830965174932096 ext(0->4095) 00010000:00010000:0.0:1746144887.888527:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dda expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:0.0:1746144887.888536:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514376 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dda expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:0.0:1746144887.888541:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa2300 00000100:00100000:1.0:1746144887.890248:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+118:31565:x1830965174931712:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7922us (8313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.890259:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5050 00000100:00100000:0.0:1746144887.895907:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.896022:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.896086:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174932224 00000100:00100000:1.0:1746144887.896096:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174932224 00000100:00100000:1.0:1746144887.896151:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5051 00000100:00100000:1.0:1746144887.896160:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+118:31579:x1830965174932224:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.896176:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.896191:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514384 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93de8 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.896319:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144887.896325:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751437d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de1 expref: 119 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.896332:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.896335:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514384 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de8 expref: 119 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.896824:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751437d lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de1 expref: 119 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144887.896833:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751437d lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de1 expref: 119 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144887.896841:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172329344:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144887.897748:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144887.907514:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172329344:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144887.907538:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514384 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de8 expref: 119 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.907555:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:0.0:1746144887.907577:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+119:31579:x1830965174932224:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 11419us (11683us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144887.907584:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5051 00000100:00100000:0.0:1746144887.911622:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.921008:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.921043:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174932736 00000100:00100000:0.0:1746144887.921051:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174932736 00010000:00010000:0.0:1746144887.921090:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751437d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de1 expref: 119 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:0.0:1746144887.921126:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10467 00000100:00100000:0.0:1746144887.921134:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+119:1985:x1830965174932736:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144887.921147:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144887.921168:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751437d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de1 expref: 119 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:0.0:1746144887.921180:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751437d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de1 expref: 119 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:0.0:1746144887.921205:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751437d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de1 expref: 119 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:0.0:1746144887.921224:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144887.921225:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144887.921232:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514384 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de8 expref: 118 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.921240:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de8 expref: 118 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.921272:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de8 expref: 118 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144887.921285:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172329472:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144887.921352:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144887.923473:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.923493:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172329472:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144887.923511:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144887.923545:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+119:1985:x1830965174932736:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2412us (2555us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144887.923553:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10467 00000100:00100000:1.0:1746144887.926548:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.926578:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174933120 00000100:00100000:0.0:1746144887.926587:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174933120 00000100:00100000:0.0:1746144887.926626:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5052 00000100:00100000:0.0:1746144887.926634:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174933120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144887.926651:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144887.926668:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091750400/0x4076af672751438b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93def expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.926696:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514384 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de8 expref: 117 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.926703:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144887.926705:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144887.926708:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091750400/0x4076af672751438b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93def expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.926734:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de8 expref: 117 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.926750:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de8 expref: 117 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:0.0:1746144887.926790:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172329600:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144887.926851:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144887.933046:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.933338:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174933248 00000100:00100000:1.0:1746144887.933346:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174933248 00010000:00010000:1.0:1746144887.933375:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de8 expref: 118 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144887.933397:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10468 00000100:00100000:1.0:1746144887.933403:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+118:1985:x1830965174933248:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144887.933417:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144887.933438:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514384 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de8 expref: 118 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144887.933448:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514384 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de8 expref: 118 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144887.933472:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514384 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93de8 expref: 118 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144887.933482:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144887.933484:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144887.933491:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091750400/0x4076af672751438b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93def expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.933498:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091750400/0x4076af672751438b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93def expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.933528:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091750400/0x4076af672751438b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93def expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144887.933545:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172329728:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144887.933608:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144887.934471:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.949530:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.949820:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d365880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172330112:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144887.949855:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a41eca00/0x4076af6727514399 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dfd expref: 119 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.949874:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a41eca00, rc 0) 00000100:00100000:1.0:1746144887.949918:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+119:31579:x1830965174933760:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6983us (7572us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.949926:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5054 00000100:00100000:1.0:1746144887.963925:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174934656 00000100:00100000:1.0:1746144887.963934:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174934656 00000100:00100000:1.0:1746144887.963977:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5055 00000100:00100000:1.0:1746144887.963985:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174934656:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.964014:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.964032:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce22000/0x4076af67275143a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e04 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.964061:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a41eca00/0x4076af6727514399 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dfd expref: 117 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.964069:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.964071:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.964074:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce22000/0x4076af67275143a0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e04 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.964109:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a41eca00/0x4076af6727514399 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dfd expref: 117 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.964121:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a41eca00/0x4076af6727514399 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93dfd expref: 117 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144887.964134:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172330368:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144887.964216:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000001:00080000:1.0:1746144887.964759:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967933 is committed 00000001:00080000:1.0:1746144887.965082:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967963 is committed 00000001:00080000:1.0:1746144887.965146:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294967965 is committed 00000100:00100000:1.0:1746144887.966562:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172330368:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144887.966593:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ce22000/0x4076af67275143a0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e04 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.966611:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce22000, rc 0) 00000100:00100000:1.0:1746144887.966661:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174934656:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2676us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.966669:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5055 00000100:00100000:0.0:1746144887.967273:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.969032:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.969081:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174934912 00000100:00100000:1.0:1746144887.969086:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174934912 00000100:00100000:1.0:1746144887.969127:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5056 00000100:00100000:1.0:1746144887.969133:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+6:31565:x1830965174934912:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.969148:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.969163:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ce23e00/0x4076af67275143a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e0b expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.969324:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ce22000/0x4076af67275143a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e04 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.969331:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144887.969333:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144887.969336:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce23e00/0x4076af67275143a7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e0b expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.969358:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ce22000/0x4076af67275143a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e04 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.969368:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ce22000/0x4076af67275143a0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e04 expref: 5 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144887.969377:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172330624:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144887.969580:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144887.971149:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.971264:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174935168 00000100:00100000:1.0:1746144887.971270:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174935168 00002000:00100000:1.0:1746144887.971303:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5c000 x1830965174935168/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/0 e 0 to 0 dl 1746144898 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.971312:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5c000 with x1830965174935168 ext(0->4095) 00010000:00010000:1.0:1746144887.971319:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ce22000/0x4076af67275143a0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e04 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144887.971330:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ce22000/0x4076af67275143a0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e04 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144887.971337:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5c000 00000100:00100000:1.0:1746144887.972237:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1789 00000100:00100000:1.0:1746144887.972248:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174935168:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144887.972457:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174935168:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 212us (1309us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144887.972463:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1789 00002000:00100000:1.0:1746144887.972469:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5c000 x1830965174935168/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:528/0 lens 488/4536 e 0 to 0 dl 1746144898 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144887.972478:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5c000 with x1830965174935168 ext(0->4095) 00010000:00010000:1.0:1746144887.972484:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ce22000/0x4076af67275143a0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e04 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144887.972493:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ce22000/0x4076af67275143a0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e04 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144887.972499:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5c000 00000100:00100000:1.0:1746144887.972536:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172330624:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144887.972560:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ce23e00/0x4076af67275143a7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e0b expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.972574:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ce23e00, rc 0) 00000100:00100000:1.0:1746144887.972594:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+6:31565:x1830965174934912:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3461us (3565us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144887.972604:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5056 00000100:00100000:0.0:1746144887.976808:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.976959:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174935296 00000100:00100000:0.0:1746144887.976967:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174935296 00010000:00010000:0.0:1746144887.977011:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce22000/0x4076af67275143a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e04 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:0.0:1746144887.977171:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10472 00000100:00100000:0.0:1746144887.977179:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174935296:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144887.977193:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144887.977214:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ce22000/0x4076af67275143a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e04 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:0.0:1746144887.977227:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ce22000/0x4076af67275143a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e04 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:0.0:1746144887.977257:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ce22000/0x4076af67275143a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e04 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:0.0:1746144887.977272:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144887.977274:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144887.977282:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ce23e00/0x4076af67275143a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e0b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.977290:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ce23e00/0x4076af67275143a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e0b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144887.977325:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ce23e00/0x4076af67275143a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e0b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144887.977337:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009167f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172330752:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144887.977429:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144887.980963:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144887.998040:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144887.998272:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174935680 00000100:00100000:1.0:1746144887.998283:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174935680 00000100:00100000:1.0:1746144887.998336:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5057 00000100:00100000:1.0:1746144887.998345:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174935680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144887.998362:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144887.998381:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275143ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e12 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.998413:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ce23e00/0x4076af67275143a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e0b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.998420:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.998422:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144887.998425:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275143ae lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e12 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.998456:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ce23e00/0x4076af67275143a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e0b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144887.998469:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ce23e00/0x4076af67275143a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e0b expref: 5 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144887.998481:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172330880:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144887.998578:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144888.000330:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172330880:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.000361:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275143ae lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e12 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.000376:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a41ec400, rc 0) 00000100:00100000:1.0:1746144888.000418:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174935680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2074us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.000426:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5057 00000100:00100000:0.0:1746144888.000836:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.000964:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174935808 00000100:00100000:1.0:1746144888.000970:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174935808 00002000:00100000:1.0:1746144888.001015:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009167f480 x1830965174935808/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 496/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.001024:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167f480 with x1830965174935808 ext(0->7) 00010000:00010000:1.0:1746144888.001030:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ce23e00/0x4076af67275143a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e0b expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.001041:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ce23e00/0x4076af67275143a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e0b expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.001047:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009167f480 00000100:00100000:1.0:1746144888.001073:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1790 00000100:00100000:1.0:1746144888.001080:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1985:x1830965174935808:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144888.001821:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965174935808:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 740us (984us total) trans 4294967966 rc 0/0 00000100:00100000:1.0:1746144888.001828:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1790 00002000:00100000:1.0:1746144888.001834:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009167f480 x1830965174935808/t4294967966(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 496/448 e 0 to 0 dl 1746144899 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.001847:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167f480 with x1830965174935808 ext(0->7) 00010000:00010000:1.0:1746144888.001852:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ce23e00/0x4076af67275143a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e0b expref: 8 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.001860:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ce23e00/0x4076af67275143a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e0b expref: 8 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.001866:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009167f480 00000100:00100000:0.0:1746144888.005556:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.009108:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.009156:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174936064 00000100:00100000:1.0:1746144888.009165:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174936064 00000100:00100000:1.0:1746144888.009220:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5058 00000100:00100000:1.0:1746144888.009228:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31565:x1830965174936064:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.009246:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.009264:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275143b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e19 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.009290:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275143ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e12 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.009298:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.009299:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.009302:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275143b5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e19 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.009330:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275143ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e12 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.009346:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275143ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e12 expref: 5 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.009358:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172331136:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.010566:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144888.011485:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.011527:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174936320 00000100:00100000:1.0:1746144888.011533:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174936320 00002000:00100000:1.0:1746144888.011566:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093857100 x1830965174936320/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.011575:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093857100 with x1830965174936320 ext(0->4095) 00010000:00010000:1.0:1746144888.011584:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275143ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e12 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.011595:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275143ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e12 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.011602:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093857100 00000100:00100000:1.0:1746144888.011628:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1791 00000100:00100000:1.0:1746144888.011635:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174936320:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144888.011836:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174936320:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 201us (351us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144888.011842:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1791 00002000:00100000:1.0:1746144888.011848:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093857100 x1830965174936320/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/4536 e 0 to 0 dl 1746144899 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.011861:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093857100 with x1830965174936320 ext(0->4095) 00010000:00010000:1.0:1746144888.011866:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275143ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e12 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.011875:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275143ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e12 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.011881:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093857100 00000100:00100000:1.0:1746144888.012465:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172331136:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.012484:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275143b5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e19 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.012498:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5fc00, rc 0) 00000100:00100000:1.0:1746144888.012530:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31565:x1830965174936064:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3303us (3425us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.012538:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5058 00000100:00100000:0.0:1746144888.014912:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.018462:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.026420:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.026974:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174936832 00000100:00100000:1.0:1746144888.026984:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174936832 00000100:00100000:1.0:1746144888.027051:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5059 00000100:00100000:1.0:1746144888.027059:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174936832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.027078:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.027097:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af67275143bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e20 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.027133:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275143b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e19 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.027141:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.027143:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.027146:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af67275143bc lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e20 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.027177:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275143b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e19 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.027188:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275143b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e19 expref: 7 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.027201:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172331392:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.028797:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144888.033145:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172331392:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.033181:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af67275143bc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e20 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.033198:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5e600, rc 0) 00000100:00100000:1.0:1746144888.033245:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174936832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6186us (6836us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.033254:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5059 00000100:00100000:0.0:1746144888.034619:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.034853:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174936960 00000100:00100000:1.0:1746144888.034860:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174936960 00000100:00100000:1.0:1746144888.034903:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5060 00000100:00100000:1.0:1746144888.034909:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31565:x1830965174936960:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.034930:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.034947:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af67275143c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e27 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.034970:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.034976:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af67275143bc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e20 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.034982:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144888.034986:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af67275143c3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e27 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.035036:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af67275143bc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e20 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.035047:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af67275143c3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e27 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.035056:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5f600, rc 0) 00000100:00100000:1.0:1746144888.035119:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31565:x1830965174936960:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 209us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.035125:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5060 00000100:00100000:0.0:1746144888.037238:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.037374:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174937088 00000100:00100000:1.0:1746144888.037381:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174937088 00002000:00100000:1.0:1746144888.037421:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8801358ec000 x1830965174937088/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 496/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.037430:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358ec000 with x1830965174937088 ext(0->7) 00010000:00010000:1.0:1746144888.037440:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275143b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e19 expref: 9 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.037452:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275143b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e19 expref: 9 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.037459:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801358ec000 00000100:00100000:1.0:1746144888.037494:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1792 00000100:00100000:1.0:1746144888.037501:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965174937088:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746144888.041074:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.043585:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.051723:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.063889:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.069381:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.069489:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174937984 00000100:00100000:1.0:1746144888.069498:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174937984 00000100:00100000:1.0:1746144888.070472:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5061 00000100:00100000:1.0:1746144888.070483:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174937984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.070504:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.070523:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af67275143ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e2e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.070553:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af67275143c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e27 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.070560:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.070562:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.070566:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af67275143ca lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e2e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.070607:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af67275143c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e27 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.070623:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af67275143c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e27 expref: 9 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.070635:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172331904:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.070725:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144888.075728:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172331904:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.075798:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af67275143ca lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e2e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.075819:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5f200, rc 0) 00000100:00100000:1.0:1746144888.075881:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174937984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5399us (6508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.075890:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5061 00000100:00100000:0.0:1746144888.076707:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.086494:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.090110:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.092354:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.092442:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174938624 00000100:00100000:1.0:1746144888.092447:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174938624 00000100:00100000:1.0:1746144888.092484:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5062 00000100:00100000:1.0:1746144888.092489:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+11:31565:x1830965174938624:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.092502:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.092518:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af67275143d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e35 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.092544:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af67275143ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e2e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.092556:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.092559:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.092562:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af67275143d1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e35 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.092728:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af67275143ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e2e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.092740:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af67275143ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e2e expref: 5 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.092751:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172332160:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.093446:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144888.096335:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.096749:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172332160:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.096792:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af67275143d1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e35 expref: 13 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.096801:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5f400, rc 0) 00000100:00100000:1.0:1746144888.096819:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+13:31565:x1830965174938624:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4330us (4469us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.096825:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5062 00000100:00100000:0.0:1746144888.098421:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.103254:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.112462:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.116442:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.118984:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.123189:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.127062:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.128133:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.132299:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.133140:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.137013:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.145338:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.148113:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.149579:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3820 00000100:00100000:1.0:1746144888.149593:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1984:x1830965174941056:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144888.150708:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1984:x1830965174941056:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 1113us (2593us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144888.150718:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3820 00002000:00100000:1.0:1746144888.150727:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e831c00 x1830965174941056/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 488/4536 e 0 to 0 dl 1746144899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.150735:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e831c00 with x1830965174941056 ext(0->4095) 00002000:00010000:1.0:1746144888.150741:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e831c00 00000100:00100000:0.0:1746144888.153691:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.154097:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174941184 00000100:00100000:1.0:1746144888.154106:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174941184 00000100:00100000:1.0:1746144888.154458:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5067 00000100:00100000:1.0:1746144888.154467:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174941184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.154485:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.154505:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5e200/0x4076af67275143f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e58 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.154536:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091751e00/0x4076af67275143ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e51 expref: 11 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.154544:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.154545:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.154548:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5e200/0x4076af67275143f4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e58 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.154580:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091751e00/0x4076af67275143ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e51 expref: 11 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.154594:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091751e00/0x4076af67275143ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e51 expref: 11 pid: 10401 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.154611:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172333440:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.155722:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144888.159033:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.159160:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172333440:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.159194:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5e200/0x4076af67275143f4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e58 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.159213:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5e200, rc 0) 00000100:00100000:1.0:1746144888.159258:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174941184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4791us (5577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.159266:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5067 00000100:00100000:0.0:1746144888.160631:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.160691:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174941440 00000100:00100000:1.0:1746144888.160695:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174941440 00000100:00100000:1.0:1746144888.160726:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5068 00000100:00100000:1.0:1746144888.160732:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+12:31565:x1830965174941440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.160745:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.160758:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5fa00/0x4076af67275143fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e5f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.160805:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5e200/0x4076af67275143f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e58 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.160812:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.160813:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.160816:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5fa00/0x4076af67275143fb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e5f expref: 13 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.160839:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5e200/0x4076af67275143f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e58 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.160849:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5e200/0x4076af67275143f4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e58 expref: 5 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.160857:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172333696:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.160899:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144888.163974:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172333696:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.164005:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5fa00/0x4076af67275143fb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e5f expref: 12 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.164020:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5fa00, rc 0) 00000100:00100000:1.0:1746144888.164038:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+12:31565:x1830965174941440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3306us (3410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.164044:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5068 00000100:00100000:0.0:1746144888.164853:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.165122:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174941696 00000100:00100000:1.0:1746144888.165129:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174941696 00002000:00100000:1.0:1746144888.165169:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a4f0a680 x1830965174941696/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.165180:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f0a680 with x1830965174941696 ext(0->4095) 00010000:00010000:1.0:1746144888.165188:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5e200/0x4076af67275143f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e58 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.165206:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5e200/0x4076af67275143f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e58 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.165213:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4f0a680 00000100:00100000:1.0:1746144888.165242:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1798 00000100:00100000:1.0:1746144888.165249:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174941696:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144888.165405:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174941696:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 156us (553us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144888.165411:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1798 00002000:00100000:1.0:1746144888.165417:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a4f0a680 x1830965174941696/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/4536 e 0 to 0 dl 1746144899 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.165424:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f0a680 with x1830965174941696 ext(0->4095) 00010000:00010000:1.0:1746144888.165429:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5e200/0x4076af67275143f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e58 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.165437:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5e200/0x4076af67275143f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e58 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.165442:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4f0a680 00000100:00100000:0.0:1746144888.167981:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.170500:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.177486:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.177621:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174942208 00000100:00100000:1.0:1746144888.177631:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174942208 00000100:00100000:1.0:1746144888.177679:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5069 00000100:00100000:1.0:1746144888.177686:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174942208:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.177705:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.177722:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514402 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e66 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.177751:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5fa00/0x4076af67275143fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e5f expref: 11 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.177758:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.177760:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.177795:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514402 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e66 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.177825:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5fa00/0x4076af67275143fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e5f expref: 11 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.177837:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5fa00/0x4076af67275143fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e5f expref: 11 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.177848:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172333952:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.177927:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144888.179759:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172333952:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.179813:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514402 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e66 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.179828:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5f200, rc 0) 00000100:00100000:1.0:1746144888.179865:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174942208:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2179us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.179872:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5069 00000100:00100000:0.0:1746144888.183949:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.184061:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174942336 00000100:00100000:1.0:1746144888.184069:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174942336 00002000:00100000:1.0:1746144888.184113:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880092f71500 x1830965174942336/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 496/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.184124:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f71500 with x1830965174942336 ext(0->7) 00010000:00010000:1.0:1746144888.184133:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5fa00/0x4076af67275143fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e5f expref: 12 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.184147:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5fa00/0x4076af67275143fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e5f expref: 12 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.184154:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f71500 00000100:00100000:1.0:1746144888.184184:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1799 00000100:00100000:1.0:1746144888.184190:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1984:x1830965174942336:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144888.184516:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+14:1984:x1830965174942336:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 325us (576us total) trans 4294967969 rc 0/0 00000100:00100000:1.0:1746144888.184522:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1799 00002000:00100000:1.0:1746144888.184528:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880092f71500 x1830965174942336/t4294967969(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 496/448 e 0 to 0 dl 1746144899 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.184535:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f71500 with x1830965174942336 ext(0->7) 00010000:00010000:1.0:1746144888.184540:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5fa00/0x4076af67275143fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e5f expref: 14 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.184548:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5fa00/0x4076af67275143fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e5f expref: 14 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.184559:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f71500 00000100:00100000:0.0:1746144888.191883:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.191975:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174942592 00000100:00100000:1.0:1746144888.191985:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174942592 00000100:00100000:1.0:1746144888.192050:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5070 00000100:00100000:1.0:1746144888.192058:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+14:31565:x1830965174942592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.192077:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.192094:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727514409 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e6d expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.192122:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.192128:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514402 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e66 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.192134:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144888.192137:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727514409 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e6d expref: 15 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.192228:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514402 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e66 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.192243:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727514409 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e6d expref: 15 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.192253:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5f400, rc 0) 00000100:00100000:0.0:1746144888.192293:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.192297:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+15:31565:x1830965174942592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 241us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.192306:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5070 00000100:00100000:0.0:1746144888.194802:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.197655:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.201891:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.202140:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174943232 00000100:00100000:1.0:1746144888.202147:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174943232 00002000:00100000:1.0:1746144888.202180:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70e00 x1830965174943232/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 488/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.202190:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70e00 with x1830965174943232 ext(0->4095) 00002000:00010000:1.0:1746144888.202194:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f70e00 00000100:00100000:1.0:1746144888.202425:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3822 00000100:00100000:1.0:1746144888.202432:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+14:1985:x1830965174943232:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144888.202585:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+14:1985:x1830965174943232:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 154us (705us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144888.202591:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3822 00002000:00100000:1.0:1746144888.202595:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70e00 x1830965174943232/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 488/4536 e 0 to 0 dl 1746144899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.202602:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70e00 with x1830965174943232 ext(0->4095) 00002000:00010000:1.0:1746144888.202604:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f70e00 00000100:00100000:0.0:1746144888.207560:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.220114:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.220484:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.225463:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.228712:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.231238:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.235613:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.242125:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.242423:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174944512 00000100:00100000:1.0:1746144888.242433:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174944512 00000100:00100000:1.0:1746144888.242487:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5073 00000100:00100000:1.0:1746144888.242495:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174944512:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.242514:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.242531:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af672751441e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e82 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.242567:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af6727514417 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e7b expref: 15 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.242574:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.242576:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.242579:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af672751441e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e82 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.242607:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af6727514417 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e7b expref: 15 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.242620:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af6727514417 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e7b expref: 15 pid: 10401 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.242630:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172334976:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.242716:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144888.244368:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172334976:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.244395:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af672751441e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e82 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.244410:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5e600, rc 0) 00000100:00100000:1.0:1746144888.244451:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174944512:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1957us (2336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.244459:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5073 00000100:00100000:0.0:1746144888.245318:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.246902:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174944640 00000100:00100000:1.0:1746144888.246914:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174944640 00002000:00100000:1.0:1746144888.246960:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800a417d880 x1830965174944640/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 496/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.246970:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417d880 with x1830965174944640 ext(0->7) 00010000:00010000:1.0:1746144888.246979:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af6727514417 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e7b expref: 16 pid: 10401 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.247004:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af6727514417 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e7b expref: 16 pid: 10401 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.247011:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417d880 00000100:00100000:1.0:1746144888.247047:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1803 00000100:00100000:1.0:1746144888.247054:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1985:x1830965174944640:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144888.247406:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965174944640:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 351us (2089us total) trans 4294967971 rc 0/0 00000100:00100000:1.0:1746144888.247412:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1803 00002000:00100000:1.0:1746144888.247418:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800a417d880 x1830965174944640/t4294967971(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 496/448 e 0 to 0 dl 1746144899 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.247425:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417d880 with x1830965174944640 ext(0->7) 00010000:00010000:1.0:1746144888.247429:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af6727514417 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e7b expref: 18 pid: 10401 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.247437:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af6727514417 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e7b expref: 18 pid: 10401 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.247443:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417d880 00000100:00100000:0.0:1746144888.250915:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.252296:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.252372:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174944768 00000100:00100000:1.0:1746144888.252382:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174944768 00000100:00100000:1.0:1746144888.252716:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5074 00000100:00100000:1.0:1746144888.252726:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965174944768:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.252746:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.252787:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514425 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e89 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.252816:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.252823:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af672751441e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e82 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.252833:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144888.252837:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514425 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e89 expref: 19 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.252876:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af672751441e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e82 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.253376:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514425 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e89 expref: 19 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.253385:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5f200, rc 0) 00000100:00100000:1.0:1746144888.253422:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31565:x1830965174944768:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 697us (2516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.253428:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5074 00000100:00100000:0.0:1746144888.262312:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.264743:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.265032:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174945664 00000100:00100000:1.0:1746144888.265039:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174945664 00000100:00100000:1.0:1746144888.265538:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5075 00000100:00100000:1.0:1746144888.265546:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174945664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.265560:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.265576:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af672751442c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e90 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.265601:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514425 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e89 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.265608:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.265609:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.265613:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af672751442c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e90 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.265642:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514425 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e89 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.265654:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514425 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e89 expref: 17 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.267204:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172335488:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.267305:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144888.269181:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172335488:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.269210:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af672751442c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e90 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.269226:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5f400, rc 0) 00000100:00100000:1.0:1746144888.269265:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174945664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3718us (4525us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.269274:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5075 00000100:00100000:0.0:1746144888.270349:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.273539:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.275220:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.275326:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174946176 00000100:00100000:1.0:1746144888.275331:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174946176 00000100:00100000:1.0:1746144888.275356:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5076 00000100:00100000:1.0:1746144888.275361:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+17:31565:x1830965174946176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.275372:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.275387:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af6727514433 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e97 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.275412:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af672751442c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e90 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.275419:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.275421:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.275424:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af6727514433 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e97 expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.275452:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af672751442c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e90 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.275463:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af672751442c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e90 expref: 5 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.275473:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172335744:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.275528:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144888.277712:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172335744:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.277742:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af6727514433 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e97 expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.277757:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5fc00, rc 0) 00000100:00100000:1.0:1746144888.277839:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965174946176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2476us (2619us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.277848:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5076 00000100:00100000:0.0:1746144888.278134:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.278656:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.278716:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174946432 00000100:00100000:1.0:1746144888.278722:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174946432 00000100:00100000:1.0:1746144888.278779:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5077 00000100:00100000:1.0:1746144888.278787:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174946432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.278801:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.278815:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af672751443a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93e9e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.278833:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.278838:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af6727514433 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e97 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.278844:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.278847:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af672751443a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e9e expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.278873:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af6727514433 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e97 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.278883:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af672751443a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e9e expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.278891:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5f600, rc 0) 00000100:00100000:1.0:1746144888.278914:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:31579:x1830965174946432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 128us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.278919:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5077 00000100:00100000:0.0:1746144888.283159:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.286834:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.286921:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.290065:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.290591:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174947200 00000100:00100000:1.0:1746144888.290598:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174947200 00002000:00100000:1.0:1746144888.290637:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac84a80 x1830965174947200/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.290646:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac84a80 with x1830965174947200 ext(0->4095) 00010000:00010000:1.0:1746144888.290655:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af672751443a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e9e expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.290667:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af672751443a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e9e expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.290674:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac84a80 00000100:00100000:1.0:1746144888.290699:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1806 00000100:00100000:1.0:1746144888.290705:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174947200:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144888.290906:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965174947200:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 201us (848us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144888.290913:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1806 00002000:00100000:1.0:1746144888.290918:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac84a80 x1830965174947200/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/4536 e 0 to 0 dl 1746144899 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.290931:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac84a80 with x1830965174947200 ext(0->4095) 00010000:00010000:1.0:1746144888.290936:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af672751443a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e9e expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.290944:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af672751443a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93e9e expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.290949:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac84a80 00000100:00100000:0.0:1746144888.295560:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.295621:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.301226:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.304618:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.309400:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.311481:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174947968 00000100:00100000:1.0:1746144888.311496:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174947968 00000100:00100000:1.0:1746144888.311566:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5080 00000100:00100000:1.0:1746144888.311575:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174947968:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.311596:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.311617:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af672751444f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93eb3 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.311650:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091750400/0x4076af6727514448 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93eac expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.311658:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.311661:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.311664:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af672751444f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93eb3 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.311698:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091750400/0x4076af6727514448 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93eac expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.311716:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091750400/0x4076af6727514448 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93eac expref: 17 pid: 10401 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.311727:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172336768:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.311827:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144888.330741:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172336768:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.330817:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af672751444f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93eb3 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.330835:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5fc00, rc 0) 00000100:00100000:0.0:1746144888.332191:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.332289:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174948096 00000100:00100000:1.0:1746144888.332296:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174948096 00002000:00100000:1.0:1746144888.332331:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009bae1500 x1830965174948096/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 496/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.332340:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae1500 with x1830965174948096 ext(0->7) 00010000:00010000:1.0:1746144888.332347:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091750400/0x4076af6727514448 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93eac expref: 18 pid: 10401 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.332360:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091750400/0x4076af6727514448 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93eac expref: 18 pid: 10401 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.332366:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bae1500 00000100:00100000:1.0:1746144888.333841:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1807 00000100:00100000:1.0:1746144888.333966:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965174948096:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144888.334351:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1984:x1830965174948096:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 499us (2159us total) trans 4294967972 rc 0/0 00000100:00100000:1.0:1746144888.334358:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1807 00002000:00100000:1.0:1746144888.334366:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009bae1500 x1830965174948096/t4294967972(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 496/448 e 0 to 0 dl 1746144899 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.334376:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae1500 with x1830965174948096 ext(0->7) 00010000:00010000:1.0:1746144888.334385:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091750400/0x4076af6727514448 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93eac expref: 20 pid: 10401 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.334397:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091750400/0x4076af6727514448 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93eac expref: 20 pid: 10401 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.334403:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bae1500 00000100:00100000:0.0:1746144888.335791:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.337788:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.343809:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.347584:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.350694:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174948992 00000100:00100000:0.0:1746144888.350700:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174948992 00002000:00100000:0.0:1746144888.350737:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d364380 x1830965174948992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 488/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144888.350751:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d364380 with x1830965174948992 ext(0->4095) 00002000:00010000:0.0:1746144888.350755:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d364380 00000100:00100000:0.0:1746144888.352944:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.353659:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174949120 00000100:00100000:1.0:1746144888.353670:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174949120 00000100:00100000:1.0:1746144888.354355:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5082 00000100:00100000:1.0:1746144888.354364:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174949120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.354379:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.354394:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af672751445d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93ec1 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.354417:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af6727514456 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93eba expref: 19 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.354423:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.354425:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.354428:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af672751445d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ec1 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.354451:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af6727514456 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93eba expref: 19 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.354460:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091750200/0x4076af6727514456 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93eba expref: 19 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.354470:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172337280:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.354966:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144888.357622:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.357715:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172337280:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.357741:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af672751445d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ec1 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.357755:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5f200, rc 0) 00000100:00100000:1.0:1746144888.357804:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174949120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3442us (4864us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.357812:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5082 00000100:00100000:0.0:1746144888.360297:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.360314:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174949504 00000100:00100000:0.0:1746144888.360318:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174949504 00002000:00100000:0.0:1746144888.360348:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2ca80 x1830965174949504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144888.360357:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2ca80 with x1830965174949504 ext(0->4095) 00002000:00010000:0.0:1746144888.360362:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2ca80 00000100:00100000:0.0:1746144888.360376:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3828 00000100:00100000:0.0:1746144888.360381:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174949504:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144888.360504:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174949504:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 122us (208us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144888.360510:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3828 00002000:00100000:0.0:1746144888.360514:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2ca80 x1830965174949504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/4536 e 0 to 0 dl 1746144899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144888.360522:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2ca80 with x1830965174949504 ext(0->4095) 00002000:00010000:0.0:1746144888.360524:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2ca80 00000100:00100000:0.0:1746144888.363225:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.363314:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174949632 00000100:00100000:1.0:1746144888.363325:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174949632 00000100:00100000:1.0:1746144888.363381:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5083 00000100:00100000:1.0:1746144888.363388:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31579:x1830965174949632:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.363403:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.363418:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af6727514464 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93ec8 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.363444:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af672751445d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ec1 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.363450:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.363452:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.363455:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af6727514464 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ec8 expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.363479:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af672751445d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ec1 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.363488:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af672751445d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ec1 expref: 5 pid: 10401 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.363499:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172337536:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144888.363633:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.364242:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144888.365189:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172337536:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.365216:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af6727514464 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ec8 expref: 21 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.365230:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5e600, rc 0) 00000100:00100000:1.0:1746144888.365264:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+21:31579:x1830965174949632:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1876us (2049us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.365272:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5083 00000100:00100000:0.0:1746144888.366245:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.370277:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.374751:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.374863:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174950272 00000100:00100000:1.0:1746144888.374872:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174950272 00000100:00100000:1.0:1746144888.374919:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5085 00000100:00100000:1.0:1746144888.374926:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174950272:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.374944:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.374962:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af6727514472 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93ed6 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.375000:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.375005:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af672751446b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ecf expref: 20 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.375011:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144888.375015:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af6727514472 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ed6 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.375050:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af672751446b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ecf expref: 20 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.375062:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af6727514472 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ed6 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.375071:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5fc00, rc 0) 00000100:00100000:1.0:1746144888.375115:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174950272:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 190us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.375122:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5085 00000100:00100000:0.0:1746144888.376630:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.379558:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.382173:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.382265:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.382362:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174950784 00000100:00100000:1.0:1746144888.382371:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174950784 00000100:00100000:1.0:1746144888.382433:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5086 00000100:00100000:1.0:1746144888.382441:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31565:x1830965174950784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.382461:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.382479:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514479 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93edd expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.382508:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.382515:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af6727514472 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ed6 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.382520:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144888.382524:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514479 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93edd expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.382563:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af6727514472 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ed6 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.382577:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514479 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93edd expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.382586:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5f200, rc 0) 00000100:00100000:1.0:1746144888.382629:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+22:31565:x1830965174950784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 189us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.382635:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5086 00000100:00100000:0.0:1746144888.386984:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.391075:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.393942:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.394020:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174951680 00000100:00100000:1.0:1746144888.394031:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174951680 00000100:00100000:1.0:1746144888.394339:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5087 00000100:00100000:1.0:1746144888.394347:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174951680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.394363:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.394380:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af6727514480 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93ee4 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.394413:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514479 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93edd expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.394421:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.394422:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.394426:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af6727514480 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ee4 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.394456:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514479 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93edd expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.394468:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af6727514479 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93edd expref: 19 pid: 10401 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.394480:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172338560:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.394576:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144888.395848:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172338560:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.395873:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af6727514480 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ee4 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.395888:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5e600, rc 0) 00000100:00100000:1.0:1746144888.395917:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174951680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1570us (2030us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.395926:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5087 00000100:00100000:0.0:1746144888.397129:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.399370:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.401331:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.401388:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174952192 00000100:00100000:1.0:1746144888.401393:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174952192 00000100:00100000:0.0:1746144888.401981:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.402312:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174952320 00000100:00100000:1.0:1746144888.402316:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174952320 00000100:00100000:0.0:1746144888.407686:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.411599:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.415210:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.415857:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.419788:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.425453:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.425567:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.430643:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.430915:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174953728 00000100:00100000:1.0:1746144888.430924:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174953728 00002000:00100000:1.0:1746144888.430970:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612f480 x1830965174953728/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.430981:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612f480 with x1830965174953728 ext(0->4095) 00010000:00010000:1.0:1746144888.431001:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514495 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ef9 expref: 6 pid: 8432 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.431016:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514495 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ef9 expref: 6 pid: 8432 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.431023:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612f480 00000100:00100000:1.0:1746144888.431055:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1814 00000100:00100000:1.0:1746144888.431063:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174953728:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144888.431250:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174953728:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 187us (617us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144888.431257:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1814 00002000:00100000:1.0:1746144888.431263:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612f480 x1830965174953728/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/4536 e 0 to 0 dl 1746144899 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.431271:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612f480 with x1830965174953728 ext(0->4095) 00010000:00010000:1.0:1746144888.431276:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514495 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ef9 expref: 6 pid: 8432 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.431286:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514495 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ef9 expref: 6 pid: 8432 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.433420:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612f480 00000100:00100000:0.0:1746144888.439374:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.449612:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172339712:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144888.449635:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144888.449677:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965174953856:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 8511us (10312us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144888.449688:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10507 00000100:00100000:0.0:1746144888.449817:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.449857:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174954112 00000100:00100000:0.0:1746144888.449863:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174954112 00002000:00100000:0.0:1746144888.449901:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612fb80 x1830965174954112/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 488/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144888.449910:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612fb80 with x1830965174954112 ext(0->4095) 00002000:00010000:0.0:1746144888.449916:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612fb80 00000100:00100000:0.0:1746144888.449937:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3831 00000100:00100000:0.0:1746144888.449944:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1984:x1830965174954112:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144888.450723:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1984:x1830965174954112:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 779us (905us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144888.450729:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3831 00002000:00100000:0.0:1746144888.450734:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612fb80 x1830965174954112/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 488/4536 e 0 to 0 dl 1746144899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144888.450742:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612fb80 with x1830965174954112 ext(0->4095) 00002000:00010000:0.0:1746144888.450744:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612fb80 00000100:00100000:0.0:1746144888.462011:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.462045:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174954240 00000100:00100000:0.0:1746144888.462055:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174954240 00000100:00100000:0.0:1746144888.462099:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5092 00000100:00100000:0.0:1746144888.462108:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174954240:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144888.462126:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144888.462144:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275144a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93f07 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144888.462174:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751449c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f00 expref: 19 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144888.464200:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144888.464206:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144888.464216:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275144a3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f07 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144888.464260:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751449c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f00 expref: 19 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144888.464275:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751449c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f00 expref: 19 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:0.0:1746144888.464289:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800924d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172339840:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144888.464392:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144888.473347:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800924d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172339840:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144888.473381:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275144a3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f07 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144888.473399:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:0.0:1746144888.473455:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174954240:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 11347us (11465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144888.473596:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5092 00000100:00100000:0.0:1746144888.479337:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.495870:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.501382:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.505717:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.506779:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.506973:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174955008 00000100:00100000:0.0:1746144888.506976:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174955008 00000100:00100000:0.0:1746144888.507010:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5094 00000100:00100000:0.0:1746144888.507015:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+23:31579:x1830965174955008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144888.507023:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144888.507030:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275144b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93f15 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144888.507041:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144888.507045:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275144aa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f0e expref: 24 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144888.507049:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144888.507053:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275144b1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f15 expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144888.507073:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275144aa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f0e expref: 24 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144888.507083:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275144b1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f15 expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144888.507093:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:0.0:1746144888.507118:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+24:31579:x1830965174955008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 102us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144888.507124:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5094 00000100:00100000:0.0:1746144888.511382:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.519049:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.526747:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.530511:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.532749:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.537908:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.540625:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.540819:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.540849:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174956288 00000100:00100000:0.0:1746144888.540854:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174956288 00002000:00100000:0.0:1746144888.540892:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336ad80 x1830965174956288/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144888.540901:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336ad80 with x1830965174956288 ext(0->4095) 00002000:00010000:0.0:1746144888.540905:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009336ad80 00000100:00100000:0.0:1746144888.540921:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3834 00000100:00100000:0.0:1746144888.540928:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174956288:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144888.541114:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174956288:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 185us (489us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144888.541120:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3834 00002000:00100000:0.0:1746144888.541126:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336ad80 x1830965174956288/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/4536 e 0 to 0 dl 1746144899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144888.541133:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336ad80 with x1830965174956288 ext(0->4095) 00002000:00010000:0.0:1746144888.541136:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009336ad80 00000100:00100000:1.0:1746144888.545545:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174956544 00000100:00100000:1.0:1746144888.545552:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174956544 00000100:00100000:1.0:1746144888.545683:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5097 00000100:00100000:1.0:1746144888.545693:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+23:31579:x1830965174956544:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.545710:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.545728:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af67275144c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93f2a expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.545756:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.545779:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af67275144bf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f23 expref: 24 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.545786:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.545789:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af67275144c6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f2a expref: 24 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.545831:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af67275144bf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f23 expref: 24 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.545846:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af67275144c6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f2a expref: 24 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.546136:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5f600, rc 0) 00000100:00100000:1.0:1746144888.546154:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+23:31579:x1830965174956544:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 463us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.546159:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5097 00000100:00100000:0.0:1746144888.546199:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.548965:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.550963:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.555266:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.558706:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.558800:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174957440 00000100:00100000:1.0:1746144888.558808:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174957440 00000100:00100000:1.0:1746144888.558858:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5098 00000100:00100000:1.0:1746144888.558866:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174957440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.558880:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.558899:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5ee00/0x4076af67275144cd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93f31 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.558927:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af67275144c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f2a expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.558935:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.558937:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.558940:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5ee00/0x4076af67275144cd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f31 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.558971:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af67275144c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f2a expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.558983:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f600/0x4076af67275144c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f2a expref: 21 pid: 20722 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.559017:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172341376:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.559095:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144888.560354:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172341376:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.560377:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5ee00/0x4076af67275144cd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f31 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.560389:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5ee00, rc 0) 00000100:00100000:1.0:1746144888.560414:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174957440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1549us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.560422:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5098 00000100:00100000:0.0:1746144888.561537:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.567229:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.567310:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.567384:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174957824 00000100:00100000:1.0:1746144888.567393:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174957824 00000100:00100000:1.0:1746144888.567446:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5099 00000100:00100000:1.0:1746144888.567454:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+21:31565:x1830965174957824:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.567473:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.567491:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af67275144d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93f38 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.567519:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5ee00/0x4076af67275144cd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f31 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.567527:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.567529:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.567532:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af67275144d4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f38 expref: 22 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.567564:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5ee00/0x4076af67275144cd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f31 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.567574:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5ee00/0x4076af67275144cd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f31 expref: 6 pid: 20722 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.567585:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172341632:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.567650:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144888.568947:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172341632:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.568967:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af67275144d4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f38 expref: 22 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.568979:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5e600, rc 0) 00000100:00100000:1.0:1746144888.569083:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+22:31565:x1830965174957824:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1629us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.569089:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5099 00000100:00100000:0.0:1746144888.570131:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.570458:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174958080 00000100:00100000:1.0:1746144888.570464:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174958080 00000100:00100000:1.0:1746144888.570508:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5100 00000100:00100000:1.0:1746144888.570515:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+22:31579:x1830965174958080:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.570527:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.570541:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af67275144db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93f3f expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.570561:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.570566:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af67275144d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f38 expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.570572:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.570575:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af67275144db lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f3f expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.570609:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5e600/0x4076af67275144d4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f38 expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.570620:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af67275144db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f3f expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.570629:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5f400, rc 0) 00000100:00100000:0.0:1746144888.570699:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.571135:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+23:31579:x1830965174958080:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 620us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.571141:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5100 00000100:00100000:0.0:1746144888.573506:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.577457:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.582530:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.584751:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.584871:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174958976 00000100:00100000:1.0:1746144888.584879:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174958976 00000100:00100000:1.0:1746144888.584924:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5101 00000100:00100000:1.0:1746144888.584933:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174958976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.584947:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.584965:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275144e2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93f46 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.585001:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af67275144db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f3f expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.585011:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.585013:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.585016:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275144e2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f46 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.585046:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af67275144db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f3f expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.585058:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af67275144db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f3f expref: 21 pid: 20722 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.585069:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172342144:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.585832:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144888.587531:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172342144:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.587558:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275144e2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f46 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.587573:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5fc00, rc 0) 00000100:00100000:1.0:1746144888.587606:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174958976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2675us (2860us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.587613:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5101 00000100:00100000:0.0:1746144888.588525:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.592687:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.593414:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174959488 00000100:00100000:1.0:1746144888.593419:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174959488 00000100:00100000:1.0:1746144888.593452:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5102 00000100:00100000:1.0:1746144888.593457:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+21:31565:x1830965174959488:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.593468:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.593483:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af67275144e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93f4d expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.593507:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275144e2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f46 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.593515:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.593516:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.593520:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af67275144e9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f4d expref: 22 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.593548:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275144e2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f46 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.593559:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5fc00/0x4076af67275144e2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f46 expref: 5 pid: 20722 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.593571:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172342400:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.593645:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144888.597208:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.597803:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172342400:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.597821:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af67275144e9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f4d expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.597828:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5f200, rc 0) 00000100:00100000:1.0:1746144888.597843:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+23:31565:x1830965174959488:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4387us (4475us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.597851:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5102 00000100:00100000:0.0:1746144888.599700:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.605262:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.605318:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174960000 00000100:00100000:1.0:1746144888.605327:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174960000 00002000:00100000:1.0:1746144888.605386:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925ab100 x1830965174960000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 488/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.605395:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab100 with x1830965174960000 ext(0->4095) 00010000:00010000:1.0:1746144888.605404:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af67275144e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f4d expref: 23 pid: 20722 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.605417:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af67275144e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f4d expref: 23 pid: 20722 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.605424:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925ab100 00000100:00100000:1.0:1746144888.605564:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1819 00000100:00100000:1.0:1746144888.605571:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965174960000:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144888.605758:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965174960000:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 186us (506us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144888.605785:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1819 00002000:00100000:1.0:1746144888.605790:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925ab100 x1830965174960000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 488/4536 e 0 to 0 dl 1746144899 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.605797:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab100 with x1830965174960000 ext(0->4095) 00010000:00010000:1.0:1746144888.605802:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af67275144e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f4d expref: 23 pid: 20722 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.605815:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5f200/0x4076af67275144e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f4d expref: 23 pid: 20722 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.605820:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925ab100 00000100:00100000:0.0:1746144888.610865:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.615854:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.619300:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.622481:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.626562:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.627847:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.632627:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.632673:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.636545:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.637459:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174961536 00000100:00100000:1.0:1746144888.637467:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174961536 00002000:00100000:1.0:1746144888.637506:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea8700 x1830965174961536/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 488/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.637516:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8700 with x1830965174961536 ext(0->4095) 00010000:00010000:1.0:1746144888.637524:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275144fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f62 expref: 23 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.637536:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275144fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f62 expref: 23 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.637542:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea8700 00000100:00100000:1.0:1746144888.637568:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1821 00000100:00100000:1.0:1746144888.637574:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965174961536:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144888.637747:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965174961536:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 173us (1207us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144888.637753:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1821 00002000:00100000:1.0:1746144888.637758:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea8700 x1830965174961536/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 488/4536 e 0 to 0 dl 1746144899 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.637778:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8700 with x1830965174961536 ext(0->4095) 00010000:00010000:1.0:1746144888.637784:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275144fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f62 expref: 23 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.637793:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275144fe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f62 expref: 23 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.637798:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea8700 00000100:00100000:0.0:1746144888.640759:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.645185:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.649088:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.653789:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.656735:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.659886:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.660516:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174962560 00000100:00100000:0.0:1746144888.660521:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174962560 00002000:00100000:0.0:1746144888.660559:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417df80 x1830965174962560/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144888.660570:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417df80 with x1830965174962560 ext(0->4095) 00010000:00010000:0.0:1746144888.660578:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751450c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f70 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:0.0:1746144888.660589:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751450c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f70 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:0.0:1746144888.660595:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417df80 00000100:00100000:0.0:1746144888.660620:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1822 00000100:00100000:0.0:1746144888.660627:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174962560:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144888.660804:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174962560:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 176us (922us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144888.660810:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1822 00002000:00100000:0.0:1746144888.660816:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417df80 x1830965174962560/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/4536 e 0 to 0 dl 1746144899 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144888.660822:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417df80 with x1830965174962560 ext(0->4095) 00010000:00010000:0.0:1746144888.660827:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751450c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f70 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:0.0:1746144888.660835:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751450c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f70 expref: 6 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:0.0:1746144888.660841:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417df80 00000100:00100000:0.0:1746144888.664946:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.668567:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.675127:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.685069:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.685514:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174963200 00000100:00100000:1.0:1746144888.685521:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174963200 00002000:00100000:1.0:1746144888.685554:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880135ea4000 x1830965174963200/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 496/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.685563:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4000 with x1830965174963200 ext(0->7) 00010000:00010000:1.0:1746144888.685569:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f77 expref: 22 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.685581:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f77 expref: 22 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.685587:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea4000 00000100:00100000:1.0:1746144888.685614:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1823 00000100:00100000:1.0:1746144888.685620:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1983:x1830965174963200:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144888.686996:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1983:x1830965174963200:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 1362us (1925us total) trans 4294967974 rc 0/0 00000100:00100000:1.0:1746144888.687005:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1823 00002000:00100000:1.0:1746144888.687015:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880135ea4000 x1830965174963200/t4294967974(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 496/448 e 0 to 0 dl 1746144899 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.687028:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4000 with x1830965174963200 ext(0->7) 00010000:00010000:1.0:1746144888.687036:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f77 expref: 24 pid: 8430 timeout: 582 lvb_type: 0 00010000:00010000:1.0:1746144888.687049:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514513 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f77 expref: 24 pid: 8430 timeout: 582 lvb_type: 0 00002000:00010000:1.0:1746144888.687054:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea4000 00000100:00100000:0.0:1746144888.696587:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.704891:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.706755:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.710858:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.710899:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.714421:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.718124:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.724994:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.730756:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.730837:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174964736 00000100:00100000:1.0:1746144888.730847:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174964736 00000100:00100000:1.0:1746144888.730910:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5112 00000100:00100000:1.0:1746144888.730919:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174964736:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.730937:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.730957:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af672751452f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93f93 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.731027:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514528 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f8c expref: 23 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.731036:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.731038:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.731041:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af672751452f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f93 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.731072:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514528 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f8c expref: 23 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.731088:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514528 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f8c expref: 23 pid: 8430 timeout: 582 lvb_type: 0 00000100:00100000:1.0:1746144888.731100:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172344960:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.731202:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144888.739102:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172344960:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.739143:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af672751452f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93f93 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.739163:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5480800, rc 0) 00000100:00100000:1.0:1746144888.739426:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174964736:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 8506us (8678us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.739436:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5112 00000100:00100000:0.0:1746144888.740459:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.748545:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.757213:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.761482:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.767210:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.771103:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.786332:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.798047:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.810233:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.817194:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.821967:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.825714:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.826016:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174966912 00000100:00100000:1.0:1746144888.826023:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174966912 00002000:00100000:1.0:1746144888.826064:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093443100 x1830965174966912/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 488/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.826074:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093443100 with x1830965174966912 ext(0->4095) 00002000:00010000:1.0:1746144888.826079:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093443100 00000100:00100000:1.0:1746144888.826107:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3844 00000100:00100000:1.0:1746144888.826114:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1982:x1830965174966912:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144888.826281:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1982:x1830965174966912:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 168us (578us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144888.826288:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3844 00002000:00100000:1.0:1746144888.826293:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093443100 x1830965174966912/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 488/4536 e 0 to 0 dl 1746144899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144888.826300:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093443100 with x1830965174966912 ext(0->4095) 00002000:00010000:1.0:1746144888.826304:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093443100 00000100:00100000:0.0:1746144888.839490:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.843259:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.850382:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.855308:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.857346:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174967552 00000100:00100000:0.0:1746144888.857359:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174967552 00002000:00100000:0.0:1746144888.857408:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801391d1880 x1830965174967552/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144888.857418:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d1880 with x1830965174967552 ext(0->4095) 00002000:00010000:0.0:1746144888.857424:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801391d1880 00000100:00100000:0.0:1746144888.857458:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3845 00000100:00100000:0.0:1746144888.857465:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174967552:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144888.857647:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174967552:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 182us (2340us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144888.857657:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3845 00002000:00100000:0.0:1746144888.857663:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801391d1880 x1830965174967552/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/4536 e 0 to 0 dl 1746144899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144888.857670:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d1880 with x1830965174967552 ext(0->4095) 00002000:00010000:0.0:1746144888.857673:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801391d1880 00000100:00100000:0.0:1746144888.860316:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.861525:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.861587:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174967680 00000100:00100000:1.0:1746144888.861600:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174967680 00000100:00100000:1.0:1746144888.861645:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174967808 00000100:00100000:1.0:1746144888.861648:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174967808 00000100:00100000:1.0:1746144888.861667:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5117 00000100:00100000:1.0:1746144888.861674:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31579:x1830965174967680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.861694:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.861709:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727514552 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93fb6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.861738:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af672751454b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93faf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.861746:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.861747:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.861750:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727514552 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93fb6 expref: 31 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.861803:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af672751454b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93faf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.861813:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af672751454b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93faf expref: 5 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144888.861824:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172346240:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144888.861897:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144888.864926:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172346240:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144888.865020:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5480400/0x4076af6727514552 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93fb6 expref: 31 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.865036:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5480400, rc 0) 00000100:00100000:1.0:1746144888.865086:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31579:x1830965174967680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3411us (4779us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.865093:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5117 00000100:00100000:0.0:1746144888.865560:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.869637:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.872851:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.873470:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.873837:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174968320 00000100:00100000:1.0:1746144888.873841:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174968320 00000100:00100000:1.0:1746144888.874240:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5119 00000100:00100000:1.0:1746144888.874246:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174968320:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.874259:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.874270:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727514560 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93fc4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.874286:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.874291:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514559 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93fbd expref: 30 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.874296:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.874299:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727514560 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93fc4 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.874335:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514559 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93fbd expref: 30 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.874347:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727514560 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93fc4 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.874354:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.874356:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144888.874361:0:8430:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514559 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93fbd expref: 30 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.874366:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514559 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93fbd expref: 30 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.874378:0:8430:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514559 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93fbd expref: 30 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.874388:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514559 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93fbd expref: 30 pid: 8432 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144888.874397:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172346752:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144888.874467:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144888.877371:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.877493:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172346752:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144888.877514:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5481a00, rc 0) 00000100:00100000:1.0:1746144888.877572:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174968320:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3325us (4727us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144888.877580:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5119 00000100:00100000:0.0:1746144888.880401:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.880506:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.880601:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174968832 00000100:00100000:1.0:1746144888.880609:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174968832 00000100:00100000:1.0:1746144888.880660:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5120 00000100:00100000:1.0:1746144888.880668:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31565:x1830965174968832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144888.880683:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144888.880700:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727514567 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93fcb expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.880727:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144888.880733:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727514560 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93fc4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.880739:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144888.880743:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727514567 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93fcb expref: 31 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.880810:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af6727514560 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93fc4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.880825:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af6727514567 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93fcb expref: 31 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144888.880835:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5481e00, rc 0) 00000100:00100000:0.0:1746144888.880896:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31565:x1830965174968832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 227us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144888.880903:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5120 00000100:00100000:0.0:1746144888.883886:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.892240:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.892299:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.902784:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.906204:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.911372:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.911506:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.922419:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.928510:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.933455:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.940932:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.943008:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.947109:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.950654:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.954212:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.956206:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.956271:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174971648 00000100:00100000:0.0:1746144888.956276:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174971648 00000100:00100000:0.0:1746144888.956299:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5126 00000100:00100000:0.0:1746144888.956304:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31579:x1830965174971648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144888.956312:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144888.956321:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727514591 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af93ff5 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144888.956335:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144888.956339:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751458a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93fee expref: 32 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144888.956344:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144888.956346:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727514591 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ff5 expref: 32 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144888.956367:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751458a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93fee expref: 32 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144888.956377:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727514591 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ff5 expref: 32 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144888.956391:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:0.0:1746144888.956561:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+32:31579:x1830965174971648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 255us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144888.956566:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5126 00000100:00100000:0.0:1746144888.959816:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.964305:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.969695:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.976282:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.978715:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.983364:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.987698:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.989218:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.989242:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174973056 00000100:00100000:0.0:1746144888.989246:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174973056 00002000:00100000:0.0:1746144888.989288:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a1f80 x1830965174973056/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144888.989297:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a1f80 with x1830965174973056 ext(0->4095) 00002000:00010000:0.0:1746144888.989302:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938a1f80 00000100:00100000:0.0:1746144888.989316:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3850 00000100:00100000:0.0:1746144888.989322:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174973056:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144888.989796:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174973056:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 472us (576us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144888.989801:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3850 00002000:00100000:0.0:1746144888.990110:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a1f80 x1830965174973056/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:529/0 lens 488/4536 e 0 to 0 dl 1746144899 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144888.990119:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a1f80 with x1830965174973056 ext(0->4095) 00010000:00010000:0.0:1746144888.990124:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514598 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ffc expref: 6 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:0.0:1746144888.990135:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514598 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af93ffc expref: 6 pid: 8430 timeout: 583 lvb_type: 0 00002000:00010000:0.0:1746144888.990140:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a1f80 00000100:00100000:0.0:1746144888.993594:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.993677:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144888.998174:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144888.998594:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174973568 00000100:00100000:0.0:1746144888.998600:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174973568 00002000:00100000:0.0:1746144888.998629:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932abb80 x1830965174973568/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 488/0 e 0 to 0 dl 1746144899 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144888.998637:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932abb80 with x1830965174973568 ext(0->4095) 00010000:00010000:0.0:1746144888.998643:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751459f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94003 expref: 31 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:0.0:1746144888.998654:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751459f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94003 expref: 31 pid: 8430 timeout: 583 lvb_type: 0 00002000:00010000:0.0:1746144888.998659:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932abb80 00000100:00100000:0.0:1746144888.998684:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1836 00000100:00100000:0.0:1746144888.998691:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965174973568:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144888.998854:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965174973568:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 162us (679us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144888.998861:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1836 00002000:00100000:0.0:1746144888.998866:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932abb80 x1830965174973568/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:529/0 lens 488/4536 e 0 to 0 dl 1746144899 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144888.998871:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932abb80 with x1830965174973568 ext(0->4095) 00010000:00010000:0.0:1746144888.998875:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751459f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94003 expref: 31 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:0.0:1746144888.998883:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751459f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94003 expref: 31 pid: 8430 timeout: 583 lvb_type: 0 00002000:00010000:0.0:1746144888.998888:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932abb80 00000100:00100000:1.0:1746144889.001341:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:1.0:1746144889.002933:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144889.007430:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.010206:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:1.0:1746144889.010718:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144889.013832:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.017562:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.017655:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.020322:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093256d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172349824:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144889.020350:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275145b4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94018 expref: 30 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144889.020362:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d200, rc 0) 00000100:00100000:0.0:1746144889.020809:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31565:x1830965174974464:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3057us (3247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144889.020816:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5131 00000100:00100000:0.0:1746144889.023596:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.023646:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.023878:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5132 00000100:00100000:0.0:1746144889.023886:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31579:x1830965174974720:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144889.023897:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144889.023907:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275145bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9401f expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144889.024066:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275145b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94018 expref: 31 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144889.024072:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144889.024074:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144889.024077:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275145bb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9401f expref: 31 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144889.024098:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275145b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94018 expref: 31 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144889.024107:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275145b4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70080400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94018 expref: 31 pid: 8430 timeout: 583 lvb_type: 0 00000100:00100000:0.0:1746144889.024117:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938a0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172349952:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144889.024187:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.028373:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.028547:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174975104 00000100:00100000:1.0:1746144889.028553:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174975104 00002000:00100000:1.0:1746144889.028586:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a1180 x1830965174975104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.028594:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a1180 with x1830965174975104 ext(0->4095) 00010000:00010000:1.0:1746144889.028601:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275145b4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94018 expref: 32 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.028611:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275145b4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94018 expref: 32 pid: 8430 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.028617:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a1180 00000100:00100000:1.0:1746144889.028639:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1838 00000100:00100000:1.0:1746144889.028946:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1984:x1830965174975104:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144889.029086:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1984:x1830965174975104:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 440us (720us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.029091:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1838 00002000:00100000:1.0:1746144889.029095:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a1180 x1830965174975104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.029102:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a1180 with x1830965174975104 ext(0->4095) 00010000:00010000:1.0:1746144889.029106:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275145b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94018 expref: 31 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.029115:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275145b4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94018 expref: 31 pid: 8430 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.029120:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a1180 00000100:00100000:0.0:1746144889.032220:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.037423:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.037685:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174975488 00000100:00100000:1.0:1746144889.037690:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174975488 00002000:00100000:1.0:1746144889.037724:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a2680 x1830965174975488/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.037733:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a2680 with x1830965174975488 ext(0->4095) 00002000:00010000:1.0:1746144889.037736:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938a2680 00000100:00100000:1.0:1746144889.038385:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3852 00000100:00100000:1.0:1746144889.038394:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1982:x1830965174975488:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144889.038674:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1982:x1830965174975488:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 280us (1249us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.038680:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3852 00002000:00100000:1.0:1746144889.038685:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a2680 x1830965174975488/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.038692:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a2680 with x1830965174975488 ext(0->4095) 00002000:00010000:1.0:1746144889.038695:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938a2680 00000100:00100000:0.0:1746144889.042656:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.046472:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.048032:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.052483:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.056911:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.061445:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.063425:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174976512 00000100:00100000:1.0:1746144889.063434:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174976512 00002000:00100000:1.0:1746144889.063472:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ea00 x1830965174976512/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.063481:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ea00 with x1830965174976512 ext(0->4095) 00002000:00010000:1.0:1746144889.063486:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ea00 00000100:00100000:1.0:1746144889.063513:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3853 00000100:00100000:1.0:1746144889.063520:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965174976512:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144889.063677:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965174976512:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 157us (2236us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.063683:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3853 00002000:00100000:1.0:1746144889.063688:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ea00 x1830965174976512/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.063694:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ea00 with x1830965174976512 ext(0->4095) 00002000:00010000:1.0:1746144889.063697:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ea00 00000100:00100000:0.0:1746144889.070895:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.074230:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.076654:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1746144889.076912:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275145d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94034 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.076921:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275145d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94034 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.076948:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275145d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94034 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144889.076958:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093255f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172350976:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144889.077027:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.081675:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093255f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172350976:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144889.081703:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144889.081746:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1982:x1830965174976896:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4921us (5095us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.081754:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10551 00000100:00100000:0.0:1746144889.084259:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.084303:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174977152 00000100:00100000:1.0:1746144889.084311:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174977152 00000100:00100000:0.0:1746144889.084311:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.084346:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174977280 00002000:00100000:1.0:1746144889.084348:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d367800 x1830965174977152/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1746144889.084350:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174977280 00002000:00100000:1.0:1746144889.084358:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d367800 with x1830965174977152 ext(0->4095) 00002000:00010000:1.0:1746144889.084363:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d367800 00000100:00100000:2.0:1746144889.084390:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5136 00000100:00100000:1.0:1746144889.084390:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3854 00000100:00100000:2.0:1746144889.084398:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31565:x1830965174977280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:1.0:1746144889.084398:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174977152:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00010000:00010000:2.0:1746144889.084409:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.084422:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275145d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9403b expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.084441:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275145d0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94034 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.084447:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.084449:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.084452:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275145d7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9403b expref: 32 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.084477:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275145d0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94034 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.084487:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275145d0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94034 expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.084499:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172351104:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.084693:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174977152:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 295us (439us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.084700:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3854 00002000:00100000:1.0:1746144889.084705:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d367800 x1830965174977152/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.084712:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d367800 with x1830965174977152 ext(0->4095) 00000100:00100000:2.0:1746144889.084714:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448000 going to sleep for 11 seconds 00010000:00010000:1.0:1746144889.084717:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275145d0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94034 expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.084728:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275145d0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94034 expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.084733:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d367800 00000100:00100000:0.0:1746144889.087864:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.087937:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172351104:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.087964:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275145d7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9403b expref: 32 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.087978:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:2.0:1746144889.088021:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+32:31565:x1830965174977280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3624us (3709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.088031:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5136 00000100:00100000:2.0:1746144889.088051:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174977408 00000100:00100000:2.0:1746144889.088055:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174977408 00000100:00100000:1.0:1746144889.088362:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5137 00000100:00100000:1.0:1746144889.088372:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+32:31579:x1830965174977408:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.088383:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.088395:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af67275145de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94042 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.088413:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.088417:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275145d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9403b expref: 33 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.088422:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.088425:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af67275145de lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94042 expref: 33 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.088450:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275145d7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9403b expref: 33 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.088459:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af67275145de lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94042 expref: 33 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.088465:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5481e00, rc 0) 00000100:00100000:1.0:1746144889.088480:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+33:31579:x1830965174977408:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 113us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.088486:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5137 00000100:00100000:0.0:1746144889.088748:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.091810:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.092193:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174977792 00000100:00100000:1.0:1746144889.092198:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174977792 00002000:00100000:1.0:1746144889.092225:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093854a80 x1830965174977792/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.092233:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854a80 with x1830965174977792 ext(0->4095) 00010000:00010000:1.0:1746144889.092239:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275145d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9403b expref: 33 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.092249:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275145d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9403b expref: 33 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.092255:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093854a80 00000100:00100000:1.0:1746144889.092276:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1841 00000100:00100000:1.0:1746144889.092281:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1984:x1830965174977792:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144889.092400:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1984:x1830965174977792:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 118us (591us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.092405:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1841 00002000:00100000:1.0:1746144889.092410:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093854a80 x1830965174977792/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.092416:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854a80 with x1830965174977792 ext(0->4095) 00010000:00010000:1.0:1746144889.092420:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275145d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9403b expref: 33 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.092432:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275145d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9403b expref: 33 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.092437:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093854a80 00000100:00100000:0.0:1746144889.094178:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.096998:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.099354:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.099411:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174978304 00000100:00100000:2.0:1746144889.099417:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174978304 00000100:00100000:2.0:1746144889.099584:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5138 00000100:00100000:2.0:1746144889.099592:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174978304:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.099605:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.099829:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275145e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94049 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.099856:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af67275145de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94042 expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.099862:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.099864:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.099867:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275145e5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94049 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.099895:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af67275145de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94042 expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.099906:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af67275145de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94042 expref: 31 pid: 10401 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.099918:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172351616:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.100898:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.102808:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172351616:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.102892:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275145e5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94049 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.102907:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:2.0:1746144889.102954:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174978304:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3363us (3602us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.102961:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5138 00000100:00100000:0.0:1746144889.103053:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.106276:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.106387:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174978688 00000100:00100000:2.0:1746144889.106393:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174978688 00002000:00100000:2.0:1746144889.106430:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925a9500 x1830965174978688/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.106438:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9500 with x1830965174978688 ext(0->4095) 00002000:00010000:2.0:1746144889.106442:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925a9500 00000100:00100000:2.0:1746144889.106456:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3856 00000100:00100000:2.0:1746144889.106462:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174978688:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144889.106589:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174978688:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 126us (313us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.106594:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3856 00002000:00100000:2.0:1746144889.106599:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925a9500 x1830965174978688/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.106605:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9500 with x1830965174978688 ext(0->4095) 00002000:00010000:2.0:1746144889.106607:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925a9500 00000100:00100000:0.0:1746144889.108356:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.108431:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.108487:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174978816 00000100:00100000:2.0:1746144889.108493:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174978816 00000100:00100000:2.0:1746144889.108537:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5139 00000100:00100000:2.0:1746144889.108545:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31565:x1830965174978816:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.108557:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144889.108558:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174978944 00000100:00100000:0.0:1746144889.108561:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174978944 00010000:00010000:2.0:1746144889.108571:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275145ec lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94050 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144889.108580:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5140 00000100:00100000:0.0:1746144889.108584:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+33:31579:x1830965174978944:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144889.108592:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.108593:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275145e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94049 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144889.108598:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275145f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94057 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.108604:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.108606:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.108609:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275145ec lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94050 expref: 33 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144889.108616:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144889.108620:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275145ec lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94050 expref: 34 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144889.108625:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144889.108627:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275145f3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94057 expref: 34 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.108960:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275145e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94049 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144889.108963:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275145ec lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94050 expref: 34 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.108971:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275145e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94049 expref: 5 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.108991:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172352000:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144889.108994:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275145f3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94057 expref: 34 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144889.109003:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:0.0:1746144889.109049:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+34:31579:x1830965174978944:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 464us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144889.109055:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5140 00000100:00100000:2.0:1746144889.109391:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.111655:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172352000:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.111681:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275145ec lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94050 expref: 33 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.111693:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:2.0:1746144889.111734:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+33:31565:x1830965174978816:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3189us (3382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.111740:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5139 00000100:00100000:0.0:1746144889.112638:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.117503:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.118074:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174979328 00000100:00100000:1.0:1746144889.118082:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174979328 00002000:00100000:1.0:1746144889.118115:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea8380 x1830965174979328/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.118125:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8380 with x1830965174979328 ext(0->4095) 00010000:00010000:1.0:1746144889.118132:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275145ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94050 expref: 33 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.118144:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275145ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94050 expref: 33 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.118150:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea8380 00000100:00100000:1.0:1746144889.118175:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1842 00000100:00100000:1.0:1746144889.118182:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1985:x1830965174979328:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144889.118324:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1985:x1830965174979328:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 142us (822us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.118330:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1842 00002000:00100000:1.0:1746144889.118336:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea8380 x1830965174979328/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.118342:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8380 with x1830965174979328 ext(0->4095) 00010000:00010000:1.0:1746144889.118347:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275145ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94050 expref: 33 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.118356:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275145ec lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94050 expref: 33 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.118361:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea8380 00000100:00100000:0.0:1746144889.121414:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.125079:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.125713:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174979712 00000100:00100000:2.0:1746144889.125720:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174979712 00002000:00100000:2.0:1746144889.125755:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b033100 x1830965174979712/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.125805:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033100 with x1830965174979712 ext(0->4095) 00002000:00010000:2.0:1746144889.125809:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b033100 00000100:00100000:2.0:1746144889.125894:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3857 00000100:00100000:2.0:1746144889.125901:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1985:x1830965174979712:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144889.126040:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1985:x1830965174979712:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 140us (963us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.126046:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3857 00002000:00100000:2.0:1746144889.126051:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b033100 x1830965174979712/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.126057:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033100 with x1830965174979712 ext(0->4095) 00002000:00010000:2.0:1746144889.126060:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b033100 00000100:00100000:0.0:1746144889.129647:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.129717:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174979840 00000100:00100000:2.0:1746144889.129726:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174979840 00000100:00100000:2.0:1746144889.129794:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5141 00000100:00100000:2.0:1746144889.129803:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174979840:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.129820:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.129916:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275145fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9405e expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.129941:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275145f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94057 expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.129947:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.129948:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.129952:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275145fa lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9405e expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.129978:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275145f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94057 expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.129997:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275145f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94057 expref: 31 pid: 10401 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.130009:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172352384:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.130553:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.131940:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172352384:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.131964:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275145fa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9405e expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.131976:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:2.0:1746144889.132013:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174979840:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2212us (2372us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.132020:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5141 00000100:00100000:0.0:1746144889.133196:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.135855:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.136245:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174980096 00000100:00100000:2.0:1746144889.136250:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174980096 00000100:00100000:2.0:1746144889.136280:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5142 00000100:00100000:2.0:1746144889.136286:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31565:x1830965174980096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.136299:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.136312:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514601 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94065 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.136338:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275145fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9405e expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.136344:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.136346:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.136348:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514601 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94065 expref: 32 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.136370:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275145fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9405e expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.136380:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275145fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9405e expref: 5 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.136389:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172352640:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.137295:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.138408:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.138490:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174980352 00000100:00100000:1.0:1746144889.138497:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174980352 00002000:00100000:1.0:1746144889.138537:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093256d80 x1830965174980352/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.138546:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256d80 with x1830965174980352 ext(0->4095) 00010000:00010000:1.0:1746144889.138554:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275145fa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9405e expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.138566:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275145fa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9405e expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.138572:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093256d80 00000100:00100000:1.0:1746144889.138866:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1843 00000100:00100000:2.0:1746144889.138869:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172352640:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.138874:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174980352:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00010000:00010000:2.0:1746144889.138972:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514601 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94065 expref: 32 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.138994:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:2.0:1746144889.139024:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+32:31565:x1830965174980096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2738us (3178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.139030:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5142 00000100:00100000:1.0:1746144889.139039:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174980352:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 165us (635us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.139045:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1843 00002000:00100000:1.0:1746144889.139050:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093256d80 x1830965174980352/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.139061:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256d80 with x1830965174980352 ext(0->4095) 00010000:00010000:1.0:1746144889.139065:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275145fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9405e expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.139074:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275145fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9405e expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.139079:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093256d80 00000100:00100000:0.0:1746144889.141564:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.145552:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.145590:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174980736 00000100:00100000:1.0:1746144889.145596:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174980736 00002000:00100000:1.0:1746144889.145625:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f73480 x1830965174980736/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.145634:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f73480 with x1830965174980736 ext(0->4095) 00002000:00010000:1.0:1746144889.145637:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f73480 00000100:00100000:1.0:1746144889.145659:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3858 00000100:00100000:1.0:1746144889.145665:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1984:x1830965174980736:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144889.145827:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1984:x1830965174980736:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 161us (276us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.145832:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3858 00002000:00100000:1.0:1746144889.145837:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f73480 x1830965174980736/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.145844:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f73480 with x1830965174980736 ext(0->4095) 00002000:00010000:1.0:1746144889.145847:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f73480 00000100:00100000:0.0:1746144889.163662:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.163846:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174980864 00000100:00100000:2.0:1746144889.163856:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174980864 00000100:00100000:2.0:1746144889.163912:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5143 00000100:00100000:2.0:1746144889.163920:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174980864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.165190:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.165208:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514608 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9406c expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.165236:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514601 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94065 expref: 31 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.165243:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.165245:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.165248:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514608 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9406c expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.165275:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514601 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94065 expref: 31 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.165287:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514601 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94065 expref: 31 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.165299:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172352896:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.166109:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.168334:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093255f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172352896:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.168370:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514608 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9406c expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.168390:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:2.0:1746144889.168427:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174980864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4509us (4774us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.168435:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5143 00000100:00100000:0.0:1746144889.170218:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.171314:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174980992 00000100:00100000:1.0:1746144889.171326:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174980992 00002000:00100000:1.0:1746144889.171366:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880092f72a00 x1830965174980992/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 496/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.171376:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f72a00 with x1830965174980992 ext(0->7) 00010000:00010000:1.0:1746144889.171383:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514601 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94065 expref: 32 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.171395:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514601 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94065 expref: 32 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.171401:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f72a00 00000100:00100000:1.0:1746144889.171431:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1844 00000100:00100000:1.0:1746144889.171437:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1985:x1830965174980992:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144889.171708:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1985:x1830965174980992:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 270us (1494us total) trans 4294967979 rc 0/0 00000100:00100000:1.0:1746144889.171713:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1844 00002000:00100000:1.0:1746144889.171719:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880092f72a00 x1830965174980992/t4294967979(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 496/448 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.171725:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f72a00 with x1830965174980992 ext(0->7) 00010000:00010000:1.0:1746144889.171729:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514601 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94065 expref: 34 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.171738:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514601 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94065 expref: 34 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.171746:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f72a00 00000100:00100000:0.0:1746144889.178570:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.184124:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.184238:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174981248 00000100:00100000:0.0:1746144889.184245:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174981248 00000100:00100000:0.0:1746144889.184857:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5144 00000100:00100000:0.0:1746144889.184864:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+34:31565:x1830965174981248:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144889.184879:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144889.184890:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751460f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94073 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144889.184911:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514608 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9406c expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144889.184917:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144889.184919:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144889.184921:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751460f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94073 expref: 35 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144889.184944:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514608 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9406c expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144889.184953:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514608 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9406c expref: 5 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:0.0:1746144889.184962:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172353152:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.185033:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.185567:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174981504 00000100:00100000:0.0:1746144889.185572:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174981504 00002000:00100000:0.0:1746144889.185594:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181c700 x1830965174981504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144889.185602:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181c700 with x1830965174981504 ext(0->4095) 00010000:00010000:0.0:1746144889.185607:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514608 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9406c expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:0.0:1746144889.185616:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514608 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9406c expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:0.0:1746144889.185621:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181c700 00000100:00100000:0.0:1746144889.185634:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1845 00000100:00100000:0.0:1746144889.185639:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174981504:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144889.185784:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174981504:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 143us (750us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144889.185789:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1845 00002000:00100000:0.0:1746144889.185793:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181c700 x1830965174981504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144889.185800:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181c700 with x1830965174981504 ext(0->4095) 00010000:00010000:0.0:1746144889.185803:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514608 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9406c expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:0.0:1746144889.185811:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514608 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9406c expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:0.0:1746144889.185816:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181c700 00000100:00100000:0.0:1746144889.188413:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.190480:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.194843:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.200001:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.203037:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.205585:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.210482:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.215382:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.215460:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.215495:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174982912 00000100:00100000:0.0:1746144889.215502:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174982912 00002000:00100000:0.0:1746144889.215537:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b462300 x1830965174982912/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144889.215545:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b462300 with x1830965174982912 ext(0->4095) 00002000:00010000:0.0:1746144889.215549:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b462300 00000100:00100000:0.0:1746144889.216136:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3860 00000100:00100000:0.0:1746144889.216143:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174982912:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144889.216260:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174982912:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 118us (885us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144889.216266:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3860 00002000:00100000:0.0:1746144889.216271:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b462300 x1830965174982912/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144889.216278:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b462300 with x1830965174982912 ext(0->4095) 00002000:00010000:0.0:1746144889.216281:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b462300 00000100:00100000:0.0:1746144889.220409:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.221715:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.226404:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.229159:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.233750:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.233841:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174983936 00000100:00100000:1.0:1746144889.233848:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174983936 00002000:00100000:1.0:1746144889.233886:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70a80 x1830965174983936/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.233895:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70a80 with x1830965174983936 ext(0->4095) 00002000:00010000:1.0:1746144889.233899:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f70a80 00000100:00100000:1.0:1746144889.233927:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3861 00000100:00100000:1.0:1746144889.233934:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1984:x1830965174983936:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144889.234691:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1984:x1830965174983936:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 756us (947us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.234697:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3861 00002000:00100000:1.0:1746144889.234703:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70a80 x1830965174983936/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.234709:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70a80 with x1830965174983936 ext(0->4095) 00002000:00010000:1.0:1746144889.234711:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f70a80 00000100:00100000:0.0:1746144889.237201:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.242427:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.245869:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.246416:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172354560:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144889.246430:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144889.246450:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1984:x1830965174984192:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3857us (4029us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.246459:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10565 00000100:00100000:0.0:1746144889.247820:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.248479:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174984576 00000100:00100000:1.0:1746144889.248484:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174984576 00002000:00100000:1.0:1746144889.248518:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093440e00 x1830965174984576/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.248526:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093440e00 with x1830965174984576 ext(0->4095) 00010000:00010000:1.0:1746144889.248532:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514632 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94096 expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.248546:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514632 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94096 expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.248551:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093440e00 00000100:00100000:1.0:1746144889.248579:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1848 00000100:00100000:1.0:1746144889.248586:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174984576:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144889.248734:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174984576:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 147us (915us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.248740:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1848 00002000:00100000:1.0:1746144889.248744:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093440e00 x1830965174984576/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.248750:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093440e00 with x1830965174984576 ext(0->4095) 00010000:00010000:1.0:1746144889.248755:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514632 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94096 expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.248784:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514632 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94096 expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.248789:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093440e00 00000100:00100000:0.0:1746144889.252046:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.255455:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.255547:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174984832 00000100:00100000:2.0:1746144889.255555:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174984832 00010000:00010000:2.0:1746144889.255586:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514632 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94096 expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.255622:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10566 00000100:00100000:2.0:1746144889.255629:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174984832:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144889.255642:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144889.255662:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514632 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94096 expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.255671:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514632 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94096 expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.255689:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514632 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94096 expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.255716:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.255717:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.255723:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514639 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9409d expref: 34 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.255730:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514639 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9409d expref: 34 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.255780:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514639 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9409d expref: 34 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.255791:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9409d expref: 34 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.255800:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b463100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172354944:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144889.255862:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.259040:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b463100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172354944:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144889.259062:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144889.259104:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965174984832:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3475us (3655us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.259113:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10566 00000100:00100000:0.0:1746144889.260073:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.260182:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174985088 00000100:00100000:2.0:1746144889.260386:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174985088 00002000:00100000:2.0:1746144889.260423:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac84380 x1830965174985088/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.260433:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac84380 with x1830965174985088 ext(0->4095) 00010000:00010000:2.0:1746144889.260441:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9409d expref: 35 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.260452:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9409d expref: 35 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.260457:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac84380 00000100:00100000:2.0:1746144889.260755:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1849 00000100:00100000:2.0:1746144889.260783:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1985:x1830965174985088:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144889.260936:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1985:x1830965174985088:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 172us (866us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.260942:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1849 00002000:00100000:2.0:1746144889.260947:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac84380 x1830965174985088/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.260954:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac84380 with x1830965174985088 ext(0->4095) 00010000:00010000:2.0:1746144889.260958:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9409d expref: 35 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.260967:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9409d expref: 35 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.260973:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac84380 00000100:00100000:0.0:1746144889.264452:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.264581:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174985216 00000100:00100000:2.0:1746144889.264590:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174985216 00010000:00010000:2.0:1746144889.264628:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9409d expref: 35 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.264703:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10567 00000100:00100000:2.0:1746144889.264865:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1985:x1830965174985216:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144889.264878:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144889.264902:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514639 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9409d expref: 35 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.264913:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514639 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9409d expref: 35 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.264931:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514639 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9409d expref: 35 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.264957:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.264959:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.264965:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514640 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940a4 expref: 34 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.264973:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514640 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940a4 expref: 34 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.265007:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514640 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940a4 expref: 34 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144889.265022:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b463100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172355072:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144889.265373:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.271469:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.271651:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b463100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172355072:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144889.271672:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144889.271995:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1985:x1830965174985216:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7283us (7549us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.272003:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10567 00000100:00100000:0.0:1746144889.275387:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.276009:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174985600 00000100:00100000:2.0:1746144889.276015:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174985600 00000100:00100000:0.0:1746144889.281147:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.281302:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.282045:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174985856 00000100:00100000:2.0:1746144889.282050:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174985856 00000100:00100000:2.0:1746144889.282081:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5153 00000100:00100000:2.0:1746144889.282087:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+34:31565:x1830965174985856:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.282098:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.282106:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751464e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af940b2 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.282121:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514647 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ab expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.282126:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.282128:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.282131:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751464e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940b2 expref: 35 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.282145:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ab expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.282155:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514647 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ab expref: 5 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.282164:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b463100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172355456:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.282199:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.284628:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b463100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172355456:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144889.284629:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1746144889.284661:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751464e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940b2 expref: 35 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.284677:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:2.0:1746144889.284846:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+35:31565:x1830965174985856:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2758us (3542us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.284854:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5153 00000100:00100000:1.0:1746144889.285084:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174986112 00000100:00100000:1.0:1746144889.285090:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174986112 00002000:00100000:1.0:1746144889.285118:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612d180 x1830965174986112/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.285126:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612d180 with x1830965174986112 ext(0->4095) 00010000:00010000:1.0:1746144889.285132:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ab expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.285142:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ab expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.285148:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612d180 00000100:00100000:1.0:1746144889.285366:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1850 00000100:00100000:1.0:1746144889.285374:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174986112:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144889.285509:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174986112:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 136us (885us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.285514:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1850 00002000:00100000:1.0:1746144889.285519:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612d180 x1830965174986112/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.285526:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612d180 with x1830965174986112 ext(0->4095) 00010000:00010000:1.0:1746144889.285530:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ab expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.285538:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514647 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ab expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.285543:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612d180 00000100:00100000:0.0:1746144889.288514:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.288599:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174986240 00000100:00100000:2.0:1746144889.288607:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174986240 00000100:00100000:2.0:1746144889.288644:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5154 00000100:00100000:2.0:1746144889.288652:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+34:31579:x1830965174986240:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.288667:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.288681:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514655 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af940b9 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.288701:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.288706:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751464e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940b2 expref: 35 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.288715:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.288718:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514655 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940b9 expref: 35 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.288745:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751464e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940b2 expref: 35 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.288756:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514655 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940b9 expref: 35 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.288785:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:2.0:1746144889.288830:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+35:31579:x1830965174986240:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 179us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.288836:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5154 00000100:00100000:2.0:1746144889.289911:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.293525:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.293744:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174986624 00000100:00100000:2.0:1746144889.293748:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174986624 00002000:00100000:2.0:1746144889.293791:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612df80 x1830965174986624/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.293799:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612df80 with x1830965174986624 ext(0->4095) 00010000:00010000:2.0:1746144889.293806:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751464e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940b2 expref: 35 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.293815:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751464e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940b2 expref: 35 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.293825:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612df80 00000100:00100000:2.0:1746144889.294958:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1851 00000100:00100000:2.0:1746144889.294969:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1984:x1830965174986624:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.295120:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1984:x1830965174986624:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 153us (1600us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.295125:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1851 00002000:00100000:2.0:1746144889.295130:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612df80 x1830965174986624/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.295136:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612df80 with x1830965174986624 ext(0->4095) 00010000:00010000:2.0:1746144889.295140:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751464e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940b2 expref: 35 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.295149:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751464e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940b2 expref: 35 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.295154:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612df80 00000100:00100000:0.0:1746144889.297689:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.302439:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.302505:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174987008 00000100:00100000:1.0:1746144889.302512:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174987008 00002000:00100000:1.0:1746144889.302546:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa3100 x1830965174987008/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.302559:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa3100 with x1830965174987008 ext(0->4095) 00002000:00010000:1.0:1746144889.302564:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa3100 00000100:00100000:1.0:1746144889.302587:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3863 00000100:00100000:1.0:1746144889.302592:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1985:x1830965174987008:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144889.302717:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1985:x1830965174987008:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 125us (285us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.302723:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3863 00002000:00100000:1.0:1746144889.302728:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa3100 x1830965174987008/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.302734:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa3100 with x1830965174987008 ext(0->4095) 00002000:00010000:1.0:1746144889.302736:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa3100 00000100:00100000:0.0:1746144889.305882:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.306144:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174987136 00000100:00100000:2.0:1746144889.306151:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174987136 00000100:00100000:2.0:1746144889.306193:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5155 00000100:00100000:2.0:1746144889.306200:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174987136:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.306214:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.306227:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751465c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af940c0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.306254:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514655 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940b9 expref: 33 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.306260:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.306261:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.306264:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751465c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940c0 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.306284:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514655 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940b9 expref: 33 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.306294:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514655 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940b9 expref: 33 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.306303:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b460e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172355968:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.306382:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.308626:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b460e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172355968:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.308653:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751465c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940c0 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.308665:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:2.0:1746144889.308705:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174987136:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2505us (2829us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.308712:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5155 00000100:00100000:0.0:1746144889.308977:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.314751:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.315544:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.316239:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174987520 00000100:00100000:2.0:1746144889.316243:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174987520 00000100:00100000:2.0:1746144889.316266:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5156 00000100:00100000:2.0:1746144889.316271:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+33:31565:x1830965174987520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.316278:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.316290:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514663 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af940c7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.316309:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751465c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940c0 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.316315:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.316316:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.316319:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514663 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940c7 expref: 34 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.316342:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751465c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940c0 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.316351:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751465c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940c0 expref: 5 pid: 8432 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.316362:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b460e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172356224:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.316403:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.319378:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.319513:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174987776 00000100:00100000:1.0:1746144889.319519:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174987776 00000100:00100000:1.0:1746144889.319550:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5157 00000100:00100000:1.0:1746144889.319556:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+35:31579:x1830965174987776:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.319572:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.319586:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af672751466a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af940ce expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.319606:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.319611:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514663 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940c7 expref: 36 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.319616:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.319620:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af672751466a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ce expref: 36 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.319647:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514663 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940c7 expref: 36 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.319658:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af672751466a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ce expref: 36 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.319666:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5481c00, rc 0) 00000100:00100000:1.0:1746144889.319697:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+36:31579:x1830965174987776:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 141us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.319701:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5157 00000100:00100000:2.0:1746144889.319852:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b460e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172356224:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.319870:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514663 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940c7 expref: 35 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.319882:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:2.0:1746144889.319899:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+35:31565:x1830965174987520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3629us (5156us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.319904:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5156 00000100:00100000:0.0:1746144889.321415:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.325247:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.325495:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174988160 00000100:00100000:1.0:1746144889.325500:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174988160 00002000:00100000:1.0:1746144889.325531:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d4000 x1830965174988160/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.325539:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d4000 with x1830965174988160 ext(0->4095) 00010000:00010000:1.0:1746144889.325546:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514663 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940c7 expref: 35 pid: 8432 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.325557:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514663 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940c7 expref: 35 pid: 8432 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.325563:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a2d4000 00000100:00100000:1.0:1746144889.325576:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1852 00000100:00100000:1.0:1746144889.325582:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1985:x1830965174988160:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144889.325706:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1985:x1830965174988160:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 123us (465us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.325711:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1852 00002000:00100000:1.0:1746144889.325716:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d4000 x1830965174988160/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.325722:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d4000 with x1830965174988160 ext(0->4095) 00010000:00010000:1.0:1746144889.325727:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514663 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940c7 expref: 35 pid: 8432 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.325735:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514663 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940c7 expref: 35 pid: 8432 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.325740:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a2d4000 00000100:00100000:0.0:1746144889.328102:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.331099:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.331346:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174988544 00000100:00100000:2.0:1746144889.331351:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174988544 00002000:00100000:2.0:1746144889.331380:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d4380 x1830965174988544/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.331389:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d4380 with x1830965174988544 ext(0->4095) 00002000:00010000:2.0:1746144889.331393:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a2d4380 00000100:00100000:2.0:1746144889.331534:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3865 00000100:00100000:2.0:1746144889.331540:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1985:x1830965174988544:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.331655:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1985:x1830965174988544:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 115us (562us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.331661:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3865 00002000:00100000:2.0:1746144889.331665:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d4380 x1830965174988544/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.331672:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d4380 with x1830965174988544 ext(0->4095) 00002000:00010000:2.0:1746144889.331674:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a2d4380 00000100:00100000:0.0:1746144889.334444:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.334551:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174988672 00000100:00100000:2.0:1746144889.334559:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174988672 00000100:00100000:2.0:1746144889.334600:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5158 00000100:00100000:2.0:1746144889.334606:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174988672:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.334624:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.334639:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514671 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af940d5 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.334663:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af672751466a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ce expref: 33 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.334670:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.334671:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.334674:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514671 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940d5 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.334697:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af672751466a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ce expref: 33 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.334707:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481c00/0x4076af672751466a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ce expref: 33 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.334717:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b460e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172356736:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.334808:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.336916:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.337009:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b460e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172356736:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.337042:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514671 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940d5 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.337057:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:2.0:1746144889.337650:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174988672:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3043us (3211us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.337660:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5158 00000100:00100000:0.0:1746144889.343258:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.343337:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174989056 00000100:00100000:2.0:1746144889.343345:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174989056 00002000:00100000:2.0:1746144889.343379:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d4e00 x1830965174989056/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.343388:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d4e00 with x1830965174989056 ext(0->4095) 00002000:00010000:2.0:1746144889.343391:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a2d4e00 00000100:00100000:0.0:1746144889.343570:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.343598:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174989184 00000100:00100000:2.0:1746144889.343602:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174989184 00000100:00100000:2.0:1746144889.343622:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5159 00000100:00100000:2.0:1746144889.343629:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+33:31565:x1830965174989184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.343641:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.343894:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514678 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af940dc expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.343916:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514671 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940d5 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.343922:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.343923:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.343926:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514678 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940dc expref: 34 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.343948:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514671 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940d5 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.343957:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514671 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940d5 expref: 5 pid: 10401 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.343969:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b460e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172356992:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.344024:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.347162:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.347246:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174989312 00000100:00100000:2.0:1746144889.347257:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174989312 00000100:00100000:2.0:1746144889.347611:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5160 00000100:00100000:2.0:1746144889.347620:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+35:31579:x1830965174989312:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.347635:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.347650:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af672751467f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af940e3 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.347671:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.347675:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514678 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940dc expref: 36 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.347680:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.347683:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af672751467f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940e3 expref: 36 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.347710:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514678 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940dc expref: 36 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.347720:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af672751467f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940e3 expref: 36 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.347727:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:2.0:1746144889.347801:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+36:31579:x1830965174989312:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 183us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.347807:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5160 00000100:00100000:2.0:1746144889.349608:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b460e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172356992:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.349629:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514678 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940dc expref: 35 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.349640:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:2.0:1746144889.349663:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+35:31565:x1830965174989184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6035us (6094us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.349669:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5159 00000100:00100000:0.0:1746144889.351208:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.354598:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.354730:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174989696 00000100:00100000:2.0:1746144889.354735:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174989696 00002000:00100000:2.0:1746144889.354793:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d5c00 x1830965174989696/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.354803:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d5c00 with x1830965174989696 ext(0->4095) 00010000:00010000:2.0:1746144889.354809:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514678 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940dc expref: 35 pid: 10401 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.354821:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514678 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940dc expref: 35 pid: 10401 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.354827:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a2d5c00 00000100:00100000:2.0:1746144889.354848:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1853 00000100:00100000:2.0:1746144889.354854:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1984:x1830965174989696:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.354990:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1984:x1830965174989696:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 136us (392us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.354996:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1853 00002000:00100000:2.0:1746144889.355001:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d5c00 x1830965174989696/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.355008:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d5c00 with x1830965174989696 ext(0->4095) 00010000:00010000:2.0:1746144889.355013:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514678 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940dc expref: 35 pid: 10401 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.355021:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514678 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940dc expref: 35 pid: 10401 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.355027:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a2d5c00 00000100:00100000:0.0:1746144889.357408:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.361814:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.364885:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.365389:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174990208 00000100:00100000:2.0:1746144889.365397:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174990208 00000100:00100000:2.0:1746144889.365616:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5161 00000100:00100000:2.0:1746144889.365623:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174990208:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.365637:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.365650:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514686 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af940ea expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.365671:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af672751467f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940e3 expref: 33 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.365678:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.365679:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.365682:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514686 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ea expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.365709:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af672751467f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940e3 expref: 33 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.365718:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af672751467f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940e3 expref: 33 pid: 8432 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.365728:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b460e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172357504:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.366345:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.367715:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b460e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172357504:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.367740:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514686 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ea expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.367754:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:2.0:1746144889.367807:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174990208:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2184us (2926us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.367813:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5161 00000100:00100000:0.0:1746144889.369455:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.371566:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.371621:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174990464 00000100:00100000:2.0:1746144889.371626:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174990464 00000100:00100000:2.0:1746144889.372538:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5162 00000100:00100000:2.0:1746144889.372547:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+34:31565:x1830965174990464:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.372562:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.372574:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751468d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af940f1 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.372597:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514686 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ea expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.372604:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.372605:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.372608:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751468d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940f1 expref: 35 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.372629:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514686 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ea expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.372638:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514686 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ea expref: 5 pid: 10401 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.372647:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b460e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172357760:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.372991:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.376488:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.378475:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174990720 00000100:00100000:2.0:1746144889.378481:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174990720 00002000:00100000:2.0:1746144889.378509:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d7100 x1830965174990720/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.378517:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d7100 with x1830965174990720 ext(0->4095) 00010000:00010000:2.0:1746144889.378523:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514686 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ea expref: 6 pid: 10401 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.378532:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514686 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ea expref: 6 pid: 10401 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.378537:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a2d7100 00000100:00100000:0.0:1746144889.381926:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.386788:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.387009:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174991104 00000100:00100000:2.0:1746144889.387014:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174991104 00002000:00100000:2.0:1746144889.387045:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d7800 x1830965174991104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.387053:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d7800 with x1830965174991104 ext(0->4095) 00002000:00010000:2.0:1746144889.387057:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a2d7800 00000100:00100000:2.0:1746144889.387067:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3868 00000100:00100000:2.0:1746144889.387072:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1985:x1830965174991104:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144889.387651:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1985:x1830965174991104:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 578us (890us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.387657:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3868 00002000:00100000:2.0:1746144889.387662:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d7800 x1830965174991104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.387668:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d7800 with x1830965174991104 ext(0->4095) 00002000:00010000:2.0:1746144889.387670:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a2d7800 00000100:00100000:0.0:1746144889.409816:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.409887:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174991232 00000100:00100000:2.0:1746144889.409894:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174991232 00000100:00100000:2.0:1746144889.409935:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5163 00000100:00100000:2.0:1746144889.409943:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174991232:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.409957:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.409971:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514694 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af940f8 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.410005:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751468d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940f1 expref: 33 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.410016:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.410018:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.410020:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514694 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940f8 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.410044:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751468d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940f1 expref: 33 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.410054:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751468d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940f1 expref: 33 pid: 10401 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.410064:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b463b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172358016:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.410125:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.415607:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b463b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172358016:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.415638:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514694 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940f8 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.415653:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:2.0:1746144889.415690:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174991232:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5749us (5881us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.415697:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5163 00000100:00100000:0.0:1746144889.417352:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.435493:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.445084:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.445169:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174991616 00000100:00100000:2.0:1746144889.445176:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174991616 00000100:00100000:2.0:1746144889.445228:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5164 00000100:00100000:2.0:1746144889.445235:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+36:31565:x1830965174991616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.445251:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.445265:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751469b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af940ff expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.445292:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514694 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940f8 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.445298:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.445299:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.445302:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751469b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ff expref: 37 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.445328:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514694 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940f8 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.445338:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514694 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940f8 expref: 5 pid: 10401 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.445349:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b463b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172358272:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.445412:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.447962:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.449122:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174991872 00000100:00100000:2.0:1746144889.449128:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174991872 00002000:00100000:2.0:1746144889.449160:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f384a80 x1830965174991872/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.449169:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f384a80 with x1830965174991872 ext(0->4095) 00010000:00010000:2.0:1746144889.449175:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514694 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940f8 expref: 6 pid: 10401 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.449188:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514694 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940f8 expref: 6 pid: 10401 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.449194:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f384a80 00000100:00100000:2.0:1746144889.449216:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1856 00000100:00100000:2.0:1746144889.449225:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174991872:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.450014:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f384a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174991872:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 789us (2057us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.450022:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1856 00002000:00100000:2.0:1746144889.450027:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f384a80 x1830965174991872/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.450035:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f384a80 with x1830965174991872 ext(0->4095) 00010000:00010000:2.0:1746144889.450039:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514694 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940f8 expref: 6 pid: 10401 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.450048:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514694 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940f8 expref: 6 pid: 10401 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.450053:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f384a80 00000100:00100000:0.0:1746144889.453605:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.456994:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.457105:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174992256 00000100:00100000:2.0:1746144889.457111:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174992256 00002000:00100000:2.0:1746144889.457144:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f384e00 x1830965174992256/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.457152:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f384e00 with x1830965174992256 ext(0->4095) 00002000:00010000:2.0:1746144889.457157:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f384e00 00000100:00100000:2.0:1746144889.457172:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3869 00000100:00100000:2.0:1746144889.457178:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1985:x1830965174992256:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144889.458650:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1985:x1830965174992256:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1467us (1651us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.458658:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3869 00002000:00100000:2.0:1746144889.458667:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f384e00 x1830965174992256/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.458674:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f384e00 with x1830965174992256 ext(0->4095) 00002000:00010000:2.0:1746144889.458678:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f384e00 00000100:00100000:0.0:1746144889.476126:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.487714:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.487940:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174992512 00000100:00100000:2.0:1746144889.487948:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174992512 00002000:00100000:2.0:1746144889.488000:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008f385500 x1830965174992512/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 496/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.488009:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f385500 with x1830965174992512 ext(0->7) 00010000:00010000:2.0:1746144889.488016:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751469b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ff expref: 36 pid: 10401 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.488027:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751469b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ff expref: 36 pid: 10401 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.488033:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f385500 00000100:00100000:2.0:1746144889.488058:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1857 00000100:00100000:2.0:1746144889.488065:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1985:x1830965174992512:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144889.488629:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1985:x1830965174992512:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 260us (617us total) trans 4294967981 rc 0/0 00000100:00100000:2.0:1746144889.488636:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1857 00002000:00100000:2.0:1746144889.488642:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008f385500 x1830965174992512/t4294967981(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 496/448 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.488649:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f385500 with x1830965174992512 ext(0->7) 00010000:00010000:2.0:1746144889.488654:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751469b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ff expref: 38 pid: 10401 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.488662:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751469b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af940ff expref: 38 pid: 10401 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.488668:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f385500 00000100:00100000:0.0:1746144889.491635:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.494887:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.497321:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.502016:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.502220:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174993152 00000100:00100000:1.0:1746144889.502228:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174993152 00000100:00100000:1.0:1746144889.502274:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5167 00000100:00100000:1.0:1746144889.502281:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+39:31565:x1830965174993152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.502301:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.502317:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af67275146b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94114 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.502337:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.502341:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275146a9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9410d expref: 40 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.502346:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.502349:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af67275146b0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94114 expref: 40 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.502377:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275146a9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9410d expref: 40 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.502386:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af67275146b0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94114 expref: 40 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.502393:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5480800, rc 0) 00000100:00100000:1.0:1746144889.502411:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+40:31565:x1830965174993152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 130us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.502416:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5167 00000100:00100000:0.0:1746144889.503170:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1746144889.503922:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275146a9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9410d expref: 38 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.503932:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275146a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9410d expref: 38 pid: 10401 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.503942:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b463b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172359040:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144889.504018:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e92e780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.505702:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b463b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172359040:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144889.505718:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144889.505754:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f386680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965174993280:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2300us (2583us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.505797:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10582 00000100:00100000:0.0:1746144889.505939:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.506005:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174993536 00000100:00100000:2.0:1746144889.506010:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174993536 00002000:00100000:2.0:1746144889.506040:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f386a00 x1830965174993536/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.506048:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f386a00 with x1830965174993536 ext(0->4095) 00010000:00010000:2.0:1746144889.506053:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275146a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9410d expref: 39 pid: 10401 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.506062:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275146a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9410d expref: 39 pid: 10401 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.506092:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f386a00 00000100:00100000:2.0:1746144889.506115:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1858 00000100:00100000:2.0:1746144889.506122:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1984:x1830965174993536:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.506315:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1984:x1830965174993536:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 194us (375us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.506321:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1858 00002000:00100000:2.0:1746144889.506325:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f386a00 x1830965174993536/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.506331:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f386a00 with x1830965174993536 ext(0->4095) 00010000:00010000:2.0:1746144889.506335:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275146a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9410d expref: 39 pid: 10401 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.506344:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275146a9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9410d expref: 39 pid: 10401 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.506349:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f386a00 00000100:00100000:0.0:1746144889.507948:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.508019:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.508029:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174993664 00000100:00100000:2.0:1746144889.508034:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174993664 00000100:00100000:2.0:1746144889.508119:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5168 00000100:00100000:2.0:1746144889.508127:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174993664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.508139:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.508151:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275146b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9411b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.508170:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.508174:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af67275146b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94114 expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.508179:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144889.508181:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275146b7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9411b expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.508209:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af67275146b0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94114 expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.508220:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275146b7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9411b expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.508228:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:2.0:1746144889.508266:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174993664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 141us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.508271:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5168 00000100:00100000:0.0:1746144889.510448:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.510514:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174994048 00000100:00100000:2.0:1746144889.510518:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174994048 00002000:00100000:2.0:1746144889.510549:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f387480 x1830965174994048/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.510557:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f387480 with x1830965174994048 ext(0->4095) 00010000:00010000:2.0:1746144889.510563:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af67275146b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94114 expref: 38 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.510578:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af67275146b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94114 expref: 38 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.510584:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f387480 00000100:00100000:2.0:1746144889.510609:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1859 00000100:00100000:2.0:1746144889.510616:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1984:x1830965174994048:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.510756:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1984:x1830965174994048:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 140us (308us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.510780:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1859 00002000:00100000:2.0:1746144889.510785:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f387480 x1830965174994048/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.510791:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f387480 with x1830965174994048 ext(0->4095) 00010000:00010000:2.0:1746144889.510795:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af67275146b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94114 expref: 38 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.510803:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5480800/0x4076af67275146b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94114 expref: 38 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.510808:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f387480 00000100:00100000:0.0:1746144889.512146:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.512210:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.512261:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174994304 00000100:00100000:2.0:1746144889.512264:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174994304 00000100:00100000:2.0:1746144889.512283:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5169 00000100:00100000:2.0:1746144889.512288:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+39:31565:x1830965174994304:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.512297:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.512307:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275146be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94122 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.512325:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.512329:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275146b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9411b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.512334:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144889.512336:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275146be lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94122 expref: 40 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.512471:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275146b7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9411b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.512645:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275146be lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94122 expref: 39 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.512653:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:2.0:1746144889.512687:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+39:31565:x1830965174994304:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 398us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.512692:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5169 00000100:00100000:0.0:1746144889.515201:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.518433:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.521394:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.523363:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.523503:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174995072 00000100:00100000:2.0:1746144889.523509:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174995072 00000100:00100000:2.0:1746144889.523540:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5170 00000100:00100000:2.0:1746144889.523546:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174995072:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.523558:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.523570:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275146c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94129 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.523594:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275146be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94122 expref: 37 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.523600:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.523602:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.523605:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275146c5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94129 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.523629:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275146be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94122 expref: 37 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.523639:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275146be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94122 expref: 37 pid: 10401 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.523648:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b463b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172359808:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.523718:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.526001:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b463b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172359808:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.526027:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275146c5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94129 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.526039:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:2.0:1746144889.526069:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174995072:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2522us (2708us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.526075:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5170 00000100:00100000:0.0:1746144889.526286:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.529790:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.529953:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174995456 00000100:00100000:2.0:1746144889.529960:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174995456 00002000:00100000:2.0:1746144889.530012:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091684e00 x1830965174995456/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.530020:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091684e00 with x1830965174995456 ext(0->4095) 00002000:00010000:2.0:1746144889.530025:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091684e00 00000100:00100000:2.0:1746144889.530043:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3872 00000100:00100000:2.0:1746144889.530049:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174995456:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.530188:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174995456:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 139us (432us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.530194:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3872 00002000:00100000:2.0:1746144889.530199:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091684e00 x1830965174995456/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.530205:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091684e00 with x1830965174995456 ext(0->4095) 00002000:00010000:2.0:1746144889.530208:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091684e00 00000100:00100000:0.0:1746144889.532055:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.532130:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174995584 00000100:00100000:2.0:1746144889.532136:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174995584 00000100:00100000:2.0:1746144889.532467:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5171 00000100:00100000:2.0:1746144889.532474:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+37:31565:x1830965174995584:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.532487:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.532499:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275146cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94130 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.532526:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275146c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94129 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.532532:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.532534:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.532537:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275146cc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94130 expref: 38 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.532561:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275146c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94129 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.532571:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275146c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94129 expref: 5 pid: 10401 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.532581:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b463b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172360064:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.532656:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.534275:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.534374:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.534453:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b463b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172360064:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.534478:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275146cc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94130 expref: 38 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.534490:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:2.0:1746144889.534522:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+38:31565:x1830965174995584:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2048us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.534529:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5171 00000100:00100000:2.0:1746144889.534548:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174995712 00000100:00100000:2.0:1746144889.534552:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174995712 00000100:00100000:2.0:1746144889.534572:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5172 00000100:00100000:2.0:1746144889.534576:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+38:31579:x1830965174995712:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.534585:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.534594:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275146d3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94137 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.534607:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.534611:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275146cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94130 expref: 39 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.534616:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.534618:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275146d3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94137 expref: 39 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.534637:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275146cc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94130 expref: 39 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.534646:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275146d3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94137 expref: 39 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.534653:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:2.0:1746144889.534666:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+39:31579:x1830965174995712:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 90us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.534671:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5172 00000100:00100000:0.0:1746144889.537758:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.537811:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174996096 00000100:00100000:2.0:1746144889.537816:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174996096 00002000:00100000:2.0:1746144889.537846:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091685500 x1830965174996096/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.537860:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091685500 with x1830965174996096 ext(0->4095) 00010000:00010000:2.0:1746144889.537866:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275146cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94130 expref: 39 pid: 10401 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.537877:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275146cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94130 expref: 39 pid: 10401 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.537883:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091685500 00000100:00100000:2.0:1746144889.537902:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1861 00000100:00100000:2.0:1746144889.537909:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1984:x1830965174996096:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.538054:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1984:x1830965174996096:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 146us (296us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.538060:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1861 00002000:00100000:2.0:1746144889.538065:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091685500 x1830965174996096/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.538071:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091685500 with x1830965174996096 ext(0->4095) 00010000:00010000:2.0:1746144889.538075:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275146cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94130 expref: 39 pid: 10401 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.538084:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275146cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94130 expref: 39 pid: 10401 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.538089:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091685500 00000100:00100000:0.0:1746144889.540596:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.543373:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.543554:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174996480 00000100:00100000:2.0:1746144889.543559:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174996480 00002000:00100000:2.0:1746144889.543589:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091685c00 x1830965174996480/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.543596:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091685c00 with x1830965174996480 ext(0->4095) 00002000:00010000:2.0:1746144889.543601:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091685c00 00000100:00100000:2.0:1746144889.543625:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3873 00000100:00100000:2.0:1746144889.543632:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1985:x1830965174996480:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144889.543785:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1985:x1830965174996480:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 153us (415us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.543790:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3873 00002000:00100000:2.0:1746144889.543795:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091685c00 x1830965174996480/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.543802:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091685c00 with x1830965174996480 ext(0->4095) 00002000:00010000:2.0:1746144889.543805:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091685c00 00000100:00100000:0.0:1746144889.546747:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.546862:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174996608 00000100:00100000:1.0:1746144889.546870:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174996608 00000100:00100000:1.0:1746144889.546898:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5173 00000100:00100000:1.0:1746144889.546905:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174996608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.546918:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.546931:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af67275146da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9413e expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.546954:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275146d3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94137 expref: 37 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.546960:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.546961:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.546965:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af67275146da lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9413e expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.546998:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275146d3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94137 expref: 37 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.547008:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275146d3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94137 expref: 37 pid: 10401 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.547019:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172360576:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.547209:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.549002:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172360576:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.549025:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af67275146da lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9413e expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.549038:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5481800, rc 0) 00000100:00100000:1.0:1746144889.549067:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174996608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2161us (2325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.549073:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5173 00000100:00100000:0.0:1746144889.550189:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.555161:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.555324:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174996864 00000100:00100000:1.0:1746144889.555333:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174996864 00000100:00100000:1.0:1746144889.555371:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5174 00000100:00100000:1.0:1746144889.555377:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:31565:x1830965174996864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.555393:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.555408:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af67275146e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94145 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.555434:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af67275146da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9413e expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.555440:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.555442:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.555444:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af67275146e1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94145 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.555470:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af67275146da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9413e expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.555480:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af67275146da lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9413e expref: 5 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.555490:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172360832:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.555561:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.555680:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.555742:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174997120 00000100:00100000:2.0:1746144889.555746:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174997120 00002000:00100000:2.0:1746144889.555800:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091686a00 x1830965174997120/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.555809:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091686a00 with x1830965174997120 ext(0->4095) 00010000:00010000:2.0:1746144889.555815:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af67275146da lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9413e expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.555825:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af67275146da lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9413e expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.555835:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091686a00 00000100:00100000:2.0:1746144889.555872:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1862 00000100:00100000:2.0:1746144889.555879:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174997120:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144889.556013:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965174997120:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 135us (333us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.556018:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1862 00002000:00100000:2.0:1746144889.556023:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091686a00 x1830965174997120/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.556029:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091686a00 with x1830965174997120 ext(0->4095) 00010000:00010000:2.0:1746144889.556033:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af67275146da lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9413e expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.556041:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481800/0x4076af67275146da lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9413e expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.556045:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091686a00 00000100:00100000:1.0:1746144889.559449:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172360832:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.559477:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af67275146e1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94145 expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.559492:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5481e00, rc 0) 00000100:00100000:1.0:1746144889.559537:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:31565:x1830965174996864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4159us (4383us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.559544:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5174 00000100:00100000:0.0:1746144889.560055:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.560152:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.560725:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174997248 00000100:00100000:1.0:1746144889.560730:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174997248 00000100:00100000:1.0:1746144889.561015:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5175 00000100:00100000:1.0:1746144889.561023:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009969b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:31579:x1830965174997248:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.561035:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.561044:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af67275146e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9414c expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.561059:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af67275146e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94145 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.561065:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.561066:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.561069:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af67275146e8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9414c expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.561085:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af67275146e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94145 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.561093:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af67275146e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94145 expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.561100:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172361088:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.561629:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.564202:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.564297:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172361088:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.564322:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af67275146e8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9414c expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.564339:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5481a00, rc 0) 00000100:00100000:1.0:1746144889.564374:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009969b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+39:31579:x1830965174997248:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3352us (4320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.564381:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5175 00000100:00100000:2.0:1746144889.564566:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174997632 00000100:00100000:2.0:1746144889.564572:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174997632 00002000:00100000:2.0:1746144889.564605:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091687100 x1830965174997632/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.564613:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091687100 with x1830965174997632 ext(0->4095) 00010000:00010000:2.0:1746144889.564619:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af67275146e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94145 expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.564632:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af67275146e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94145 expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.564637:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091687100 00000100:00100000:2.0:1746144889.564651:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1863 00000100:00100000:2.0:1746144889.564657:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1984:x1830965174997632:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.564800:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1984:x1830965174997632:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 143us (604us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.564806:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1863 00002000:00100000:2.0:1746144889.564811:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091687100 x1830965174997632/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.564817:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091687100 with x1830965174997632 ext(0->4095) 00010000:00010000:2.0:1746144889.564821:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af67275146e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94145 expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.564829:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a5481e00/0x4076af67275146e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94145 expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.564835:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091687100 00000100:00100000:0.0:1746144889.568537:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.573894:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.574332:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174998016 00000100:00100000:2.0:1746144889.574339:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174998016 00002000:00100000:2.0:1746144889.574374:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091687800 x1830965174998016/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.574383:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091687800 with x1830965174998016 ext(0->4095) 00002000:00010000:2.0:1746144889.574387:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091687800 00000100:00100000:2.0:1746144889.574414:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3874 00000100:00100000:2.0:1746144889.574421:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1985:x1830965174998016:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144889.574564:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1985:x1830965174998016:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 143us (674us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.574570:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3874 00002000:00100000:2.0:1746144889.574575:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091687800 x1830965174998016/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.574582:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091687800 with x1830965174998016 ext(0->4095) 00002000:00010000:2.0:1746144889.574584:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091687800 00000100:00100000:0.0:1746144889.576099:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.576332:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174998144 00000100:00100000:1.0:1746144889.576337:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174998144 00000100:00100000:1.0:1746144889.576360:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5176 00000100:00100000:1.0:1746144889.576364:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174998144:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.576376:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.576388:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af67275146ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94153 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.576409:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af67275146e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9414c expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.576415:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.576417:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.576419:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af67275146ef lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94153 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.576440:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af67275146e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9414c expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.576448:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a5481a00/0x4076af67275146e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9414c expref: 37 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.576462:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172361344:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.576526:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.578008:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172361344:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.578028:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af67275146ef lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94153 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.578040:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099312600, rc 0) 00000100:00100000:1.0:1746144889.578078:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174998144:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1712us (1983us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.578084:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5176 00000100:00100000:0.0:1746144889.579180:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.583291:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.583549:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174998528 00000100:00100000:1.0:1746144889.583557:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174998528 00002000:00100000:1.0:1746144889.583591:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091685180 x1830965174998528/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.583600:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091685180 with x1830965174998528 ext(0->4095) 00002000:00010000:1.0:1746144889.583604:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091685180 00000100:00100000:1.0:1746144889.583619:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3875 00000100:00100000:1.0:1746144889.583624:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174998528:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144889.583754:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965174998528:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 129us (471us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.583774:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3875 00002000:00100000:1.0:1746144889.583779:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091685180 x1830965174998528/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.583790:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091685180 with x1830965174998528 ext(0->4095) 00002000:00010000:1.0:1746144889.583793:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091685180 00000100:00100000:0.0:1746144889.584090:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.584943:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174998656 00000100:00100000:1.0:1746144889.584948:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174998656 00000100:00100000:1.0:1746144889.584975:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5177 00000100:00100000:1.0:1746144889.584989:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+37:31565:x1830965174998656:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.584999:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.585010:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275146f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9415a expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.585031:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af67275146ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94153 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.585037:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.585038:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.585041:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275146f6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9415a expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.585062:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af67275146ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94153 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.585072:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099312600/0x4076af67275146ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94153 expref: 5 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.585082:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172361600:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.586245:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.588646:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.588874:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172361600:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.588897:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275146f6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9415a expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.588911:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a41ec400, rc 0) 00000100:00100000:1.0:1746144889.588957:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:31565:x1830965174998656:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3967us (4866us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.588964:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5177 00000100:00100000:1.0:1746144889.589579:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174998784 00000100:00100000:1.0:1746144889.589584:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174998784 00000100:00100000:1.0:1746144889.589621:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5178 00000100:00100000:1.0:1746144889.589627:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:31579:x1830965174998784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.589638:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.589649:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af67275146fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94161 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.589665:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.589669:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275146f6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9415a expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.589674:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.589677:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af67275146fd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94161 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.589700:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275146f6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9415a expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.589709:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af67275146fd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94161 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.589716:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099312e00, rc 0) 00000100:00100000:1.0:1746144889.589742:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+39:31579:x1830965174998784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 115us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.589746:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5178 00000100:00100000:0.0:1746144889.590078:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1746144889.594318:0:7101:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144889.594513:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.594579:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174999168 00000100:00100000:2.0:1746144889.594585:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174999168 00002000:00100000:2.0:1746144889.594616:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091684a80 x1830965174999168/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.594622:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091684a80 with x1830965174999168 ext(0->4095) 00010000:00010000:2.0:1746144889.594628:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275146f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9415a expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.594636:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275146f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9415a expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.594640:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091684a80 00000100:00100000:2.0:1746144889.594960:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1864 00000100:00100000:2.0:1746144889.594967:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1984:x1830965174999168:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.595119:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1984:x1830965174999168:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 152us (608us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.595124:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1864 00002000:00100000:2.0:1746144889.595135:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091684a80 x1830965174999168/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.595141:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091684a80 with x1830965174999168 ext(0->4095) 00010000:00010000:2.0:1746144889.595145:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275146f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9415a expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.595154:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af67275146f6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9415a expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.595158:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091684a80 00000100:00100000:0.0:1746144889.597244:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.602373:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.602420:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174999552 00000100:00100000:2.0:1746144889.602426:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174999552 00002000:00100000:2.0:1746144889.602472:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091685880 x1830965174999552/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.602479:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091685880 with x1830965174999552 ext(0->4095) 00002000:00010000:2.0:1746144889.602483:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091685880 00000100:00100000:2.0:1746144889.602504:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3876 00000100:00100000:2.0:1746144889.602510:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1985:x1830965174999552:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144889.602670:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1985:x1830965174999552:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 160us (301us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.602675:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3876 00002000:00100000:2.0:1746144889.602681:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091685880 x1830965174999552/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.602688:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091685880 with x1830965174999552 ext(0->4095) 00002000:00010000:2.0:1746144889.602690:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091685880 00000100:00100000:0.0:1746144889.605189:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.605260:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965174999680 00000100:00100000:2.0:1746144889.605267:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965174999680 00000100:00100000:2.0:1746144889.605473:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5179 00000100:00100000:2.0:1746144889.605480:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965174999680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.605493:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.605506:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514704 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94168 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.605529:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af67275146fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94161 expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.605535:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.605537:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.605540:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514704 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94168 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.605562:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af67275146fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94161 expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.605571:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099312e00/0x4076af67275146fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94161 expref: 37 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.605581:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b463b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172362112:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.605655:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.606996:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b463b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172362112:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.607018:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514704 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94168 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.607030:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d200, rc 0) 00000100:00100000:2.0:1746144889.607058:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965174999680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1578us (1875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.607065:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5179 00000100:00100000:2.0:1746144889.607256:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.609651:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.609993:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175000064 00000100:00100000:1.0:1746144889.609998:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175000064 00002000:00100000:1.0:1746144889.610026:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091686d80 x1830965175000064/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.610035:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091686d80 with x1830965175000064 ext(0->4095) 00002000:00010000:1.0:1746144889.610039:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091686d80 00000100:00100000:1.0:1746144889.610052:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3877 00000100:00100000:1.0:1746144889.610058:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175000064:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144889.610202:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175000064:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 143us (556us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.610207:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3877 00002000:00100000:1.0:1746144889.610212:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091686d80 x1830965175000064/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.610219:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091686d80 with x1830965175000064 ext(0->4095) 00002000:00010000:1.0:1746144889.610222:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091686d80 00000100:00100000:0.0:1746144889.612694:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.612846:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.612895:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175000192 00000100:00100000:2.0:1746144889.612902:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175000192 00000100:00100000:2.0:1746144889.613116:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175000320 00000100:00100000:2.0:1746144889.613119:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175000320 00000100:00100000:2.0:1746144889.613362:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5180 00000100:00100000:1.0:1746144889.613369:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5181 00000100:00100000:2.0:1746144889.613371:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+38:31579:x1830965175000192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:1.0:1746144889.613376:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:31565:x1830965175000320:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.613385:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.613385:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.613398:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751470b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9416f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.613398:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514712 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94176 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.613420:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514704 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94168 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.613426:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.613428:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.613430:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514712 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94176 expref: 40 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.613748:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.613754:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514712 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94176 expref: 40 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.613760:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.613780:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751470b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9416f expref: 40 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.613806:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514704 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94168 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.613809:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514712 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94176 expref: 40 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.613818:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514704 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94168 expref: 5 pid: 8432 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.613829:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172362496:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.613897:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00010000:00010000:2.0:1746144889.613932:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751470b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9416f expref: 40 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.613941:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:2.0:1746144889.613962:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+40:31579:x1830965175000192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 594us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.613967:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5180 00000100:00100000:1.0:1746144889.615612:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932aa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172362496:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.615634:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514712 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94176 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.615645:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a41ec400, rc 0) 00000100:00100000:1.0:1746144889.615672:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+39:31565:x1830965175000320:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2297us (2826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.615678:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5181 00000100:00100000:0.0:1746144889.616347:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.620179:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.620271:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175000704 00000100:00100000:2.0:1746144889.620277:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175000704 00002000:00100000:2.0:1746144889.620312:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094000 x1830965175000704/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.620321:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094000 with x1830965175000704 ext(0->4095) 00010000:00010000:2.0:1746144889.620327:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514712 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94176 expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.620338:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514712 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94176 expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.620344:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a094000 00000100:00100000:2.0:1746144889.620373:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1865 00000100:00100000:2.0:1746144889.620380:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1985:x1830965175000704:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144889.620964:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1985:x1830965175000704:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 583us (786us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.620971:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1865 00002000:00100000:2.0:1746144889.620984:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094000 x1830965175000704/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.620990:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094000 with x1830965175000704 ext(0->4095) 00010000:00010000:2.0:1746144889.620995:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514712 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94176 expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.621003:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514712 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94176 expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.621008:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a094000 00000100:00100000:0.0:1746144889.623872:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.627999:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.628682:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175001088 00000100:00100000:2.0:1746144889.628688:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175001088 00002000:00100000:2.0:1746144889.628726:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932aa680 x1830965175001088/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.628735:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932aa680 with x1830965175001088 ext(0->4095) 00002000:00010000:2.0:1746144889.628739:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800932aa680 00000100:00100000:2.0:1746144889.628816:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3878 00000100:00100000:2.0:1746144889.628824:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1984:x1830965175001088:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.628964:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1984:x1830965175001088:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 141us (966us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.628974:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3878 00002000:00100000:2.0:1746144889.628986:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932aa680 x1830965175001088/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.628998:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932aa680 with x1830965175001088 ext(0->4095) 00002000:00010000:2.0:1746144889.629001:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800932aa680 00000100:00100000:0.0:1746144889.630865:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.630902:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175001216 00000100:00100000:1.0:1746144889.630909:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175001216 00000100:00100000:1.0:1746144889.630951:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5182 00000100:00100000:1.0:1746144889.630958:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175001216:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.630972:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.630998:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727514719 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9417d expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.631022:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751470b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9416f expref: 37 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.631029:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.631030:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.631033:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727514719 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9417d expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.631057:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751470b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9416f expref: 37 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.631071:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af672751470b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9416f expref: 37 pid: 8432 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.631082:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172362880:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.631159:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.633051:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172362880:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.633075:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727514719 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9417d expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.633089:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099312a00, rc 0) 00000100:00100000:1.0:1746144889.633121:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175001216:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2163us (2261us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.633128:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5182 00000100:00100000:0.0:1746144889.633496:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.637851:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.637917:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.637964:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175001728 00000100:00100000:1.0:1746144889.637970:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175001728 00000100:00100000:1.0:1746144889.638021:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5183 00000100:00100000:1.0:1746144889.638028:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+37:31565:x1830965175001728:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.638043:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.638056:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a41ed400/0x4076af6727514720 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94184 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.638080:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727514719 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9417d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.638086:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.638088:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.638090:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a41ed400/0x4076af6727514720 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94184 expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.638115:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727514719 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9417d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.638126:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727514719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9417d expref: 5 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.638140:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172363136:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.638152:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175001600 00000100:00100000:2.0:1746144889.638155:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175001600 00002000:00100000:2.0:1746144889.638179:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094e00 x1830965175001600/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.638186:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094e00 with x1830965175001600 ext(0->4095) 00000100:00100000:1.0:1746144889.638186:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00010000:00010000:2.0:1746144889.638191:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727514719 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9417d expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.638199:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727514719 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9417d expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.638205:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a094e00 00000100:00100000:2.0:1746144889.638220:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1866 00000100:00100000:2.0:1746144889.638226:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175001600:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.638354:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175001600:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 128us (507us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.638360:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1866 00002000:00100000:2.0:1746144889.638364:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094e00 x1830965175001600/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.638371:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094e00 with x1830965175001600 ext(0->4095) 00010000:00010000:2.0:1746144889.638375:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727514719 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9417d expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.638384:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727514719 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9417d expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.638388:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a094e00 00000100:00100000:2.0:1746144889.640273:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.641276:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172363136:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144889.641458:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:1.0:1746144889.641516:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a41ed400/0x4076af6727514720 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94184 expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.641533:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a41ed400, rc 0) 00000100:00100000:1.0:1746144889.641567:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:31565:x1830965175001728:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3539us (3649us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.641574:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5183 00000100:00100000:1.0:1746144889.641594:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175001856 00000100:00100000:1.0:1746144889.641598:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175001856 00000100:00100000:1.0:1746144889.641618:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5184 00000100:00100000:1.0:1746144889.641623:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:31579:x1830965175001856:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.641634:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.641646:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514727 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9418b expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.641662:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.641666:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a41ed400/0x4076af6727514720 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94184 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.641672:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.641674:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514727 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9418b expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144889.641679:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175001984 00000100:00100000:2.0:1746144889.641682:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175001984 00010000:00010000:2.0:1746144889.641698:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727514719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9417d expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.641701:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a41ed400/0x4076af6727514720 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94184 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.641709:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514727 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9418b expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.641718:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a41ec400, rc 0) 00000100:00100000:2.0:1746144889.641720:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10599 00000100:00100000:2.0:1746144889.641726:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175001984:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144889.641732:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144889.641735:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+39:31579:x1830965175001856:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 113us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.641740:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5184 00010000:00010000:2.0:1746144889.641748:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727514719 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9417d expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.641757:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727514719 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9417d expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.641890:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099312a00/0x4076af6727514719 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9417d expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.641901:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.641902:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.641907:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a41ed400/0x4076af6727514720 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94184 expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.641917:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a41ed400/0x4076af6727514720 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94184 expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.641933:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a41ed400/0x4076af6727514720 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94184 expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.641941:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a41ed400/0x4076af6727514720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94184 expref: 38 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.641950:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b463100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172363392:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144889.642424:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.644170:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b463100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172363392:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144889.644174:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1746144889.644431:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144889.644471:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175001984:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2744us (3012us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.644478:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10599 00000100:00100000:0.0:1746144889.646543:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.646691:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175002368 00000100:00100000:2.0:1746144889.646697:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175002368 00010000:00010000:2.0:1746144889.646725:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a41ed400/0x4076af6727514720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94184 expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.646862:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10600 00000100:00100000:1.0:1746144889.646904:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1984:x1830965175002368:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144889.646916:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144889.646932:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a41ed400/0x4076af6727514720 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94184 expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.646942:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a41ed400/0x4076af6727514720 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94184 expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.646961:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a41ed400/0x4076af6727514720 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94184 expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.646991:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.646993:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.646999:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514727 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9418b expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.647006:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514727 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9418b expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.647031:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514727 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9418b expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144889.647040:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172363520:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144889.647110:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.649370:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172363520:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144889.649388:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144889.649434:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1984:x1830965175002368:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2564us (2893us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.649442:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10600 00000100:00100000:0.0:1746144889.649635:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.652357:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.652488:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175002752 00000100:00100000:2.0:1746144889.652495:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175002752 00000100:00100000:2.0:1746144889.652753:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5185 00000100:00100000:2.0:1746144889.652761:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175002752:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.652882:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.652896:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751472e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94192 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.652918:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514727 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9418b expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.652924:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.652925:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.652928:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751472e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94192 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.652953:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514727 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9418b expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.652963:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514727 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9418b expref: 37 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.652972:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b463100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172363648:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.653676:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.654142:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b463100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172363648:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.654164:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751472e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94192 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.654176:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:2.0:1746144889.654208:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175002752:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1448us (1857us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.654217:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5185 00000100:00100000:0.0:1746144889.655941:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.656513:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175002880 00000100:00100000:1.0:1746144889.656520:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175002880 00010000:00010000:1.0:1746144889.656546:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514727 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9418b expref: 38 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.656575:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10601 00000100:00100000:1.0:1746144889.656581:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1984:x1830965175002880:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144889.656591:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144889.656607:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514727 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9418b expref: 38 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.656621:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514727 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9418b expref: 38 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.656638:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a41ec400/0x4076af6727514727 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9418b expref: 38 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.656658:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.656659:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.656665:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751472e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94192 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.656671:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751472e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94192 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.656694:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751472e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94192 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144889.656704:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172363776:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144889.656798:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.658923:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172363776:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144889.658941:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144889.658989:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+37:1984:x1830965175002880:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2407us (3053us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.658999:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10601 00000100:00100000:2.0:1746144889.660481:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.660524:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.660589:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175003136 00000100:00100000:1.0:1746144889.660593:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175003136 00002000:00100000:1.0:1746144889.660619:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b463100 x1830965175003136/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.660629:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463100 with x1830965175003136 ext(0->4095) 00002000:00010000:1.0:1746144889.660633:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b463100 00000100:00100000:1.0:1746144889.660645:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3880 00000100:00100000:1.0:1746144889.660650:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175003136:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144889.660793:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175003136:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 142us (315us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.660799:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3880 00002000:00100000:1.0:1746144889.661001:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b463100 x1830965175003136/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.661009:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463100 with x1830965175003136 ext(0->4095) 00010000:00010000:1.0:1746144889.661014:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751472e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94192 expref: 6 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.661024:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751472e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94192 expref: 6 pid: 8430 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.661033:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b463100 00000100:00100000:0.0:1746144889.664457:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.664490:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.664751:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175003520 00000100:00100000:1.0:1746144889.664754:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175003520 00010000:00010000:1.0:1746144889.664781:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751472e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94192 expref: 6 pid: 8430 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.665081:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10602 00000100:00100000:1.0:1746144889.665087:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175003520:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144889.665095:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144889.665111:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751472e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94192 expref: 6 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.665120:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751472e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94192 expref: 6 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.665133:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751472e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94192 expref: 6 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.665149:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.665151:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.665156:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514735 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94199 expref: 38 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.665162:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514735 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94199 expref: 38 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.665179:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514735 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94199 expref: 38 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.665188:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514735 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94199 expref: 38 pid: 8430 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.665197:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172364160:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144889.665246:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.667622:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172364160:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144889.667641:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144889.667687:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175003520:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2599us (3195us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.667696:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10602 00000100:00100000:0.0:1746144889.667702:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.667728:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175003776 00000100:00100000:1.0:1746144889.667732:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175003776 00002000:00100000:1.0:1746144889.667758:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a096d80 x1830965175003776/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.667798:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a096d80 with x1830965175003776 ext(0->4095) 00010000:00010000:1.0:1746144889.667807:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514735 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94199 expref: 39 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.667818:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514735 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94199 expref: 39 pid: 8430 timeout: 583 lvb_type: 0 00002000:00010000:1.0:1746144889.667939:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a096d80 00000100:00100000:2.0:1746144889.668111:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1868 00000100:00100000:2.0:1746144889.668121:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1984:x1830965175003776:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.668248:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1984:x1830965175003776:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 131us (551us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.668253:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1868 00002000:00100000:2.0:1746144889.668258:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a096d80 x1830965175003776/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.668265:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a096d80 with x1830965175003776 ext(0->4095) 00010000:00010000:2.0:1746144889.668269:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514735 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94199 expref: 39 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.668278:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514735 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94199 expref: 39 pid: 8430 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.668283:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a096d80 00000100:00100000:0.0:1746144889.670571:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.670658:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175003904 00000100:00100000:1.0:1746144889.670664:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175003904 00010000:00010000:1.0:1746144889.670700:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514735 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94199 expref: 39 pid: 8430 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.670736:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10603 00000100:00100000:1.0:1746144889.670743:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1982:x1830965175003904:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144889.670754:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144889.671156:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514735 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94199 expref: 39 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.671173:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514735 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94199 expref: 39 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.671193:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514735 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94199 expref: 39 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.671218:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.671220:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.671227:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af672751473c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a0 expref: 38 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.671234:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af672751473c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a0 expref: 38 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.671263:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af672751473c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a0 expref: 38 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144889.671274:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172364288:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144889.671342:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.673554:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172364288:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144889.673579:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144889.673615:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1982:x1830965175003904:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2872us (3051us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.673623:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10603 00000100:00100000:0.0:1746144889.673707:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.675044:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175004160 00000100:00100000:1.0:1746144889.675052:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175004160 00002000:00100000:1.0:1746144889.675085:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a097480 x1830965175004160/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.675094:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a097480 with x1830965175004160 ext(0->4095) 00002000:00010000:1.0:1746144889.675098:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a097480 00000100:00100000:1.0:1746144889.675121:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3881 00000100:00100000:1.0:1746144889.675126:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1985:x1830965175004160:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144889.675705:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1985:x1830965175004160:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 573us (1994us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.675712:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3881 00002000:00100000:1.0:1746144889.675718:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a097480 x1830965175004160/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.675725:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a097480 with x1830965175004160 ext(0->4095) 00002000:00010000:1.0:1746144889.675728:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a097480 00000100:00100000:0.0:1746144889.678848:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.679024:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175004288 00000100:00100000:2.0:1746144889.679033:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175004288 00000100:00100000:2.0:1746144889.679083:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5188 00000100:00100000:2.0:1746144889.679091:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175004288:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.679106:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.679119:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514743 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af941a7 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.679144:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af672751473c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a0 expref: 37 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.679151:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.679152:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.679155:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514743 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a7 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.679181:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af672751473c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a0 expref: 37 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.679191:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af672751473c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a0 expref: 37 pid: 8430 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.679202:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b461f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172364416:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.679273:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.680449:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b461f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172364416:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.680470:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514743 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a7 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.680482:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:2.0:1746144889.680508:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175004288:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1418us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.680514:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5188 00000100:00100000:0.0:1746144889.681629:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.681688:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175004416 00000100:00100000:1.0:1746144889.681697:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175004416 00010000:00010000:1.0:1746144889.681727:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af672751473c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a0 expref: 38 pid: 8430 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.681757:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10604 00000100:00100000:1.0:1746144889.681780:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1984:x1830965175004416:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144889.681792:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144889.681809:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af672751473c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a0 expref: 38 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.681822:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af672751473c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a0 expref: 38 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.681840:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af672751473c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a0 expref: 38 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.681861:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.681863:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.681868:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514743 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a7 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.681875:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514743 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a7 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.681896:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514743 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a7 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144889.681905:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172364544:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144889.682795:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.685721:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.685821:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172364544:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144889.685826:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175004672 00000100:00100000:2.0:1746144889.685833:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175004672 00010000:00010000:1.0:1746144889.685839:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144889.685870:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+37:1984:x1830965175004416:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4108us (4246us total) trans 0 rc 0/0 00002000:00100000:2.0:1746144889.685873:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094380 x1830965175004672/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1746144889.685879:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10604 00002000:00100000:2.0:1746144889.685882:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094380 with x1830965175004672 ext(0->4095) 00002000:00010000:2.0:1746144889.685886:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a094380 00000100:00100000:2.0:1746144889.685916:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3882 00000100:00100000:2.0:1746144889.685922:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175004672:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.686187:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175004672:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 263us (472us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.686193:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3882 00002000:00100000:2.0:1746144889.686198:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094380 x1830965175004672/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.686205:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094380 with x1830965175004672 ext(0->4095) 00002000:00010000:2.0:1746144889.686209:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a094380 00000100:00100000:0.0:1746144889.686473:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.690825:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.692234:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.692535:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175005056 00000100:00100000:1.0:1746144889.692539:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175005056 00010000:00010000:1.0:1746144889.692557:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514743 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a7 expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.692669:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10605 00000100:00100000:1.0:1746144889.692676:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175005056:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144889.692685:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144889.692703:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514743 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a7 expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.692712:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514743 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a7 expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.692727:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514743 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941a7 expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.693309:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.693312:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.693318:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751474a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ae expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.693325:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751474a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ae expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.693351:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751474a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ae expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.693361:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751474a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ae expref: 38 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.693371:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172364928:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144889.693439:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.696656:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172364928:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144889.696676:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144889.696716:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175005056:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4040us (4483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.696725:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10605 00000100:00100000:0.0:1746144889.699047:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.705355:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.705439:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175005440 00000100:00100000:1.0:1746144889.705448:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175005440 00010000:00010000:1.0:1746144889.705477:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751474a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ae expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.705511:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10606 00000100:00100000:1.0:1746144889.705517:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1983:x1830965175005440:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144889.705528:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144889.705544:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751474a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ae expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.705554:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751474a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ae expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.705574:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751474a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ae expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.705590:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.705593:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.705598:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514751 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941b5 expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.705605:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514751 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941b5 expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.705632:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514751 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941b5 expref: 38 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144889.705643:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172365056:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144889.705717:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.709161:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172365056:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144889.709181:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144889.709232:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1983:x1830965175005440:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3713us (3883us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.709241:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10606 00000100:00100000:0.0:1746144889.710544:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.715405:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.718555:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.718647:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175005952 00000100:00100000:1.0:1746144889.718653:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175005952 00010000:00010000:1.0:1746144889.718675:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514751 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941b5 expref: 38 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.718696:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10607 00000100:00100000:1.0:1746144889.718702:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1984:x1830965175005952:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144889.718714:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144889.718732:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514751 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941b5 expref: 38 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.718746:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514751 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941b5 expref: 38 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.718796:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514751 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941b5 expref: 38 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.718809:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.718810:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.718816:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514758 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941bc expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.718823:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514758 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941bc expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.718848:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514758 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941bc expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144889.718857:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172365312:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144889.719298:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.719327:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.723423:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172365312:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144889.723444:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144889.723519:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1984:x1830965175005952:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4815us (4963us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.723527:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10607 00000100:00100000:0.0:1746144889.724495:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.724539:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175006336 00000100:00100000:2.0:1746144889.724545:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175006336 00002000:00100000:2.0:1746144889.724582:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258d180 x1830965175006336/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.724591:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258d180 with x1830965175006336 ext(0->4095) 00010000:00010000:2.0:1746144889.724598:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514758 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941bc expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.724609:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514758 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941bc expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.724620:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258d180 00000100:00100000:2.0:1746144889.724651:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1870 00000100:00100000:2.0:1746144889.724658:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175006336:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.724834:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175006336:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 176us (340us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.724840:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1870 00002000:00100000:2.0:1746144889.724845:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258d180 x1830965175006336/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.724852:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258d180 with x1830965175006336 ext(0->4095) 00010000:00010000:2.0:1746144889.724856:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514758 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941bc expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.724864:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514758 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941bc expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.724869:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258d180 00000100:00100000:0.0:1746144889.728342:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.728898:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175006464 00000100:00100000:1.0:1746144889.728907:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175006464 00010000:00010000:1.0:1746144889.728935:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514758 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941bc expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.728968:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10608 00000100:00100000:1.0:1746144889.728985:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175006464:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144889.728997:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144889.729015:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514758 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941bc expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.729026:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514758 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941bc expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.729045:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514758 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941bc expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.729072:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.729074:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.729081:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af672751475f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941c3 expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.729087:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af672751475f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941c3 expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.729115:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af672751475f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941c3 expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144889.729125:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172365568:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144889.729201:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a793c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.732885:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.733050:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172365568:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144889.733069:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144889.733103:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175006464:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4129us (4769us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.733111:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10608 00000100:00100000:0.0:1746144889.751378:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.759167:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.759241:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.760038:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175007104 00000100:00100000:2.0:1746144889.760043:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175007104 00002000:00100000:2.0:1746144889.760069:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880099e86680 x1830965175007104/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 496/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.760077:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e86680 with x1830965175007104 ext(0->7) 00010000:00010000:2.0:1746144889.760083:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af672751475f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941c3 expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.760098:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af672751475f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941c3 expref: 39 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.760104:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099e86680 00000100:00100000:2.0:1746144889.760129:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1871 00000100:00100000:2.0:1746144889.760135:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1985:x1830965175007104:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144889.760388:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1985:x1830965175007104:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 253us (1146us total) trans 4294967982 rc 0/0 00000100:00100000:2.0:1746144889.760394:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1871 00002000:00100000:2.0:1746144889.760399:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880099e86680 x1830965175007104/t4294967982(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 496/448 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.760405:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e86680 with x1830965175007104 ext(0->7) 00010000:00010000:2.0:1746144889.760409:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af672751475f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941c3 expref: 41 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.760417:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af672751475f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941c3 expref: 41 pid: 20722 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.760422:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099e86680 00000100:00100000:0.0:1746144889.764634:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.764712:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175007232 00000100:00100000:1.0:1746144889.764719:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175007232 00010000:00010000:1.0:1746144889.764746:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af672751475f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941c3 expref: 41 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.764795:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10609 00000100:00100000:1.0:1746144889.764801:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1983:x1830965175007232:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144889.764812:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746144889.764826:0:9812:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 1746144889 -> 1746144890 00002000:00010000:1.0:1746144889.764828:0:9812:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 1746144889 -> 1746144890 00010000:00010000:1.0:1746144889.764833:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af672751475f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941c3 expref: 41 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.764842:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af672751475f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941c3 expref: 41 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.764859:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af672751475f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941c3 expref: 41 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.764873:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.764874:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.764880:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514766 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ca expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.764886:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514766 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ca expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.764910:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514766 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ca expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.764918:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514766 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ca expref: 5 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.764927:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172365952:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144889.764998:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.768937:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.769373:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172365952:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144889.769390:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144889.769410:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1983:x1830965175007232:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4610us (4784us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.769417:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10609 00000100:00100000:0.0:1746144889.775857:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.776426:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175007616 00000100:00100000:1.0:1746144889.776435:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175007616 00010000:00010000:1.0:1746144889.776466:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514766 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ca expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.776620:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10610 00000100:00100000:1.0:1746144889.776636:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175007616:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144889.776652:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144889.776672:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514766 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ca expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.776682:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514766 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ca expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.776701:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514766 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ca expref: 6 pid: 20722 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.776726:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.776728:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.776736:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af672751476d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d1 expref: 39 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.776742:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af672751476d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d1 expref: 39 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.776794:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af672751476d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d1 expref: 39 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144889.776804:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172366080:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144889.776873:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.778902:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172366080:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144889.778922:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144889.778953:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175007616:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2326us (3103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.778965:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10610 00000100:00100000:0.0:1746144889.780317:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.780374:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175007872 00000100:00100000:2.0:1746144889.780380:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175007872 00002000:00100000:2.0:1746144889.780461:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa1f80 x1830965175007872/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.780475:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1f80 with x1830965175007872 ext(0->4095) 00002000:00010000:2.0:1746144889.780479:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa1f80 00000100:00100000:2.0:1746144889.780506:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3885 00000100:00100000:2.0:1746144889.780513:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1984:x1830965175007872:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.780650:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1984:x1830965175007872:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 137us (337us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.780656:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3885 00002000:00100000:2.0:1746144889.780661:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa1f80 x1830965175007872/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.780668:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1f80 with x1830965175007872 ext(0->4095) 00002000:00010000:2.0:1746144889.780671:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa1f80 00000100:00100000:0.0:1746144889.785456:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.786019:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175008000 00000100:00100000:1.0:1746144889.786027:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175008000 00000100:00100000:1.0:1746144889.786076:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5195 00000100:00100000:1.0:1746144889.786083:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175008000:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.786098:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.786112:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514774 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af941d8 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.786135:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af672751476d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d1 expref: 39 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.786142:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.786143:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.786146:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514774 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d8 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.786168:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af672751476d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d1 expref: 39 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.786178:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af672751476d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d1 expref: 39 pid: 8432 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.786188:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172366208:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.786889:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.791393:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172366208:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.791422:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514774 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d8 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.791436:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7c000, rc 0) 00000100:00100000:1.0:1746144889.791481:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175008000:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5397us (6030us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.791488:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5195 00000100:00100000:0.0:1746144889.791600:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.794741:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.794860:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175008256 00000100:00100000:1.0:1746144889.794868:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175008256 00010000:00010000:1.0:1746144889.794898:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af672751476d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d1 expref: 42 pid: 8432 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.794935:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10611 00000100:00100000:1.0:1746144889.794941:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+42:1982:x1830965175008256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144889.794952:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144889.794970:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af672751476d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d1 expref: 42 pid: 8432 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.794993:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af672751476d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d1 expref: 42 pid: 8432 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.795011:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af672751476d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d1 expref: 42 pid: 8432 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.795032:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.795034:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.795040:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514774 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d8 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.795047:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514774 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d8 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.795078:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514774 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d8 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144889.795088:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172366336:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144889.795156:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.797876:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.797963:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172366336:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144889.797988:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144889.798023:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1982:x1830965175008256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3081us (3288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.798032:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10611 00000100:00100000:2.0:1746144889.798104:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175008512 00000100:00100000:2.0:1746144889.798109:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175008512 00002000:00100000:2.0:1746144889.798140:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ec000 x1830965175008512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.798149:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ec000 with x1830965175008512 ext(0->4095) 00002000:00010000:2.0:1746144889.798154:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935ec000 00000100:00100000:2.0:1746144889.798181:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3886 00000100:00100000:2.0:1746144889.798188:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175008512:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746144889.798317:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175008512:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 129us (446us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.798322:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3886 00002000:00100000:2.0:1746144889.798327:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ec000 x1830965175008512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.798334:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ec000 with x1830965175008512 ext(0->4095) 00002000:00010000:2.0:1746144889.798337:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935ec000 00000100:00100000:0.0:1746144889.799947:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.800039:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175008640 00000100:00100000:1.0:1746144889.800044:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175008640 00000100:00100000:1.0:1746144889.800697:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5196 00000100:00100000:1.0:1746144889.800704:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+41:31579:x1830965175008640:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.800718:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.800733:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af941df expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.800755:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514774 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d8 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.801046:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.801049:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.801053:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941df expref: 42 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.801078:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514774 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d8 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.801088:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514774 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d8 expref: 5 pid: 8430 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.801100:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172366464:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.802269:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.803924:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172366464:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.803948:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941df expref: 42 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.803962:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf9be00, rc 0) 00000100:00100000:1.0:1746144889.804003:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+42:31579:x1830965175008640:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3299us (4059us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.804010:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5196 00000100:00100000:0.0:1746144889.804662:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.804943:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175008768 00000100:00100000:1.0:1746144889.804949:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175008768 00010000:00010000:1.0:1746144889.804972:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514774 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d8 expref: 6 pid: 8430 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.805487:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10612 00000100:00100000:1.0:1746144889.805494:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175008768:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144889.805507:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144889.805524:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514774 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d8 expref: 6 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.805534:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514774 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d8 expref: 6 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.805553:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514774 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941d8 expref: 6 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.805674:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.805677:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.805683:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941df expref: 41 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.805691:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941df expref: 41 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.805718:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941df expref: 41 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144889.805728:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172366592:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144889.806178:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.808700:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.808824:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172366592:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144889.808840:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144889.808869:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175008768:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3376us (4208us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.808880:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10612 00000100:00100000:0.0:1746144889.811145:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.811205:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175009152 00000100:00100000:1.0:1746144889.811211:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175009152 00000100:00100000:1.0:1746144889.811251:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5197 00000100:00100000:1.0:1746144889.811258:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175009152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.811270:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.811283:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514782 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af941e6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.811305:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941df expref: 41 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.811312:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.811313:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.811316:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514782 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941e6 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.811340:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941df expref: 41 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.811350:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941df expref: 41 pid: 8430 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.811360:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172366720:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.811434:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.819394:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.819452:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175009280 00000100:00100000:2.0:1746144889.819460:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175009280 00002000:00100000:2.0:1746144889.819515:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800935ed180 x1830965175009280/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 496/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.819524:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ed180 with x1830965175009280 ext(0->7) 00010000:00010000:2.0:1746144889.819532:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941df expref: 42 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.819543:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941df expref: 42 pid: 8430 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.819549:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935ed180 00000100:00100000:2.0:1746144889.819578:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1874 00000100:00100000:2.0:1746144889.819589:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+42:1982:x1830965175009280:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144889.819905:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1982:x1830965175009280:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 319us (518us total) trans 4294967984 rc 0/0 00000100:00100000:2.0:1746144889.819912:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1874 00002000:00100000:2.0:1746144889.819917:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800935ed180 x1830965175009280/t4294967984(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 496/448 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.819924:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ed180 with x1830965175009280 ext(0->7) 00010000:00010000:2.0:1746144889.819928:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941df expref: 44 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.819936:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941df expref: 44 pid: 8430 timeout: 583 lvb_type: 0 00002000:00010000:2.0:1746144889.819941:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935ed180 00000100:00100000:1.0:1746144889.820860:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172366720:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.820887:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514782 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941e6 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.820900:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501a00, rc 0) 00000100:00100000:1.0:1746144889.821363:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175009152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 10104us (10221us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.821370:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5197 00000100:00100000:0.0:1746144889.826383:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.826448:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175009408 00000100:00100000:1.0:1746144889.826456:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175009408 00010000:00010000:1.0:1746144889.826495:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941df expref: 44 pid: 8430 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.826529:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10613 00000100:00100000:1.0:1746144889.826536:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1983:x1830965175009408:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144889.826548:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144889.826566:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941df expref: 44 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.826577:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941df expref: 44 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.826595:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf9be00/0x4076af672751477b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941df expref: 44 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:1.0:1746144889.826621:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.826623:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.826629:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514782 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941e6 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.826636:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514782 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941e6 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.826664:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514782 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941e6 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144889.826675:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172366848:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144889.826935:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.828953:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.829065:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175009536 00000100:00100000:1.0:1746144889.829071:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175009536 00000100:00100000:1.0:1746144889.829110:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5198 00000100:00100000:1.0:1746144889.829115:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175009536:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.829128:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.829141:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514789 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af941ed expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.829167:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514782 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941e6 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.829174:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.829176:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.829178:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514789 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ed expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.829200:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514782 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941e6 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.829214:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514782 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941e6 expref: 5 pid: 8430 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.829223:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172366976:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.829286:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.831001:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.831343:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172366848:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144889.831358:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144889.831392:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1983:x1830965175009408:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4856us (5017us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.831399:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10613 00000100:00100000:1.0:1746144889.831675:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172366976:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.831691:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514789 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ed expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.831703:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500c00, rc 0) 00000100:00100000:1.0:1746144889.831720:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175009536:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2605us (2775us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.831725:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5198 00000100:00100000:0.0:1746144889.834685:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.834814:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.834873:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175009920 00000100:00100000:2.0:1746144889.834880:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175009920 00000100:00100000:1.0:1746144889.834907:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175010048 00000100:00100000:1.0:1746144889.834911:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175010048 00010000:00010000:2.0:1746144889.834915:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514782 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941e6 expref: 6 pid: 8430 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.834937:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10614 00000100:00100000:2.0:1746144889.834944:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175009920:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144889.834954:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144889.834972:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514782 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941e6 expref: 6 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.834993:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514782 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941e6 expref: 6 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.835012:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514782 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941e6 expref: 6 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.835035:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.835037:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.835043:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514789 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ed expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.835054:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514789 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ed expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.835080:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514789 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ed expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144889.835089:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172367104:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144889.835147:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.835223:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5199 00000100:00100000:1.0:1746144889.835230:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31579:x1830965175010048:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.835241:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.835252:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514790 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af941f4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.835268:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514789 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ed expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.835274:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.835276:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.835279:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514790 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941f4 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.835292:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514789 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ed expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.835302:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514789 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ed expref: 45 pid: 8430 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.835310:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172367232:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.835329:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.838050:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172367232:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.838084:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172367104:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144889.838106:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144889.838139:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175009920:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3195us (3324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.838147:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10614 00010000:00010000:1.0:1746144889.838149:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514790 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941f4 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.838162:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501200, rc 0) 00000100:00100000:1.0:1746144889.838184:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31579:x1830965175010048:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2954us (3504us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.838190:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5199 00000100:00100000:0.0:1746144889.838870:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.842554:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.842642:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175010432 00000100:00100000:2.0:1746144889.842650:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175010432 00010000:00010000:2.0:1746144889.842680:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514789 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ed expref: 45 pid: 8430 timeout: 583 lvb_type: 0 00000100:00100000:2.0:1746144889.842709:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10615 00000100:00100000:2.0:1746144889.842716:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1985:x1830965175010432:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144889.842727:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144889.842745:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514789 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ed expref: 45 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.842754:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514789 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ed expref: 45 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.842794:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514789 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941ed expref: 45 pid: 8430 timeout: 583 lvb_type: 0 00010000:00010000:2.0:1746144889.842815:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.842817:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.842823:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514790 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941f4 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.842829:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941f4 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.842856:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941f4 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144889.842867:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172367360:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144889.842928:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.844435:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172367360:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144889.844454:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144889.844482:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175010432:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1766us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.844500:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10615 00000100:00100000:0.0:1746144889.845724:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.848445:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.848524:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175010816 00000100:00100000:1.0:1746144889.848532:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175010816 00000100:00100000:1.0:1746144889.848626:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5200 00000100:00100000:1.0:1746144889.848634:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175010816:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.848648:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.848663:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514797 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af941fb expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.848685:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514790 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941f4 expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.848691:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.848692:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.848695:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514797 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941fb expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.848719:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514790 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941f4 expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.848732:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514790 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941f4 expref: 43 pid: 8430 timeout: 583 lvb_type: 0 00000100:00100000:1.0:1746144889.848742:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172367488:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.848931:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.850886:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172367488:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.850911:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514797 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941fb expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.850987:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500200, rc 0) 00000100:00100000:1.0:1746144889.851484:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175010816:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2849us (3044us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.851491:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5200 00000100:00100000:0.0:1746144889.851684:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.854059:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.854959:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.855052:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175011328 00000100:00100000:1.0:1746144889.855056:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175011328 00000100:00100000:1.0:1746144889.855084:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5201 00000100:00100000:1.0:1746144889.855090:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+43:31565:x1830965175011328:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.855098:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.855110:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af672751479e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94202 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.855127:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514797 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941fb expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.855134:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.855136:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.855138:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af672751479e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94202 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.855194:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514797 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941fb expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.855205:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514797 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941fb expref: 5 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144889.855219:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172367744:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.855581:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.856741:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.856903:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172367744:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.856922:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af672751479e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94202 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.856933:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500400, rc 0) 00000100:00100000:0.0:1746144889.856942:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.856959:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175011328:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1869us (2000us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.856965:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5201 00000100:00100000:1.0:1746144889.856991:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175011456 00000100:00100000:1.0:1746144889.856994:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175011456 00000100:00100000:2.0:1746144889.857060:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175011584 00000100:00100000:2.0:1746144889.857063:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175011584 00010000:00010000:2.0:1746144889.857081:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514797 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941fb expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144889.857145:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10617 00000100:00100000:2.0:1746144889.857152:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175011584:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144889.857161:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144889.857177:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514797 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941fb expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.857186:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514797 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941fb expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.857203:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514797 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af941fb expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.857215:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.857217:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.857222:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af672751479e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94202 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.857228:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af672751479e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94202 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.857255:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af672751479e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94202 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144889.857263:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172367872:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144889.857439:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5202 00000100:00100000:1.0:1746144889.857445:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31579:x1830965175011456:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.857454:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.857461:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147a5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94209 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.857474:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af672751479e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94202 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.857479:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.857480:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.857482:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147a5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94209 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.857499:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af672751479e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94202 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.857509:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af672751479e lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94202 expref: 45 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144889.857516:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172368000:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.858124:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.858162:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.861555:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.861620:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172368000:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.861645:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147a5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94209 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.861658:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501a00, rc 0) 00000100:00100000:1.0:1746144889.861694:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31579:x1830965175011456:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4248us (4956us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.861701:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5202 00000100:00100000:2.0:1746144889.862400:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172367872:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144889.862413:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144889.862434:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935efb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175011584:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5284us (5492us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.862441:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10617 00000100:00100000:0.0:1746144889.865254:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.865941:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175011968 00000100:00100000:2.0:1746144889.865949:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175011968 00010000:00010000:2.0:1746144889.865985:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af672751479e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94202 expref: 45 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144889.866210:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10618 00000100:00100000:2.0:1746144889.866218:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1983:x1830965175011968:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144889.866230:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144889.866247:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af672751479e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94202 expref: 45 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.866257:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af672751479e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94202 expref: 45 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.866274:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af672751479e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94202 expref: 45 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.866420:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.866422:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.866429:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94209 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.866436:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94209 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.866463:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94209 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144889.866474:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172368128:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144889.866830:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.869292:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.869374:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172368128:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144889.869401:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144889.869437:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1983:x1830965175011968:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3220us (4189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.869445:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10618 00000100:00100000:1.0:1746144889.869595:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175012224 00000100:00100000:1.0:1746144889.869601:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175012224 00002000:00100000:1.0:1746144889.869631:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935edf80 x1830965175012224/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.869640:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935edf80 with x1830965175012224 ext(0->4095) 00002000:00010000:1.0:1746144889.869644:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935edf80 00000100:00100000:1.0:1746144889.869666:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3890 00000100:00100000:1.0:1746144889.869673:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1983:x1830965175012224:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144889.869825:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1983:x1830965175012224:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 153us (540us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.869830:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3890 00002000:00100000:1.0:1746144889.869835:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935edf80 x1830965175012224/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.869842:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935edf80 with x1830965175012224 ext(0->4095) 00002000:00010000:1.0:1746144889.869844:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935edf80 00000100:00100000:0.0:1746144889.871706:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.871819:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175012352 00000100:00100000:1.0:1746144889.871825:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175012352 00000100:00100000:1.0:1746144889.871863:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5203 00000100:00100000:1.0:1746144889.871868:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175012352:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.871880:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.871893:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275147ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94210 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.871916:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147a5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94209 expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.871921:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.871923:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.871926:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275147ac lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94210 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.871949:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94209 expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.871964:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94209 expref: 43 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144889.871988:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172368256:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.872053:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.873915:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172368256:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.873939:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275147ac lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94210 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144889.873943:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:1.0:1746144889.873953:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500400, rc 0) 00000100:00100000:2.0:1746144889.874059:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175012480 00000100:00100000:2.0:1746144889.874064:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175012480 00010000:00010000:2.0:1746144889.874089:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94209 expref: 44 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144889.874121:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10619 00000100:00100000:2.0:1746144889.874128:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175012480:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144889.874139:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144889.874158:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147a5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94209 expref: 44 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.874167:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147a5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94209 expref: 44 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.874185:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147a5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94209 expref: 44 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.874209:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.874210:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.874216:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275147ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94210 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.874223:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275147ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94210 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.874244:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275147ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94210 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144889.874253:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172368384:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144889.874395:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175012352:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2525us (2693us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.874401:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5203 00000100:00100000:2.0:1746144889.874656:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.876617:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172368384:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144889.876637:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144889.876790:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+43:1984:x1830965175012480:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2661us (2845us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.876797:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10619 00000100:00100000:0.0:1746144889.876847:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.878806:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.879128:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175012864 00000100:00100000:1.0:1746144889.879134:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175012864 00000100:00100000:1.0:1746144889.879174:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5204 00000100:00100000:1.0:1746144889.879180:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+43:31579:x1830965175012864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.879193:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.879206:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275147b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94217 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.879428:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275147ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94210 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.879440:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.879442:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.879446:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275147b3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94217 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.879472:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275147ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94210 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.879483:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275147ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94210 expref: 5 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144889.879493:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172368512:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.879578:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.880536:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.881793:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172368512:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144889.881808:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275147b3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94217 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144889.881821:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500200, rc 0) 00000100:00100000:0.0:1746144889.881905:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31579:x1830965175012864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2724us (3103us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144889.881910:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5204 00000100:00100000:0.0:1746144889.883083:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.883155:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175013120 00000100:00100000:2.0:1746144889.883161:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175013120 00010000:00010000:2.0:1746144889.883183:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275147ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94210 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144889.883234:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10620 00000100:00100000:2.0:1746144889.883242:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175013120:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144889.883256:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144889.883281:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275147ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94210 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.883291:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275147ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94210 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.883307:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275147ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94210 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.883373:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.883375:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.883381:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275147b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94217 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.883388:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275147b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94217 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.883412:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275147b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94217 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.883421:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275147b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94217 expref: 44 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144889.883432:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172368768:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144889.883531:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.885205:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.885292:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172368768:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144889.885311:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144889.885341:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175013120:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2100us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.885350:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10620 00000100:00100000:0.0:1746144889.889119:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.889192:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175013504 00000100:00100000:1.0:1746144889.889200:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175013504 00000100:00100000:0.0:1746144889.889307:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.889352:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5206 00000100:00100000:1.0:1746144889.889360:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175013504:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.889375:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.889389:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94225 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.889411:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.889416:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af67275147ba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9421e expref: 45 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.889421:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144889.889424:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147c1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94225 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.889453:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af67275147ba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9421e expref: 45 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.889472:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147c1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94225 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.889846:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500c00, rc 0) 00000100:00100000:1.0:1746144889.889887:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175013504:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 528us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.889893:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5206 00000100:00100000:0.0:1746144889.892688:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.895014:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.895091:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.895795:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175014144 00000100:00100000:1.0:1746144889.895802:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175014144 00000100:00100000:1.0:1746144889.895831:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5207 00000100:00100000:1.0:1746144889.895836:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175014144:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.895848:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.895857:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af67275147c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9422c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.895885:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94225 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.895891:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.895892:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.895898:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af67275147c8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9422c expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.895918:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147c1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94225 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.895932:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147c1 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94225 expref: 5 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144889.895940:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172369280:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.896163:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.898361:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.898382:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172369280:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.898399:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175014400 00000100:00100000:2.0:1746144889.898404:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175014400 00010000:00010000:1.0:1746144889.898404:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af67275147c8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9422c expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.898418:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501800, rc 0) 00002000:00100000:2.0:1746144889.898434:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee6a680 x1830965175014400/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.898440:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6a680 with x1830965175014400 ext(0->4095) 00010000:00010000:2.0:1746144889.898445:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147c1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94225 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144889.898450:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31565:x1830965175014144:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2613us (3359us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144889.898453:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147c1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94225 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144889.898457:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ee6a680 00000100:00100000:1.0:1746144889.898457:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5207 00000100:00100000:2.0:1746144889.898469:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1880 00000100:00100000:2.0:1746144889.898472:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175014400:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144889.898602:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175014400:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 128us (246us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.898607:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1880 00002000:00100000:2.0:1746144889.898612:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee6a680 x1830965175014400/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.898619:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6a680 with x1830965175014400 ext(0->4095) 00010000:00010000:2.0:1746144889.898623:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94225 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.898632:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94225 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144889.898637:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ee6a680 00000100:00100000:0.0:1746144889.901249:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.904831:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.904926:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175014784 00000100:00100000:2.0:1746144889.904933:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175014784 00002000:00100000:2.0:1746144889.904982:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee6ad80 x1830965175014784/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.904991:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6ad80 with x1830965175014784 ext(0->4095) 00002000:00010000:2.0:1746144889.904996:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee6ad80 00000100:00100000:2.0:1746144889.905012:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3892 00000100:00100000:2.0:1746144889.905019:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175014784:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144889.905403:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175014784:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 384us (577us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.905409:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3892 00002000:00100000:2.0:1746144889.905414:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee6ad80 x1830965175014784/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.905421:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6ad80 with x1830965175014784 ext(0->4095) 00002000:00010000:2.0:1746144889.905423:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee6ad80 00000100:00100000:0.0:1746144889.906981:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.907054:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175014912 00000100:00100000:1.0:1746144889.907060:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175014912 00000100:00100000:1.0:1746144889.907097:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5208 00000100:00100000:1.0:1746144889.907103:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175014912:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.907115:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.907128:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275147cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94233 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.907150:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af67275147c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9422c expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.907157:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.907159:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.907162:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275147cf lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94233 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.907188:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af67275147c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9422c expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.907198:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af67275147c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9422c expref: 43 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144889.907208:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172369536:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.907274:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.908697:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172369536:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.908719:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275147cf lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94233 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.908731:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501200, rc 0) 00000100:00100000:1.0:1746144889.908792:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175014912:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1688us (1822us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.908800:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5208 00000100:00100000:2.0:1746144889.909105:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.911467:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.911536:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175015296 00000100:00100000:2.0:1746144889.911541:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175015296 00002000:00100000:2.0:1746144889.911572:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee6b480 x1830965175015296/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.911587:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6b480 with x1830965175015296 ext(0->4095) 00002000:00010000:2.0:1746144889.911591:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee6b480 00000100:00100000:2.0:1746144889.911602:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3893 00000100:00100000:2.0:1746144889.911608:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175015296:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144889.911747:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175015296:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 138us (280us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.911753:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3893 00002000:00100000:2.0:1746144889.911758:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee6b480 x1830965175015296/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.911799:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6b480 with x1830965175015296 ext(0->4095) 00002000:00010000:2.0:1746144889.911802:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee6b480 00000100:00100000:0.0:1746144889.914812:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.914889:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.915103:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175015424 00000100:00100000:1.0:1746144889.915103:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175015552 00000100:00100000:2.0:1746144889.915111:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175015424 00000100:00100000:1.0:1746144889.915111:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175015552 00000100:00100000:2.0:1746144889.915470:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5209 00000100:00100000:1.0:1746144889.915477:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5210 00000100:00100000:2.0:1746144889.915479:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31579:x1830965175015424:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:1.0:1746144889.915483:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175015552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.915493:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.915493:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.915506:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275147d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94241 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.915506:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9423a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.915527:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275147cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94233 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.915534:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.915536:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.915539:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147dd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9423a expref: 46 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.915691:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.915696:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147dd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9423a expref: 46 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.915702:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.915705:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275147d6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94241 expref: 46 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.915732:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147dd lrc: 5/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9423a expref: 46 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.915745:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275147d6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94241 expref: 46 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.915753:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:2.0:1746144889.915825:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+46:31579:x1830965175015424:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 347us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.915831:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5209 00010000:00010000:1.0:1746144889.915852:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275147cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94233 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.915864:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275147cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94233 expref: 5 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144889.915875:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172369920:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.916077:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144889.917588:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172369920:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.917608:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147dd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9423a expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.917619:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501a00, rc 0) 00000100:00100000:1.0:1746144889.917652:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31565:x1830965175015552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2169us (2762us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.917660:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5210 00000100:00100000:0.0:1746144889.917815:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.919910:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.920018:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175015936 00000100:00100000:1.0:1746144889.920023:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175015936 00002000:00100000:1.0:1746144889.920053:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee69180 x1830965175015936/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.920061:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee69180 with x1830965175015936 ext(0->4095) 00010000:00010000:1.0:1746144889.920067:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9423a expref: 45 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144889.920077:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9423a expref: 45 pid: 8430 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144889.920082:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ee69180 00000100:00100000:1.0:1746144889.920105:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1881 00000100:00100000:1.0:1746144889.920111:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1984:x1830965175015936:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144889.920713:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1984:x1830965175015936:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 601us (806us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.920719:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1881 00002000:00100000:1.0:1746144889.920724:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee69180 x1830965175015936/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.920730:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee69180 with x1830965175015936 ext(0->4095) 00010000:00010000:1.0:1746144889.920735:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9423a expref: 45 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144889.920747:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275147dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9423a expref: 45 pid: 8430 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144889.920751:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ee69180 00000100:00100000:0.0:1746144889.923266:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.924014:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e92e780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.926352:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.926467:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175016320 00000100:00100000:1.0:1746144889.926474:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175016320 00002000:00100000:1.0:1746144889.926507:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e54000 x1830965175016320/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.926516:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e54000 with x1830965175016320 ext(0->4095) 00002000:00010000:1.0:1746144889.926520:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e54000 00000100:00100000:1.0:1746144889.926547:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3894 00000100:00100000:1.0:1746144889.926553:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1984:x1830965175016320:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144889.926691:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1984:x1830965175016320:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 136us (344us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.926697:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3894 00002000:00100000:1.0:1746144889.926702:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e54000 x1830965175016320/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.926709:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e54000 with x1830965175016320 ext(0->4095) 00002000:00010000:1.0:1746144889.926711:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e54000 00000100:00100000:2.0:1746144889.926814:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172370176:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144889.926828:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144889.926850:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175016064:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3416us (3591us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.926856:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10626 00000100:00100000:0.0:1746144889.929384:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.929488:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175016448 00000100:00100000:1.0:1746144889.929496:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175016448 00000100:00100000:1.0:1746144889.930085:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5211 00000100:00100000:1.0:1746144889.930093:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175016448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.930110:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.930124:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94248 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.930146:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275147d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94241 expref: 43 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.930153:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.930154:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.930157:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147e4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94248 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.930180:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275147d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94241 expref: 43 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.930189:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275147d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94241 expref: 43 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144889.930199:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172370304:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.930572:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.934315:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.934393:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175016576 00000100:00100000:2.0:1746144889.934401:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175016576 00010000:00010000:2.0:1746144889.934435:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275147d6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94241 expref: 44 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144889.934459:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10627 00000100:00100000:2.0:1746144889.934466:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175016576:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144889.934477:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144889.934496:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275147d6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94241 expref: 44 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.934507:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275147d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94241 expref: 44 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.934526:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.934527:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.934533:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94248 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.934540:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94248 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.934567:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94248 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144889.934576:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172370432:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144889.934907:0:8430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275147d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94241 expref: 44 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144889.934921:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172370304:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.934940:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147e4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94248 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.934952:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500c00, rc 0) 00000100:00100000:1.0:1746144889.934987:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175016448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4894us (5609us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.934993:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5211 00000100:00100000:2.0:1746144889.935969:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.937881:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172370432:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144889.937900:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144889.937928:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+43:1985:x1830965175016576:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3463us (3620us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.937936:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10627 00000100:00100000:0.0:1746144889.939387:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.939914:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.939992:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175016960 00000100:00100000:1.0:1746144889.940000:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175016960 00000100:00100000:1.0:1746144889.940254:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5212 00000100:00100000:1.0:1746144889.940262:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+43:31565:x1830965175016960:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.940271:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.940285:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275147eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9424f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.940306:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94248 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.940313:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.940315:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.940318:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275147eb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9424f expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.940343:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94248 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.940353:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af67275147e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94248 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144889.940368:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172370560:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144889.940784:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.943335:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.943521:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175017088 00000100:00100000:2.0:1746144889.943528:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175017088 00000100:00100000:2.0:1746144889.943574:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5213 00000100:00100000:2.0:1746144889.943581:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31579:x1830965175017088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.943596:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.943609:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275147f2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94256 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.943630:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.943635:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275147eb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9424f expref: 46 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.943640:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.943643:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275147f2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94256 expref: 46 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.943669:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275147eb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9424f expref: 46 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.943681:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275147f2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94256 expref: 46 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.943689:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:2.0:1746144889.943720:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+46:31579:x1830965175017088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 140us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.943724:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5213 00000100:00100000:1.0:1746144889.943808:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172370560:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144889.943824:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275147eb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9424f expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.943832:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500200, rc 0) 00000100:00100000:1.0:1746144889.943848:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31565:x1830965175016960:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3588us (3934us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.943853:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5212 00000100:00100000:0.0:1746144889.945477:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.947886:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.952061:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.954509:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.955016:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175017856 00000100:00100000:2.0:1746144889.955021:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175017856 00002000:00100000:2.0:1746144889.955053:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e55c00 x1830965175017856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.955062:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e55c00 with x1830965175017856 ext(0->4095) 00002000:00010000:2.0:1746144889.955066:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e55c00 00000100:00100000:2.0:1746144889.955080:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3896 00000100:00100000:2.0:1746144889.955086:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175017856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.955218:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175017856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 132us (714us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.955224:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3896 00002000:00100000:2.0:1746144889.955229:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e55c00 x1830965175017856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.955235:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e55c00 with x1830965175017856 ext(0->4095) 00002000:00010000:2.0:1746144889.955237:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e55c00 00000100:00100000:0.0:1746144889.957400:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.961925:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.961998:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175018112 00000100:00100000:2.0:1746144889.962006:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175018112 00010000:00010000:2.0:1746144889.962038:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275147f2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94256 expref: 44 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144889.962060:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10630 00000100:00100000:2.0:1746144889.962066:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175018112:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144889.962076:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144889.962093:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275147f2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94256 expref: 44 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.962101:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275147f2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94256 expref: 44 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.962118:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275147f2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94256 expref: 44 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.962132:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.962134:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.962139:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275147f9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9425d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.962146:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275147f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9425d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.962174:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275147f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9425d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144889.962183:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172371200:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144889.962218:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.964157:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172371200:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144889.964176:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144889.964279:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.964453:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+43:1985:x1830965175018112:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2383us (2531us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.964461:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10630 00000100:00100000:1.0:1746144889.964518:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175018368 00000100:00100000:1.0:1746144889.964522:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175018368 00002000:00100000:1.0:1746144889.964551:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e56680 x1830965175018368/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.964559:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e56680 with x1830965175018368 ext(0->4095) 00002000:00010000:1.0:1746144889.964563:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e56680 00000100:00100000:1.0:1746144889.964576:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3897 00000100:00100000:1.0:1746144889.964581:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175018368:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144889.964723:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175018368:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 141us (444us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144889.964728:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3897 00002000:00100000:1.0:1746144889.964733:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e56680 x1830965175018368/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144889.964743:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e56680 with x1830965175018368 ext(0->4095) 00002000:00010000:1.0:1746144889.964746:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e56680 00000100:00100000:0.0:1746144889.967552:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.969355:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.971643:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.971687:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175018752 00000100:00100000:2.0:1746144889.971692:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175018752 00010000:00010000:2.0:1746144889.971714:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275147f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9425d expref: 6 pid: 20722 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144889.971743:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10631 00000100:00100000:2.0:1746144889.971750:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175018752:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144889.971783:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144889.971801:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275147f9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9425d expref: 6 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.971810:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275147f9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9425d expref: 6 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.971827:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275147f9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9425d expref: 6 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.972032:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.972034:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.972040:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514800 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94264 expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.972047:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514800 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94264 expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.972067:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514800 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94264 expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.972076:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514800 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94264 expref: 44 pid: 20722 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144889.972085:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172371584:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144889.972142:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.975425:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.975637:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175019008 00000100:00100000:2.0:1746144889.975643:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175019008 00002000:00100000:2.0:1746144889.975673:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e57480 x1830965175019008/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.975681:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e57480 with x1830965175019008 ext(0->4095) 00010000:00010000:2.0:1746144889.975687:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514800 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94264 expref: 45 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.975696:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514800 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94264 expref: 45 pid: 20722 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144889.975702:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e57480 00000100:00100000:2.0:1746144889.975715:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1883 00000100:00100000:2.0:1746144889.975722:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1984:x1830965175019008:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144889.975919:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1984:x1830965175019008:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 197us (500us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.975925:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1883 00002000:00100000:2.0:1746144889.975929:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e57480 x1830965175019008/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.975935:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e57480 with x1830965175019008 ext(0->4095) 00010000:00010000:2.0:1746144889.975940:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514800 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94264 expref: 45 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144889.975947:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514800 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94264 expref: 45 pid: 20722 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144889.975952:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e57480 00000100:00100000:0.0:1746144889.978430:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.984005:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.984077:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175019392 00000100:00100000:0.0:1746144889.984084:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175019392 00002000:00100000:0.0:1746144889.984114:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e832300 x1830965175019392/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144889.984123:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e832300 with x1830965175019392 ext(0->4095) 00002000:00010000:0.0:1746144889.984126:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e832300 00000100:00100000:0.0:1746144889.984139:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3898 00000100:00100000:0.0:1746144889.984145:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1982:x1830965175019392:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:0.0:1746144889.984785:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1982:x1830965175019392:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 638us (779us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144889.984793:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3898 00002000:00100000:0.0:1746144889.984798:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e832300 x1830965175019392/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144889.984811:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e832300 with x1830965175019392 ext(0->4095) 00002000:00010000:0.0:1746144889.984814:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e832300 00000100:00100000:0.0:1746144889.986555:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.987249:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175019520 00000100:00100000:2.0:1746144889.987257:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175019520 00000100:00100000:2.0:1746144889.987306:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5217 00000100:00100000:2.0:1746144889.987314:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175019520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.987327:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.987343:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751480e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94272 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.987368:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514807 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9426b expref: 43 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.987376:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.987377:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144889.987379:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751480e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94272 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.987404:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514807 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9426b expref: 43 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.987414:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514807 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9426b expref: 43 pid: 20722 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144889.987424:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172371840:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.987505:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144889.990258:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172371840:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.990288:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751480e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94272 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.990303:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:2.0:1746144889.990545:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175019520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3230us (3993us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.990553:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5217 00000100:00100000:0.0:1746144889.990656:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144889.993829:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.993882:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175019904 00000100:00100000:2.0:1746144889.993888:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175019904 00002000:00100000:2.0:1746144889.993926:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e55500 x1830965175019904/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/0 e 0 to 0 dl 1746144900 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.993934:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e55500 with x1830965175019904 ext(0->4095) 00002000:00010000:2.0:1746144889.993938:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e55500 00000100:00100000:2.0:1746144889.993962:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3899 00000100:00100000:2.0:1746144889.993968:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175019904:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144889.994507:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175019904:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 538us (678us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144889.994512:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3899 00002000:00100000:2.0:1746144889.994517:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e55500 x1830965175019904/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:530/0 lens 488/4536 e 0 to 0 dl 1746144900 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144889.994523:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e55500 with x1830965175019904 ext(0->4095) 00002000:00010000:2.0:1746144889.994525:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e55500 00000100:00100000:0.0:1746144889.995051:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144889.995094:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175020032 00000100:00100000:2.0:1746144889.995099:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175020032 00000100:00100000:2.0:1746144889.995127:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5218 00000100:00100000:2.0:1746144889.995133:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+43:31565:x1830965175020032:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144889.995141:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144889.995155:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514815 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94279 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.995178:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751480e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94272 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.995184:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.995186:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144889.995188:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514815 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94279 expref: 44 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.995214:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751480e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94272 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.995224:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af672751480e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94272 expref: 5 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144889.995233:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172372096:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144889.995301:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144889.996146:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144889.996203:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175020160 00000100:00100000:1.0:1746144889.996208:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175020160 00000100:00100000:1.0:1746144889.996240:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5219 00000100:00100000:1.0:1746144889.996245:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31579:x1830965175020160:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144889.996254:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144889.996262:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af672751481c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94280 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.996277:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144889.996281:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514815 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94279 expref: 46 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.996286:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144889.996288:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af672751481c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94280 expref: 46 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.996308:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514815 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94279 expref: 46 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.996317:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af672751481c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94280 expref: 46 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144889.996326:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501200, rc 0) 00000100:00100000:1.0:1746144889.996359:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+46:31579:x1830965175020160:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 114us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144889.996366:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5219 00000100:00100000:2.0:1746144889.997509:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172372096:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144889.997902:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514815 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94279 expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144889.997922:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:2.0:1746144889.997962:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31565:x1830965175020032:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2828us (2911us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144889.997986:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5218 00000100:00100000:0.0:1746144889.998172:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.001936:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a004700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175020288:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3599us (3762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.001948:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10634 00000100:00100000:0.0:1746144890.002416:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.002461:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175020544 00000100:00100000:2.0:1746144890.002468:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175020544 00002000:00100000:2.0:1746144890.002510:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a004a80 x1830965175020544/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.002519:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a004a80 with x1830965175020544 ext(0->4095) 00010000:00010000:2.0:1746144890.002526:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94279 expref: 45 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.002538:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94279 expref: 45 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.002544:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a004a80 00000100:00100000:2.0:1746144890.002573:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1884 00000100:00100000:2.0:1746144890.002580:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1985:x1830965175020544:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144890.002752:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a004a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1985:x1830965175020544:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 172us (337us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.002758:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1884 00002000:00100000:2.0:1746144890.002782:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a004a80 x1830965175020544/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.002790:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a004a80 with x1830965175020544 ext(0->4095) 00010000:00010000:2.0:1746144890.002796:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94279 expref: 45 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.002805:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94279 expref: 45 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.002811:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a004a80 00000100:00100000:0.0:1746144890.007051:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.007121:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175020672 00000100:00100000:2.0:1746144890.007132:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175020672 00010000:00010000:2.0:1746144890.007174:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94279 expref: 45 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.007214:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10635 00000100:00100000:2.0:1746144890.007222:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a004e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1984:x1830965175020672:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144890.007235:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144890.007257:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94279 expref: 45 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.007270:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514815 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94279 expref: 45 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.007294:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514815 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94279 expref: 45 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.007325:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.007327:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.007335:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af672751481c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94280 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.007347:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af672751481c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94280 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.007985:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af672751481c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94280 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144890.008000:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172372480:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.008657:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.012364:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.012511:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175020928 00000100:00100000:2.0:1746144890.012521:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175020928 00002000:00100000:2.0:1746144890.012577:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a005180 x1830965175020928/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.012587:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a005180 with x1830965175020928 ext(0->4095) 00002000:00010000:2.0:1746144890.012592:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a005180 00000100:00100000:2.0:1746144890.012612:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3900 00000100:00100000:2.0:1746144890.012620:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1985:x1830965175020928:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144890.012859:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1985:x1830965175020928:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 239us (504us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.012866:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3900 00002000:00100000:2.0:1746144890.012871:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a005180 x1830965175020928/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.012878:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a005180 with x1830965175020928 ext(0->4095) 00002000:00010000:2.0:1746144890.012881:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a005180 00000100:00100000:0.0:1746144890.016246:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.016362:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175021056 00000100:00100000:2.0:1746144890.016370:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175021056 00000100:00100000:2.0:1746144890.016749:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5220 00000100:00100000:2.0:1746144890.016758:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175021056:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.016901:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.016918:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514823 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94287 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.016952:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af672751481c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94280 expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.016961:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.016963:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.016966:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514823 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94287 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.017009:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af672751481c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94280 expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.017022:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af672751481c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94280 expref: 43 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.017035:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172372608:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.017656:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.019185:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172372608:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.019218:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514823 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94287 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.019240:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d200, rc 0) 00000100:00100000:2.0:1746144890.019292:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175021056:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2534us (3054us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.019300:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5220 00000100:00100000:0.0:1746144890.019574:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.023185:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.023275:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.023432:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175021568 00000100:00100000:2.0:1746144890.023439:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175021568 00000100:00100000:2.0:1746144890.023483:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5221 00000100:00100000:2.0:1746144890.023490:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175021568:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.023506:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.023523:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751482a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9428e expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.023551:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514823 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94287 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.023557:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.023560:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.023563:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751482a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9428e expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.023591:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514823 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94287 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.023602:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514823 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94287 expref: 5 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.023617:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172372864:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.023684:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144890.023742:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175021440 00000100:00100000:1.0:1746144890.023747:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175021440 00002000:00100000:1.0:1746144890.023801:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a005880 x1830965175021440/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.023809:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a005880 with x1830965175021440 ext(0->4095) 00010000:00010000:1.0:1746144890.023815:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514823 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94287 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.023825:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514823 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94287 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144890.023831:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a005880 00000100:00100000:1.0:1746144890.023845:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1885 00000100:00100000:1.0:1746144890.023850:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175021440:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144890.024028:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175021440:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 178us (853us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.024034:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1885 00002000:00100000:1.0:1746144890.024040:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a005880 x1830965175021440/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.024047:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a005880 with x1830965175021440 ext(0->4095) 00010000:00010000:1.0:1746144890.024051:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514823 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94287 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.024063:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514823 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94287 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144890.024068:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a005880 00000100:00100000:2.0:1746144890.028093:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172372864:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.028140:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751482a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9428e expref: 44 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.028161:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:2.0:1746144890.028223:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175021568:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4732us (4946us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.028231:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5221 00000100:00100000:0.0:1746144890.029559:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.030014:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.030641:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175021696 00000100:00100000:2.0:1746144890.030646:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175021696 00000100:00100000:2.0:1746144890.030682:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5222 00000100:00100000:2.0:1746144890.030692:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009969ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31579:x1830965175021696:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.030705:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.030717:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514831 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94295 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.030736:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751482a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9428e expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.030743:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.030744:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.030747:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514831 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94295 expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.030802:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751482a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9428e expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.030813:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751482a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9428e expref: 45 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.030822:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172373120:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.030860:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.034456:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172373120:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144890.034483:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1746144890.034499:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514831 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94295 expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.034517:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:2.0:1746144890.034564:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009969ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31579:x1830965175021696:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3872us (5010us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.034573:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5222 00000100:00100000:2.0:1746144890.034739:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175022080 00000100:00100000:2.0:1746144890.034744:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175022080 00002000:00100000:2.0:1746144890.034797:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a006300 x1830965175022080/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.034807:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a006300 with x1830965175022080 ext(0->4095) 00010000:00010000:2.0:1746144890.034814:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751482a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9428e expref: 45 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.034832:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751482a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9428e expref: 45 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.034839:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a006300 00000100:00100000:2.0:1746144890.034868:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1886 00000100:00100000:2.0:1746144890.034875:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1984:x1830965175022080:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144890.035247:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1984:x1830965175022080:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 373us (764us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.035254:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1886 00002000:00100000:2.0:1746144890.035259:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a006300 x1830965175022080/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.035266:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a006300 with x1830965175022080 ext(0->4095) 00010000:00010000:2.0:1746144890.035271:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751482a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9428e expref: 45 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.035279:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751482a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9428e expref: 45 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.035285:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a006300 00000100:00100000:0.0:1746144890.037697:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.042232:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.042699:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175022464 00000100:00100000:2.0:1746144890.042707:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175022464 00002000:00100000:2.0:1746144890.042749:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a006a00 x1830965175022464/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.042759:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a006a00 with x1830965175022464 ext(0->4095) 00002000:00010000:2.0:1746144890.042783:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a006a00 00000100:00100000:2.0:1746144890.042806:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3901 00000100:00100000:2.0:1746144890.042813:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175022464:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144890.042968:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175022464:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 156us (744us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.042986:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3901 00002000:00100000:2.0:1746144890.042991:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a006a00 x1830965175022464/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.042998:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a006a00 with x1830965175022464 ext(0->4095) 00002000:00010000:2.0:1746144890.043001:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a006a00 00000100:00100000:0.0:1746144890.045593:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.045946:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175022592 00000100:00100000:2.0:1746144890.045954:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175022592 00000100:00100000:2.0:1746144890.046009:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5223 00000100:00100000:2.0:1746144890.046016:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175022592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.046031:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.046047:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514838 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9429c expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.046073:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514831 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94295 expref: 43 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.046080:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.046081:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.046084:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514838 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9429c expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.046118:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514831 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94295 expref: 43 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.046129:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514831 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94295 expref: 43 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.046139:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172373376:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.047750:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.048455:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172373376:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.048488:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514838 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9429c expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.048504:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:2.0:1746144890.048559:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175022592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2542us (2975us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.048585:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5223 00000100:00100000:0.0:1746144890.049917:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.052963:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.053056:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175022848 00000100:00100000:2.0:1746144890.053063:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175022848 00000100:00100000:2.0:1746144890.053107:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5224 00000100:00100000:2.0:1746144890.053114:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175022848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.053134:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.053154:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751483f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af942a3 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.053180:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514838 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9429c expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.053188:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.053190:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.053193:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751483f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942a3 expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.053218:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514838 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9429c expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.053228:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514838 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9429c expref: 5 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.053238:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172373632:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.054054:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144890.054312:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.054526:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175023104 00000100:00100000:0.0:1746144890.054530:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175023104 00002000:00100000:0.0:1746144890.054562:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932a9500 x1830965175023104/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144890.054572:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a9500 with x1830965175023104 ext(0->4095) 00010000:00010000:0.0:1746144890.054579:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514838 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9429c expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:0.0:1746144890.054590:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514838 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9429c expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:0.0:1746144890.054596:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932a9500 00000100:00100000:0.0:1746144890.054611:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1887 00000100:00100000:0.0:1746144890.054617:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175023104:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144890.054805:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175023104:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 188us (493us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144890.054811:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1887 00002000:00100000:0.0:1746144890.054816:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932a9500 x1830965175023104/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144890.054823:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a9500 with x1830965175023104 ext(0->4095) 00010000:00010000:0.0:1746144890.054828:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514838 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9429c expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:0.0:1746144890.054836:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514838 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9429c expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:0.0:1746144890.054841:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932a9500 00000100:00100000:2.0:1746144890.057038:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172373632:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.057090:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751483f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942a3 expref: 44 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.057106:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:2.0:1746144890.057541:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175022848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4425us (4583us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.057548:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5224 00000100:00100000:0.0:1746144890.057935:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.058035:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175023232 00000100:00100000:2.0:1746144890.058041:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175023232 00000100:00100000:2.0:1746144890.058070:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5225 00000100:00100000:2.0:1746144890.058076:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31579:x1830965175023232:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.058097:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.058111:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514846 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af942aa expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.058129:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.058134:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751483f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942a3 expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.058140:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.058143:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514846 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942aa expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.058178:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751483f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942a3 expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.058189:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514846 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942aa expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.058197:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7d400, rc 0) 00000100:00100000:2.0:1746144890.058230:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31579:x1830965175023232:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 154us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.058236:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5225 00000100:00100000:0.0:1746144890.058412:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.061295:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.063826:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.066739:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.067127:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175024000 00000100:00100000:2.0:1746144890.067133:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175024000 00002000:00100000:2.0:1746144890.067174:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a004000 x1830965175024000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.067183:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a004000 with x1830965175024000 ext(0->4095) 00002000:00010000:2.0:1746144890.067188:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a004000 00000100:00100000:2.0:1746144890.067214:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3902 00000100:00100000:2.0:1746144890.067220:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175024000:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144890.067387:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175024000:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 167us (655us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.067392:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3902 00002000:00100000:2.0:1746144890.067397:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a004000 x1830965175024000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.067404:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a004000 with x1830965175024000 ext(0->4095) 00002000:00010000:2.0:1746144890.067407:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a004000 00000100:00100000:0.0:1746144890.069572:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.069672:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175024128 00000100:00100000:2.0:1746144890.069681:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175024128 00000100:00100000:2.0:1746144890.069736:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5226 00000100:00100000:2.0:1746144890.069743:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175024128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.069757:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.069805:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af672751484d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af942b1 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.069831:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514846 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942aa expref: 43 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.069838:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.069840:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.069843:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af672751484d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942b1 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.069877:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514846 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942aa expref: 43 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.069888:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514846 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942aa expref: 43 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.069900:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172374144:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.070452:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.072478:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.072605:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172374144:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.072637:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af672751484d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942b1 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.072756:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.072787:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.072794:0:8432:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af672751484d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942b1 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.072802:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af672751484d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942b1 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.072830:0:8432:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af672751484d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942b1 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144890.072842:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172374272:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.072897:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.074990:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172374272:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144890.075018:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7c000, rc 0) 00000100:00100000:2.0:1746144890.075063:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175024128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5320us (5498us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.075071:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5226 00000100:00100000:0.0:1746144890.076963:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.077267:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175024512 00000100:00100000:1.0:1746144890.077276:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175024512 00002000:00100000:1.0:1746144890.077322:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a004700 x1830965175024512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.077333:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a004700 with x1830965175024512 ext(0->4095) 00002000:00010000:1.0:1746144890.077337:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a004700 00000100:00100000:0.0:1746144890.077344:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.077374:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3903 00000100:00100000:1.0:1746144890.077381:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175024512:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144890.077585:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175024512:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 204us (628us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.077591:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3903 00002000:00100000:1.0:1746144890.077597:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a004700 x1830965175024512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.077603:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a004700 with x1830965175024512 ext(0->4095) 00002000:00010000:1.0:1746144890.077606:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a004700 00000100:00100000:2.0:1746144890.077758:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175024640 00000100:00100000:2.0:1746144890.077778:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175024640 00000100:00100000:2.0:1746144890.077803:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5227 00000100:00100000:2.0:1746144890.077807:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+43:31565:x1830965175024640:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.077816:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.077831:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514854 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af942b8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.077853:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af672751484d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942b1 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.077860:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.077862:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.077865:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514854 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942b8 expref: 44 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.077890:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af672751484d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942b1 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.077898:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af672751484d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942b1 expref: 5 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.077908:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172374400:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.077951:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.079956:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.080830:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175024768 00000100:00100000:1.0:1746144890.080838:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175024768 00000100:00100000:1.0:1746144890.080888:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5228 00000100:00100000:1.0:1746144890.080895:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31579:x1830965175024768:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144890.080909:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144890.080924:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af672751485b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af942bf expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.080948:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.080954:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514854 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942b8 expref: 46 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.080960:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.080964:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af672751485b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942bf expref: 46 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144890.081082:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172374400:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.081107:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514854 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942b8 expref: 46 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.081118:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:2.0:1746144890.081156:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+46:31565:x1830965175024640:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3347us (3810us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.081162:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5227 00010000:00010000:1.0:1746144890.082283:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514854 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942b8 expref: 45 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.082298:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af672751485b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942bf expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.082308:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501200, rc 0) 00000100:00100000:1.0:1746144890.082343:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31579:x1830965175024768:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1448us (2394us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.082348:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5228 00000100:00100000:0.0:1746144890.083282:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.087694:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.090965:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.094479:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.094629:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175025536 00000100:00100000:1.0:1746144890.094636:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175025536 00002000:00100000:1.0:1746144890.094678:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a3480 x1830965175025536/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.094695:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a3480 with x1830965175025536 ext(0->4095) 00002000:00010000:1.0:1746144890.094699:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938a3480 00000100:00100000:1.0:1746144890.094944:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3904 00000100:00100000:1.0:1746144890.094952:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175025536:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144890.095126:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175025536:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 175us (654us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.095132:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3904 00002000:00100000:1.0:1746144890.095137:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a3480 x1830965175025536/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.095143:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a3480 with x1830965175025536 ext(0->4095) 00002000:00010000:1.0:1746144890.095146:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938a3480 00000100:00100000:0.0:1746144890.098427:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.098552:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175025664 00000100:00100000:1.0:1746144890.098560:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175025664 00000100:00100000:1.0:1746144890.099194:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5229 00000100:00100000:1.0:1746144890.099203:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175025664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144890.099220:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144890.099238:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514862 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af942c6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.099267:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af672751485b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942bf expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.099274:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.099276:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.099281:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514862 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942c6 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.099310:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af672751485b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942bf expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.099322:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af672751485b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942bf expref: 43 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144890.099333:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172374912:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144890.099422:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144890.101902:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172374912:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144890.101934:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514862 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942c6 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.101950:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500c00, rc 0) 00000100:00100000:1.0:1746144890.102015:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175025664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2812us (3595us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.102023:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5229 00000100:00100000:0.0:1746144890.102469:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.106438:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.106993:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.107020:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175026176 00000100:00100000:0.0:1746144890.107025:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175026176 00000100:00100000:0.0:1746144890.107053:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5230 00000100:00100000:0.0:1746144890.107059:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+43:31565:x1830965175026176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144890.107075:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144890.107092:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514869 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af942cd expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144890.107120:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514862 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942c6 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144890.107127:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144890.107130:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144890.107133:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514869 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942cd expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144890.107158:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514862 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942c6 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144890.107168:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514862 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942c6 expref: 5 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:0.0:1746144890.107178:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800938a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172375168:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144890.107227:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.107433:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175026048 00000100:00100000:2.0:1746144890.107437:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175026048 00002000:00100000:2.0:1746144890.107467:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a0a80 x1830965175026048/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.107476:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a0a80 with x1830965175026048 ext(0->4095) 00010000:00010000:2.0:1746144890.107481:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514862 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942c6 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.107491:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514862 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942c6 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.107497:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a0a80 00000100:00100000:2.0:1746144890.107519:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1890 00000100:00100000:2.0:1746144890.107525:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175026048:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144890.107692:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175026048:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 166us (1261us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.107700:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1890 00002000:00100000:2.0:1746144890.107705:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a0a80 x1830965175026048/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.107712:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a0a80 with x1830965175026048 ext(0->4095) 00010000:00010000:2.0:1746144890.107716:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514862 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942c6 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.107723:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514862 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942c6 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.107729:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a0a80 00000100:00100000:2.0:1746144890.109537:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800938a3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172375168:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.109562:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514869 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942cd expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.109575:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:2.0:1746144890.109812:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175026176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2752us (2817us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.109819:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5230 00000100:00100000:0.0:1746144890.111898:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.117299:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.117505:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175026560 00000100:00100000:1.0:1746144890.117513:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175026560 00002000:00100000:1.0:1746144890.117559:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a3100 x1830965175026560/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.117569:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a3100 with x1830965175026560 ext(0->4095) 00002000:00010000:1.0:1746144890.117574:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938a3100 00000100:00100000:1.0:1746144890.118006:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3905 00000100:00100000:1.0:1746144890.118014:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175026560:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144890.118210:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175026560:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 196us (916us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.118216:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3905 00002000:00100000:1.0:1746144890.118222:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a3100 x1830965175026560/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.118229:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a3100 with x1830965175026560 ext(0->4095) 00002000:00010000:1.0:1746144890.118232:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938a3100 00000100:00100000:0.0:1746144890.125284:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.125398:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175026688 00000100:00100000:2.0:1746144890.125408:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175026688 00000100:00100000:2.0:1746144890.125476:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5231 00000100:00100000:2.0:1746144890.125486:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175026688:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.125507:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.125528:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514870 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af942d4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.125559:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514869 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942cd expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.125566:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.125568:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.125572:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514870 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942d4 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.125604:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514869 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942cd expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.125615:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514869 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942cd expref: 43 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.125627:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172375424:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.130310:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.132613:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172375424:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.132649:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514870 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942d4 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.132666:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d200, rc 0) 00000100:00100000:2.0:1746144890.132716:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175026688:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7231us (7444us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.132724:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5231 00000100:00100000:0.0:1746144890.136879:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.137224:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175026816 00000100:00100000:2.0:1746144890.137235:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175026816 00002000:00100000:2.0:1746144890.137291:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009230d500 x1830965175026816/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 496/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.137302:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230d500 with x1830965175026816 ext(0->7) 00010000:00010000:2.0:1746144890.137312:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514869 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942cd expref: 44 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.137326:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514869 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942cd expref: 44 pid: 8430 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.137333:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230d500 00000100:00100000:2.0:1746144890.137959:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1891 00000100:00100000:2.0:1746144890.137969:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175026816:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144890.138353:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1985:x1830965175026816:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 385us (1588us total) trans 4294967985 rc 0/0 00000100:00100000:2.0:1746144890.138360:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1891 00002000:00100000:2.0:1746144890.138366:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009230d500 x1830965175026816/t4294967985(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 496/448 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.138374:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230d500 with x1830965175026816 ext(0->7) 00010000:00010000:2.0:1746144890.138380:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514869 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942cd expref: 46 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.138389:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514869 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942cd expref: 46 pid: 8430 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.138400:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230d500 00000100:00100000:0.0:1746144890.141241:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.141833:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175026944 00000100:00100000:2.0:1746144890.141842:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175026944 00000100:00100000:2.0:1746144890.142745:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5232 00000100:00100000:2.0:1746144890.142756:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+46:31565:x1830965175026944:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.142792:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.142811:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514877 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af942db expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.142846:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.142852:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514870 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942d4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.142859:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144890.142862:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514877 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942db expref: 47 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.142902:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514870 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942d4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.142915:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514877 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942db expref: 47 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.142924:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:2.0:1746144890.142991:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+47:31565:x1830965175026944:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 237us (1758us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.143001:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5232 00000100:00100000:0.0:1746144890.144646:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.148352:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.148874:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175027328 00000100:00100000:1.0:1746144890.148882:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175027328 00002000:00100000:1.0:1746144890.148923:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f72300 x1830965175027328/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.148933:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f72300 with x1830965175027328 ext(0->4095) 00010000:00010000:1.0:1746144890.148942:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514870 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942d4 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.148955:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514870 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942d4 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144890.148961:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f72300 00000100:00100000:1.0:1746144890.148993:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1892 00000100:00100000:1.0:1746144890.148999:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175027328:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144890.149164:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175027328:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 166us (823us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.149174:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1892 00002000:00100000:1.0:1746144890.149180:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f72300 x1830965175027328/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.149186:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f72300 with x1830965175027328 ext(0->4095) 00010000:00010000:1.0:1746144890.149191:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514870 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942d4 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.149199:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514870 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942d4 expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144890.149205:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f72300 00000100:00100000:0.0:1746144890.152701:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.156393:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.157075:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175027712 00000100:00100000:2.0:1746144890.157083:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175027712 00002000:00100000:2.0:1746144890.157127:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e81f80 x1830965175027712/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.157137:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e81f80 with x1830965175027712 ext(0->4095) 00002000:00010000:2.0:1746144890.157142:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e81f80 00000100:00100000:2.0:1746144890.157159:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3906 00000100:00100000:2.0:1746144890.157165:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1982:x1830965175027712:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746144890.157336:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1982:x1830965175027712:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 171us (945us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.157342:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3906 00002000:00100000:2.0:1746144890.157346:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e81f80 x1830965175027712/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.157353:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e81f80 with x1830965175027712 ext(0->4095) 00002000:00010000:2.0:1746144890.157356:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e81f80 00000100:00100000:0.0:1746144890.168364:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.170725:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.170805:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175027968 00000100:00100000:1.0:1746144890.170811:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175027968 00002000:00100000:1.0:1746144890.170848:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009bb48000 x1830965175027968/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 496/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.170857:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb48000 with x1830965175027968 ext(0->7) 00010000:00010000:1.0:1746144890.170864:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514877 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942db expref: 46 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.170875:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514877 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942db expref: 46 pid: 8430 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144890.170880:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb48000 00000100:00100000:1.0:1746144890.170907:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1893 00000100:00100000:1.0:1746144890.170913:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1985:x1830965175027968:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144890.171230:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+48:1985:x1830965175027968:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 316us (505us total) trans 4294967986 rc 0/0 00000100:00100000:1.0:1746144890.171235:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1893 00002000:00100000:1.0:1746144890.171239:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009bb48000 x1830965175027968/t4294967986(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 496/448 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.171245:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb48000 with x1830965175027968 ext(0->7) 00010000:00010000:1.0:1746144890.171249:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514877 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942db expref: 48 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.171257:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514877 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942db expref: 48 pid: 8430 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144890.171262:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb48000 00000100:00100000:0.0:1746144890.172390:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.176494:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.176563:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175028352 00000100:00100000:2.0:1746144890.176571:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175028352 00002000:00100000:2.0:1746144890.176618:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167e680 x1830965175028352/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.176629:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167e680 with x1830965175028352 ext(0->4095) 00002000:00010000:2.0:1746144890.176635:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167e680 00000100:00100000:2.0:1746144890.176672:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3907 00000100:00100000:2.0:1746144890.176681:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175028352:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746144890.176914:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175028352:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 233us (427us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.176921:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3907 00002000:00100000:2.0:1746144890.176926:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167e680 x1830965175028352/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.176933:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167e680 with x1830965175028352 ext(0->4095) 00002000:00010000:2.0:1746144890.176935:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167e680 00000100:00100000:0.0:1746144890.180016:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.188110:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.192135:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.197713:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.201855:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.222941:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.227504:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.227813:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175029504 00000100:00100000:2.0:1746144890.227820:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175029504 00002000:00100000:2.0:1746144890.227861:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4b100 x1830965175029504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.227870:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b100 with x1830965175029504 ext(0->4095) 00002000:00010000:2.0:1746144890.227876:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4b100 00000100:00100000:2.0:1746144890.227898:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3909 00000100:00100000:2.0:1746144890.227904:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175029504:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746144890.228074:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175029504:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 170us (582us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.228080:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3909 00002000:00100000:2.0:1746144890.228085:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4b100 x1830965175029504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.228092:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b100 with x1830965175029504 ext(0->4095) 00002000:00010000:2.0:1746144890.228094:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4b100 00000100:00100000:0.0:1746144890.229854:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.234333:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.234393:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175029760 00000100:00100000:2.0:1746144890.234402:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175029760 00000100:00100000:2.0:1746144890.235444:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5237 00000100:00100000:2.0:1746144890.235461:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+51:31565:x1830965175029760:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.235482:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.235502:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751489a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af942fe expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.235530:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.235536:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514893 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942f7 expref: 52 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.235541:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.235545:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751489a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942fe expref: 52 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.235582:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514893 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942f7 expref: 52 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.235596:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751489a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942fe expref: 52 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.235605:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:2.0:1746144890.235659:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+52:31565:x1830965175029760:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 206us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.235666:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5237 00000100:00100000:0.0:1746144890.237702:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.242909:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.245410:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.246729:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1746144890.248202:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751489a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942fe expref: 50 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.248218:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af672751489a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af942fe expref: 50 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.248229:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172377216:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.248298:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.250704:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.250819:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172377216:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144890.250843:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144890.250878:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a005c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1984:x1830965175030400:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3350us (4149us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.250888:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10653 00000100:00100000:0.0:1746144890.256847:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.256905:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.257477:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175030784 00000100:00100000:2.0:1746144890.257488:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175030784 00000100:00100000:2.0:1746144890.257542:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5239 00000100:00100000:2.0:1746144890.257550:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+50:31565:x1830965175030784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.257575:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.257594:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275148a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9430c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.257624:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.257631:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af67275148a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94305 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.257637:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144890.257641:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275148a8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9430c expref: 51 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.257686:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af67275148a1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94305 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.257699:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275148a8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9430c expref: 52 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.257708:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:2.0:1746144890.257756:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+52:31565:x1830965175030784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 207us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.257778:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5239 00000100:00100000:0.0:1746144890.262491:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.268159:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.275370:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.280692:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.280791:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175031680 00000100:00100000:2.0:1746144890.280800:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175031680 00000100:00100000:2.0:1746144890.280838:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5240 00000100:00100000:2.0:1746144890.280844:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175031680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.280861:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.280874:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275148af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94313 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.280899:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275148a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9430c expref: 49 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.280905:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.280907:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.280910:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275148af lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94313 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.280939:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275148a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9430c expref: 49 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.280949:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275148a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9430c expref: 49 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.280959:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172377728:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.281073:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.283894:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172377728:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.283923:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275148af lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94313 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.283938:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:2.0:1746144890.284204:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175031680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3358us (3518us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.284213:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5240 00000100:00100000:0.0:1746144890.284372:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.284395:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.284618:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175031808 00000100:00100000:2.0:1746144890.284624:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175031808 00000100:00100000:2.0:1746144890.284649:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5241 00000100:00100000:2.0:1746144890.284655:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+50:31565:x1830965175031808:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.284666:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.284677:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9431a expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.284697:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.284701:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275148af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94313 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.284707:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144890.284710:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148b6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9431a expref: 51 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.284735:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275148af lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94313 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.284744:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148b6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9431a expref: 51 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.284751:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:2.0:1746144890.284795:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+51:31565:x1830965175031808:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 140us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.284800:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5241 00000100:00100000:0.0:1746144890.290133:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172377984:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144890.290153:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144890.290202:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1983:x1830965175031936:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5283us (5805us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144890.290212:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10656 00000100:00100000:0.0:1746144890.290599:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.297028:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.297088:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175032320 00000100:00100000:2.0:1746144890.297097:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175032320 00010000:00010000:2.0:1746144890.297128:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275148af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94313 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.297561:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10657 00000100:00100000:2.0:1746144890.297569:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175032320:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144890.297581:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144890.297599:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275148af lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94313 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.297624:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275148af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94313 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.297643:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275148af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94313 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.297666:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.297668:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.297673:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9431a expref: 49 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.297681:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9431a expref: 49 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.297847:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9431a expref: 49 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144890.297859:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172378112:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.297930:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.299724:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172378112:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144890.299756:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144890.299808:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175032320:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2240us (2787us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.299817:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10657 00000100:00100000:0.0:1746144890.300241:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.304539:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.304721:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175032704 00000100:00100000:2.0:1746144890.304729:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175032704 00000100:00100000:2.0:1746144890.304794:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5242 00000100:00100000:2.0:1746144890.304802:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175032704:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.304837:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.304854:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275148bd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94321 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.304877:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9431a expref: 49 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.304883:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.304884:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.304887:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275148bd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94321 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.304911:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9431a expref: 49 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.304920:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9431a expref: 49 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.304930:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172378240:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.305047:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.307932:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172378240:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.307958:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275148bd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94321 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.307984:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d200, rc 0) 00000100:00100000:2.0:1746144890.308013:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175032704:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3212us (3481us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.308020:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5242 00000100:00100000:0.0:1746144890.315008:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.315279:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175032832 00000100:00100000:2.0:1746144890.315286:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175032832 00002000:00100000:2.0:1746144890.315322:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880087e56a00 x1830965175032832/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 496/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.315330:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e56a00 with x1830965175032832 ext(0->7) 00010000:00010000:2.0:1746144890.315337:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9431a expref: 50 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.315349:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9431a expref: 50 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.315354:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e56a00 00000100:00100000:2.0:1746144890.315379:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1899 00000100:00100000:2.0:1746144890.315386:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1984:x1830965175032832:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144890.315647:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+52:1984:x1830965175032832:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 261us (646us total) trans 4294967988 rc 0/0 00000100:00100000:2.0:1746144890.315653:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1899 00002000:00100000:2.0:1746144890.315659:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880087e56a00 x1830965175032832/t4294967988(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 496/448 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.315670:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e56a00 with x1830965175032832 ext(0->7) 00010000:00010000:2.0:1746144890.315674:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9431a expref: 52 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.315682:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9431a expref: 52 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.315687:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e56a00 00000100:00100000:0.0:1746144890.321656:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.321710:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.321718:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175033088 00000100:00100000:2.0:1746144890.321726:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175033088 00000100:00100000:2.0:1746144890.322084:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5243 00000100:00100000:2.0:1746144890.322089:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+52:31565:x1830965175033088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.322100:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.322109:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275148c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94328 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.322122:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275148bd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94321 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.322126:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.322127:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.322130:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275148c4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94328 expref: 53 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.322144:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275148bd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94321 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.322156:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af67275148bd lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94321 expref: 5 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.322164:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172378496:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.322185:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.325290:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172378496:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.325312:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275148c4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94328 expref: 52 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.325324:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:2.0:1746144890.325342:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+52:31565:x1830965175033088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3253us (3694us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.325348:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5243 00000100:00100000:0.0:1746144890.325852:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.335101:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.343064:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.358158:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.358229:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175033856 00000100:00100000:2.0:1746144890.358237:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175033856 00000100:00100000:2.0:1746144890.358284:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5244 00000100:00100000:2.0:1746144890.358291:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175033856:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.358305:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.358319:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9432f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.358345:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275148c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94328 expref: 51 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.358356:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.358358:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.358361:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148cb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9432f expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.358384:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275148c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94328 expref: 51 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.358394:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275148c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94328 expref: 51 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.358405:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172378752:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.358480:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.359669:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172378752:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.359689:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148cb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9432f expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.359701:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:2.0:1746144890.359736:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175033856:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1446us (1586us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.359744:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5244 00000100:00100000:0.0:1746144890.374462:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.374550:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175033984 00000100:00100000:2.0:1746144890.374557:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175033984 00000100:00100000:2.0:1746144890.374644:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5245 00000100:00100000:2.0:1746144890.374653:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+52:31565:x1830965175033984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.374671:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.374684:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275148d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94336 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.374707:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.374711:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9432f expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.374716:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144890.374719:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275148d2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94336 expref: 53 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.374747:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148cb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9432f expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.374758:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275148d2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94336 expref: 53 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.374869:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:2.0:1746144890.374903:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+53:31565:x1830965175033984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 252us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.374908:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5245 00000100:00100000:0.0:1746144890.379413:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.383175:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.388842:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.388959:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175034496 00000100:00100000:2.0:1746144890.388967:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175034496 00002000:00100000:2.0:1746144890.389012:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880098df4850 x1830965175034496/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.389021:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098df4850 with x1830965175034496 ext(0->4095) 00010000:00010000:2.0:1746144890.389029:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9432f expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.389039:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9432f expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.389045:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098df4850 00000100:00100000:2.0:1746144890.389069:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1902 00000100:00100000:2.0:1746144890.389075:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098df4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175034496:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144890.389213:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098df4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175034496:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 138us (380us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.389219:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1902 00002000:00100000:2.0:1746144890.389223:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880098df4850 x1830965175034496/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.389230:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098df4850 with x1830965175034496 ext(0->4095) 00010000:00010000:2.0:1746144890.389233:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9432f expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.389241:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af67275148cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9432f expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.389245:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098df4850 00000100:00100000:0.0:1746144890.394258:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.397693:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.397911:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175034880 00000100:00100000:2.0:1746144890.397916:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175034880 00002000:00100000:2.0:1746144890.397946:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee68380 x1830965175034880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.397961:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee68380 with x1830965175034880 ext(0->4095) 00002000:00010000:2.0:1746144890.397964:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee68380 00000100:00100000:2.0:1746144890.397983:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3913 00000100:00100000:2.0:1746144890.397988:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+54:1985:x1830965175034880:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144890.400287:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee68380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+54:1985:x1830965175034880:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 2291us (2595us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.400295:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3913 00002000:00100000:2.0:1746144890.400305:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee68380 x1830965175034880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.400312:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee68380 with x1830965175034880 ext(0->4095) 00002000:00010000:2.0:1746144890.400316:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee68380 00000100:00100000:2.0:1746144890.414328:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.414394:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175035008 00000100:00100000:0.0:1746144890.414403:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175035008 00000100:00100000:0.0:1746144890.414449:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5246 00000100:00100000:0.0:1746144890.414456:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175035008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144890.414470:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144890.414483:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275148d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9433d expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144890.414507:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275148d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94336 expref: 53 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144890.414513:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144890.414514:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144890.414517:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275148d9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9433d expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144890.414542:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275148d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94336 expref: 53 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144890.414553:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275148d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94336 expref: 53 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:0.0:1746144890.414563:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172379264:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144890.414641:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.420586:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008ee69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172379264:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.420622:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275148d9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9433d expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.420638:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:2.0:1746144890.420681:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175035008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6225us (6360us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.420689:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5246 00000100:00100000:0.0:1746144890.424508:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.424956:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175035136 00000100:00100000:2.0:1746144890.424965:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175035136 00002000:00100000:2.0:1746144890.425013:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008ee69c00 x1830965175035136/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 496/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.425024:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee69c00 with x1830965175035136 ext(0->7) 00010000:00010000:2.0:1746144890.425030:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275148d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94336 expref: 54 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.425042:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275148d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94336 expref: 54 pid: 8430 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.425048:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ee69c00 00000100:00100000:2.0:1746144890.425072:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1903 00000100:00100000:2.0:1746144890.425078:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+54:1985:x1830965175035136:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144890.425321:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1985:x1830965175035136:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 243us (820us total) trans 4294967990 rc 0/0 00000100:00100000:2.0:1746144890.425327:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1903 00002000:00100000:2.0:1746144890.425331:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008ee69c00 x1830965175035136/t4294967990(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 496/448 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.425338:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee69c00 with x1830965175035136 ext(0->7) 00010000:00010000:2.0:1746144890.425342:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275148d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94336 expref: 56 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.425349:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af67275148d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94336 expref: 56 pid: 8430 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.425354:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ee69c00 00000100:00100000:0.0:1746144890.428050:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.429237:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175035264 00000100:00100000:2.0:1746144890.429251:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175035264 00000100:00100000:2.0:1746144890.429305:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5247 00000100:00100000:2.0:1746144890.429313:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+56:31565:x1830965175035264:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.429329:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.429347:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275148e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94344 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.429370:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.429375:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275148d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9433d expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.429381:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144890.429384:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275148e0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94344 expref: 57 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.429415:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275148d9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9433d expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.429427:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275148e0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94344 expref: 57 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.429436:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:2.0:1746144890.429486:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+57:31565:x1830965175035264:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 173us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.429491:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5247 00000100:00100000:0.0:1746144890.431487:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.441123:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.445237:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.447376:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10663 00000100:00100000:1.0:1746144890.447387:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175035776:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144890.447399:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144890.447418:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275148d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9433d expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.447430:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275148d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9433d expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.447450:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275148d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9433d expref: 6 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.447706:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.447708:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.447714:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275148e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94344 expref: 55 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.447721:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275148e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94344 expref: 55 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.447748:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275148e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94344 expref: 55 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144890.447757:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172379648:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144890.448100:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144890.451289:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172379648:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144890.451308:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144890.451419:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175035776:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4033us (6188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.451429:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10663 00000100:00100000:0.0:1746144890.455001:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.455104:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175036032 00000100:00100000:2.0:1746144890.455112:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175036032 00002000:00100000:2.0:1746144890.455155:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee6a680 x1830965175036032/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.455164:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6a680 with x1830965175036032 ext(0->4095) 00002000:00010000:2.0:1746144890.455168:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee6a680 00000100:00100000:2.0:1746144890.455253:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3914 00000100:00100000:2.0:1746144890.455262:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1984:x1830965175036032:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144890.455418:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1984:x1830965175036032:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 157us (424us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.455424:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3914 00002000:00100000:2.0:1746144890.455429:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee6a680 x1830965175036032/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.455436:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6a680 with x1830965175036032 ext(0->4095) 00002000:00010000:2.0:1746144890.455439:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee6a680 00000100:00100000:0.0:1746144890.463586:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.472222:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.479462:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.479831:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175036416 00000100:00100000:1.0:1746144890.479840:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175036416 00010000:00010000:1.0:1746144890.479870:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275148e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94344 expref: 58 pid: 8430 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144890.479906:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10664 00000100:00100000:1.0:1746144890.479914:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1983:x1830965175036416:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144890.479928:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144890.479946:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275148e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94344 expref: 58 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.479956:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275148e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94344 expref: 58 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.479988:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af67275148e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94344 expref: 58 pid: 8430 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.480009:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.480011:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.480017:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275148e7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9434b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.480025:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275148e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9434b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.480054:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275148e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9434b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144890.480064:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172379904:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144890.480620:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.484713:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.484816:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172379904:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144890.484838:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144890.484878:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+57:1983:x1830965175036416:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4964us (5424us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.484891:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10664 00000100:00100000:2.0:1746144890.485015:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175036672 00000100:00100000:2.0:1746144890.485020:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175036672 00002000:00100000:2.0:1746144890.485057:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee69180 x1830965175036672/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.485067:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee69180 with x1830965175036672 ext(0->4095) 00002000:00010000:2.0:1746144890.485071:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee69180 00000100:00100000:2.0:1746144890.485352:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3915 00000100:00100000:2.0:1746144890.485359:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175036672:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144890.485476:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175036672:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 118us (772us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.485484:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3915 00002000:00100000:2.0:1746144890.485488:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee69180 x1830965175036672/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.485495:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee69180 with x1830965175036672 ext(0->4095) 00002000:00010000:2.0:1746144890.485498:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee69180 00000100:00100000:0.0:1746144890.489307:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.489387:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.489591:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5250 00000100:00100000:0.0:1746144890.489597:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+59:31579:x1830965175036928:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144890.489604:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144890.489610:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275148f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94359 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144890.489624:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144890.489627:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af67275148ee lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94352 expref: 60 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144890.489632:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144890.489634:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275148f5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94359 expref: 60 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144890.489652:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af67275148ee lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94352 expref: 60 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144890.489662:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275148f5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94359 expref: 60 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144890.489670:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:0.0:1746144890.489690:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+60:31579:x1830965175036928:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 93us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144890.489695:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5250 00000100:00100000:0.0:1746144890.493565:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.493946:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175037056 00000100:00100000:1.0:1746144890.493953:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175037056 00010000:00010000:1.0:1746144890.493990:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275148e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9434b expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144890.494084:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10665 00000100:00100000:1.0:1746144890.494091:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175037056:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144890.494102:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144890.494120:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275148e7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9434b expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.494130:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275148e7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9434b expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.494148:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275148e7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9434b expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.494171:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.494173:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.494180:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af67275148ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94352 expref: 58 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.494188:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af67275148ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94352 expref: 58 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.494215:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af67275148ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94352 expref: 58 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.494229:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af67275148ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94352 expref: 58 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144890.494239:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172380288:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144890.494303:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144890.495962:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172380288:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144890.495987:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144890.496023:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175037056:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1932us (2459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.496029:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10665 00000100:00100000:0.0:1746144890.496677:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.500506:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.500742:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175037440 00000100:00100000:1.0:1746144890.500751:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175037440 00010000:00010000:1.0:1746144890.500806:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af67275148ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94352 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144890.500841:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10666 00000100:00100000:1.0:1746144890.500848:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1983:x1830965175037440:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144890.500861:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144890.500877:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af67275148ee lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94352 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.500886:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af67275148ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94352 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.500903:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af67275148ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94352 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.500926:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.500928:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.500933:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275148f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94359 expref: 58 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.500941:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275148f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94359 expref: 58 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.500977:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275148f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94359 expref: 58 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144890.500988:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172380416:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144890.501047:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144890.503917:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172380416:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144890.503934:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144890.503964:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1983:x1830965175037440:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3116us (3466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.503985:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10666 00000100:00100000:0.0:1746144890.504308:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.504457:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175037696 00000100:00100000:2.0:1746144890.504462:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175037696 00002000:00100000:2.0:1746144890.504492:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee6bb80 x1830965175037696/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.504501:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6bb80 with x1830965175037696 ext(0->4095) 00002000:00010000:2.0:1746144890.504504:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee6bb80 00000100:00100000:2.0:1746144890.504802:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3916 00000100:00100000:2.0:1746144890.504809:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1985:x1830965175037696:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144890.504931:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1985:x1830965175037696:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 124us (624us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.504937:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3916 00002000:00100000:2.0:1746144890.504942:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee6bb80 x1830965175037696/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.504949:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6bb80 with x1830965175037696 ext(0->4095) 00002000:00010000:2.0:1746144890.504951:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee6bb80 00000100:00100000:0.0:1746144890.507055:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.507925:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965172381056:0@lo:400:kworker.0 00000100:00100000:2.0:1746144890.507952:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144890.507984:0:3308:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1830965172380800:0@lo:400:kworker.0 00000100:00100000:2.0:1746144890.508005:0:3308:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144890.508018:0:3309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1830965172380928:0@lo:400:kworker.0 00000100:00100000:0.0:1746144890.508019:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172381056 00000100:00100000:0.0:1746144890.508023:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172381056 00000100:00100000:2.0:1746144890.508031:0:3309:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144890.508044:0:21078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172380800 00000100:00100000:2.0:1746144890.508047:0:21078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172380800 00000100:00100000:0.0:1746144890.508055:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1746144890.508060:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1830965172381056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746144890.508065:0:21078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172380928 00000100:00100000:2.0:1746144890.508066:0:21078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172380928 00000100:00100000:2.0:1746144890.508079:0:21078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1746144890.508084:0:21078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1830965172380800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746144890.508106:0:21078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1830965172380800:12345-0@lo:400:kworker.0 Request processed in 23us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.508111:0:21078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1746144890.508123:0:21078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1746144890.508126:0:21078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1830965172380928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746144890.508140:0:21078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1830965172380928:12345-0@lo:400:kworker.0 Request processed in 14us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.508145:0:21078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1746144890.508190:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1830965172381056:12345-0@lo:400:kworker.0 Request processed in 129us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144890.508196:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1746144890.508252:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2566f13b-362a-4e88-b0dd-c558bbe87895:3307:1830965172380672:0@lo:400:kworker.0 00000100:00100000:1.0:1746144890.508275:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144890.508289:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1830965172381184:0@lo:400:kworker.0 00000100:00100000:0.0:1746144890.508291:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172380672 00000100:00100000:0.0:1746144890.508294:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172380672 00000100:00100000:1.0:1746144890.508301:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144890.508312:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1746144890.508316:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2566f13b-362a-4e88-b0dd-c558bbe87895+18:3307:x1830965172380672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746144890.508317:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172381184 00000100:00100000:1.0:1746144890.508319:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172381184 00000100:00100000:1.0:1746144890.508334:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1746144890.508339:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1830965172381184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144890.508342:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2566f13b-362a-4e88-b0dd-c558bbe87895+18:3307:x1830965172380672:12345-0@lo:400:kworker.0 Request processed in 26us (66us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144890.508346:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1746144890.508357:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1830965172381184:12345-0@lo:400:kworker.0 Request processed in 18us (55us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.508362:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:1.0:1746144890.508371:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1746144890.508374:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746144890.508394:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2566f13b-362a-4e88-b0dd-c558bbe87895:3307:1830965172380672:0@lo:400:kworker.0 00000100:00100000:1.0:1746144890.508406:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1830965172381184:0@lo:400:kworker.0 00000100:00100000:2.0:1746144890.508716:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965172381056:0@lo:400:kworker.0 00000100:00100000:0.0:1746144890.508830:0:3308:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1830965172380800:0@lo:400:kworker.0 00000100:00100000:0.0:1746144890.508835:0:3308:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1830965172381312:0@lo:400:kworker.0 00000100:00100000:0.0:1746144890.508852:0:3308:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144890.508951:0:3309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1830965172380928:0@lo:400:kworker.0 00000100:00080000:1.0:1746144890.509590:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144890.509647:0:3308:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1830965172381312:0@lo:400:kworker.0 00000100:00100000:0.0:1746144890.510903:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.511075:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175037952 00000100:00100000:1.0:1746144890.511079:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175037952 00010000:00010000:1.0:1746144890.511100:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275148f5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94359 expref: 58 pid: 20722 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144890.511484:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10667 00000100:00100000:1.0:1746144890.511489:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1985:x1830965175037952:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144890.511498:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144890.511515:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275148f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94359 expref: 58 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.511524:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275148f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94359 expref: 58 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.511541:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275148f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94359 expref: 58 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.511558:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.511559:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.511565:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275148fc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94360 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.511571:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275148fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94360 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.511592:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275148fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94360 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144890.511600:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172381440:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144890.511634:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144890.513843:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172381440:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144890.513861:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144890.513913:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.515302:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+57:1985:x1830965175037952:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3807us (4397us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.515312:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10667 00000100:00100000:0.0:1746144890.516036:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.519265:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.519298:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.519354:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175038592 00000100:00100000:1.0:1746144890.519359:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175038592 00010000:00010000:1.0:1746144890.519381:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275148fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94360 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144890.519396:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10668 00000100:00100000:1.0:1746144890.519400:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175038592:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144890.519412:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144890.519427:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275148fc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94360 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.519435:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275148fc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94360 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.519452:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275148fc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94360 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.519463:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.519465:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.519471:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514903 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94367 expref: 57 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.519477:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514903 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94367 expref: 57 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.519498:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514903 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94367 expref: 57 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144890.519506:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172381696:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144890.519543:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144890.522429:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172381696:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144890.522439:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144890.522583:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175038592:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3180us (3282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.522594:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10668 00000100:00100000:2.0:1746144890.522864:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.523073:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175038848 00000100:00100000:0.0:1746144890.523078:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175038848 00002000:00100000:0.0:1746144890.523106:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e831180 x1830965175038848/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144890.523114:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e831180 with x1830965175038848 ext(0->4095) 00010000:00010000:0.0:1746144890.523120:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514903 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94367 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:0.0:1746144890.523130:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514903 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94367 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:0.0:1746144890.523136:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e831180 00000100:00100000:0.0:1746144890.523157:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1907 00000100:00100000:0.0:1746144890.523164:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1985:x1830965175038848:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144890.523302:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1985:x1830965175038848:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 138us (438us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144890.523309:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1907 00002000:00100000:0.0:1746144890.523314:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e831180 x1830965175038848/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144890.523321:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e831180 with x1830965175038848 ext(0->4095) 00010000:00010000:0.0:1746144890.523325:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514903 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94367 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:0.0:1746144890.523338:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514903 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94367 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:0.0:1746144890.523343:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e831180 00000100:00100000:0.0:1746144890.524631:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.524801:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175038976 00000100:00100000:1.0:1746144890.524807:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175038976 00010000:00010000:1.0:1746144890.524827:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514903 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94367 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.524879:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10669 00000100:00100000:2.0:1746144890.524891:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1984:x1830965175038976:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144890.524901:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144890.524916:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514903 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94367 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.524926:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514903 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94367 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.524944:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514903 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94367 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.524980:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.524982:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.524988:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751490a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9436e expref: 58 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.524996:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751490a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9436e expref: 58 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.525052:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751490a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9436e expref: 58 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144890.525063:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172381952:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.525278:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.527241:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172381952:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144890.527243:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.527296:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175039232 00000100:00100000:1.0:1746144890.527304:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175039232 00002000:00100000:1.0:1746144890.527335:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d367480 x1830965175039232/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.527344:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d367480 with x1830965175039232 ext(0->4095) 00002000:00010000:1.0:1746144890.527348:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d367480 00000100:00100000:1.0:1746144890.527376:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3918 00000100:00100000:1.0:1746144890.527383:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1985:x1830965175039232:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144890.527541:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1985:x1830965175039232:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 158us (301us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.527547:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3918 00002000:00100000:1.0:1746144890.527552:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d367480 x1830965175039232/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.527559:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d367480 with x1830965175039232 ext(0->4095) 00002000:00010000:1.0:1746144890.527561:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d367480 00010000:00010000:2.0:1746144890.527602:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144890.527624:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175038976:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2738us (2997us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.527630:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10669 00000100:00100000:0.0:1746144890.530205:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.533715:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.533957:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175039488 00000100:00100000:2.0:1746144890.533963:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175039488 00010000:00010000:2.0:1746144890.533996:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751490a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9436e expref: 58 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.534426:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10670 00000100:00100000:2.0:1746144890.534439:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175039488:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144890.534449:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144890.534467:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751490a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9436e expref: 58 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.534477:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751490a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9436e expref: 58 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.534558:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751490a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9436e expref: 58 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.534731:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.534734:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.534740:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514911 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94375 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.534747:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514911 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94375 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.534796:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514911 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94375 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144890.534808:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172382208:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.534866:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.536078:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172382208:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144890.536094:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144890.536125:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+57:1984:x1830965175039488:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1689us (2412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.536133:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10670 00000100:00100000:0.0:1746144890.540290:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.540332:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.540405:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175039872 00000100:00100000:2.0:1746144890.540408:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175039872 00002000:00100000:2.0:1746144890.540434:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d364380 x1830965175039872/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.540441:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d364380 with x1830965175039872 ext(0->4095) 00002000:00010000:2.0:1746144890.540445:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d364380 00000100:00100000:2.0:1746144890.540468:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3919 00000100:00100000:2.0:1746144890.540472:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175039872:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144890.540588:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175039872:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 115us (254us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.540594:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3919 00002000:00100000:2.0:1746144890.540599:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d364380 x1830965175039872/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.540606:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d364380 with x1830965175039872 ext(0->4095) 00010000:00010000:2.0:1746144890.540611:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514911 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94375 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.540619:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514911 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94375 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.541102:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d364380 00000100:00100000:0.0:1746144890.542874:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.542943:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.543003:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175040128 00000100:00100000:2.0:1746144890.543004:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175040000 00000100:00100000:2.0:1746144890.543009:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175040000 00000100:00100000:1.0:1746144890.543009:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175040128 00010000:00010000:2.0:1746144890.543030:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514911 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94375 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144890.543043:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5256 00000100:00100000:2.0:1746144890.543045:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10671 00000100:00100000:1.0:1746144890.543048:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+59:31579:x1830965175040128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:2.0:1746144890.543049:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175040000:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144890.543058:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144890.543058:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144890.543067:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af672751491f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94383 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.543074:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514911 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94375 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.543081:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.543085:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514918 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9437c expref: 60 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.543321:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.543325:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af672751491f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94383 expref: 59 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.543335:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514911 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94375 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.543352:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514911 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94375 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.543356:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514918 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9437c expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.543366:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af672751491f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94383 expref: 59 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.543373:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.543374:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.543379:0:20722:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514918 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9437c expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.543385:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514918 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9437c expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.543397:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144890.543400:0:20722:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514918 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9437c expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.543414:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514918 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9437c expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.543415:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175040000:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 365us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.543420:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10671 00000100:00100000:1.0:1746144890.543424:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172382592:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144890.543463:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144890.544985:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172382592:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144890.545008:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500c00, rc 0) 00000100:00100000:1.0:1746144890.545038:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+59:31579:x1830965175040128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1989us (2093us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.545044:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5256 00000100:00100000:2.0:1746144890.547223:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175040384 00000100:00100000:2.0:1746144890.547230:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175040384 00002000:00100000:2.0:1746144890.547273:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38ea00 x1830965175040384/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.547289:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38ea00 with x1830965175040384 ext(0->4095) 00010000:00010000:2.0:1746144890.547296:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514918 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9437c expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.547308:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514918 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9437c expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.547314:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f38ea00 00000100:00100000:2.0:1746144890.547347:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1908 00000100:00100000:2.0:1746144890.547355:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1984:x1830965175040384:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144890.547518:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1984:x1830965175040384:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 164us (397us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.547524:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1908 00002000:00100000:2.0:1746144890.547528:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38ea00 x1830965175040384/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.547536:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38ea00 with x1830965175040384 ext(0->4095) 00010000:00010000:2.0:1746144890.547540:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514918 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9437c expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.547547:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514918 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9437c expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.547552:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f38ea00 00000100:00100000:0.0:1746144890.550039:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.550127:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175040512 00000100:00100000:2.0:1746144890.550135:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175040512 00010000:00010000:2.0:1746144890.550164:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514918 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9437c expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.550188:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10672 00000100:00100000:2.0:1746144890.550195:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1982:x1830965175040512:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144890.550206:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144890.550225:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514918 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9437c expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.550236:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514918 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9437c expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.550256:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514918 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9437c expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.551057:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.551060:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.551067:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af672751491f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94383 expref: 58 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.551074:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af672751491f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94383 expref: 58 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.551103:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af672751491f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94383 expref: 58 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144890.551114:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172382720:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.551189:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.554951:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172382720:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144890.554988:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144890.555023:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.555036:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1982:x1830965175040512:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4841us (5002us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144890.555045:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10672 00000100:00100000:1.0:1746144890.555418:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175040768 00000100:00100000:1.0:1746144890.555423:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175040768 00002000:00100000:1.0:1746144890.555452:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e831500 x1830965175040768/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.555461:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e831500 with x1830965175040768 ext(0->4095) 00002000:00010000:1.0:1746144890.555464:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e831500 00000100:00100000:1.0:1746144890.555478:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3920 00000100:00100000:1.0:1746144890.555484:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175040768:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144890.555660:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175040768:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 175us (637us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.555666:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3920 00002000:00100000:1.0:1746144890.555671:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e831500 x1830965175040768/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.555683:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e831500 with x1830965175040768 ext(0->4095) 00002000:00010000:1.0:1746144890.555685:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e831500 00000100:00100000:0.0:1746144890.556040:0:3309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172382848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746144890.556072:0:3309:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144890.556123:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172382848 00000100:00100000:0.0:1746144890.556125:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172382848 00000100:00100000:0.0:1746144890.556181:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1746144890.556187:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1830965172382848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746144890.556210:0:8435:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 680984576 pending 0 free 3856662528 avail 3854565376 00000100:00100000:0.0:1746144890.556236:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1830965172382848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144890.556241:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1746144890.556266:0:3309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172382848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746144890.557418:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.557468:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175040896 00000100:00100000:1.0:1746144890.557474:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175040896 00000100:00100000:1.0:1746144890.557513:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5257 00000100:00100000:1.0:1746144890.557520:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175040896:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144890.557532:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144890.557547:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514926 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9438a expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.557568:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af672751491f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94383 expref: 57 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.557574:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.557576:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.557578:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514926 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9438a expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.557598:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af672751491f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94383 expref: 57 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.557607:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af672751491f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94383 expref: 57 pid: 20722 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144890.557616:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172382976:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144890.557676:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144890.559347:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172382976:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144890.559369:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514926 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9438a expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.559380:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500200, rc 0) 00000100:00100000:1.0:1746144890.559420:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175040896:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1900us (2004us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.559425:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5257 00000100:00100000:0.0:1746144890.559845:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.560092:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175041024 00000100:00100000:2.0:1746144890.560098:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175041024 00010000:00010000:2.0:1746144890.560120:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af672751491f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94383 expref: 58 pid: 20722 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.560136:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10673 00000100:00100000:2.0:1746144890.560141:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1985:x1830965175041024:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144890.560150:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144890.560166:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af672751491f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94383 expref: 58 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.560174:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af672751491f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94383 expref: 58 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.560190:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af672751491f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94383 expref: 58 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.560212:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.560213:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.560218:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514926 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9438a expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.560225:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514926 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9438a expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.560245:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514926 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9438a expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144890.560255:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172383104:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.560304:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.562822:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172383104:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144890.562845:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144890.562880:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+57:1985:x1830965175041024:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2737us (3034us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.562889:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10673 00000100:00100000:0.0:1746144890.563005:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.563091:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175041280 00000100:00100000:2.0:1746144890.563096:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175041280 00002000:00100000:2.0:1746144890.563221:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d364700 x1830965175041280/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.563230:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d364700 with x1830965175041280 ext(0->4095) 00002000:00010000:2.0:1746144890.563234:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d364700 00000100:00100000:2.0:1746144890.563259:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3921 00000100:00100000:2.0:1746144890.563266:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175041280:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144890.563521:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175041280:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 256us (516us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.563527:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3921 00002000:00100000:2.0:1746144890.563533:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d364700 x1830965175041280/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.563539:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d364700 with x1830965175041280 ext(0->4095) 00002000:00010000:2.0:1746144890.563542:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d364700 00000100:00100000:0.0:1746144890.565256:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.565417:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175041408 00000100:00100000:1.0:1746144890.565422:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175041408 00000100:00100000:1.0:1746144890.565461:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5258 00000100:00100000:1.0:1746144890.565467:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+57:31579:x1830965175041408:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144890.565478:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144890.565491:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af672751492d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94391 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.565513:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514926 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9438a expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.565520:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.565521:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.565525:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af672751492d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94391 expref: 58 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.565547:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514926 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9438a expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.565556:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514926 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9438a expref: 5 pid: 20722 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144890.565566:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172383232:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144890.565632:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.566939:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.570278:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172383232:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144890.570302:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af672751492d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94391 expref: 59 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.570315:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500e00, rc 0) 00000100:00100000:1.0:1746144890.570349:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+59:31579:x1830965175041408:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4881us (5097us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.570355:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5258 00000100:00100000:0.0:1746144890.571280:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.571577:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175041664 00000100:00100000:2.0:1746144890.571584:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175041664 00010000:00010000:2.0:1746144890.571611:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514926 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9438a expref: 6 pid: 20722 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.571641:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10674 00000100:00100000:2.0:1746144890.571648:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093369880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175041664:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144890.571658:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144890.571675:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514926 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9438a expref: 6 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.571685:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514926 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9438a expref: 6 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.571703:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514926 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9438a expref: 6 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.571726:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.571727:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.571733:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af672751492d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94391 expref: 58 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.571741:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af672751492d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94391 expref: 58 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.571790:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af672751492d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94391 expref: 58 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.571897:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af672751492d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94391 expref: 58 pid: 20722 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.571907:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172383488:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.572146:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.574383:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.574537:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172383488:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144890.574556:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144890.574583:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093369880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175041664:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2937us (3304us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.574590:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10674 00000100:00100000:3.0:1746144890.575026:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1985:x1830965175041920:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 423us (646us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144890.575032:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1909 00002000:00100000:3.0:1746144890.575037:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336bb80 x1830965175041920/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144890.575044:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336bb80 with x1830965175041920 ext(0->4095) 00010000:00010000:3.0:1746144890.575049:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af672751492d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94391 expref: 59 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.575057:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af672751492d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94391 expref: 59 pid: 20722 timeout: 584 lvb_type: 0 00002000:00010000:3.0:1746144890.575062:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009336bb80 00000100:00100000:0.0:1746144890.577011:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.577068:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175042048 00000100:00100000:1.0:1746144890.577075:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175042048 00000100:00100000:1.0:1746144890.577115:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5260 00000100:00100000:1.0:1746144890.577121:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175042048:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144890.577134:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144890.577146:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9439f expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.577164:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.577169:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514934 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94398 expref: 58 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.577175:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144890.577178:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9439f expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.577208:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514934 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94398 expref: 58 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.577219:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9439f expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.577227:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501a00, rc 0) 00000100:00100000:1.0:1746144890.577268:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175042048:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 147us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.577274:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5260 00000100:00100000:0.0:1746144890.579123:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.579194:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175042176 00000100:00100000:2.0:1746144890.579199:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175042176 00010000:00010000:2.0:1746144890.579225:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af672751492d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94391 expref: 59 pid: 20722 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.579243:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10675 00000100:00100000:2.0:1746144890.579249:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1984:x1830965175042176:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144890.579259:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144890.579275:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af672751492d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94391 expref: 59 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.579285:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af672751492d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94391 expref: 59 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.579301:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af672751492d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94391 expref: 59 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.579443:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.579445:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.579451:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514934 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94398 expref: 58 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.579458:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514934 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94398 expref: 58 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.579482:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514934 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94398 expref: 58 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.579490:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514934 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94398 expref: 58 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.579499:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172383744:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.580059:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.581992:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.582124:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172383744:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144890.582143:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144890.582176:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175042176:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2926us (3057us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.582184:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10675 00000100:00100000:3.0:1746144890.582259:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175042432 00000100:00100000:3.0:1746144890.582265:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175042432 00002000:00100000:3.0:1746144890.582293:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093369f80 x1830965175042432/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144890.582301:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369f80 with x1830965175042432 ext(0->4095) 00010000:00010000:3.0:1746144890.582307:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514934 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94398 expref: 58 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.582316:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514934 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94398 expref: 58 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:3.0:1746144890.582321:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093369f80 00000100:00100000:3.0:1746144890.582335:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1910 00000100:00100000:3.0:1746144890.582341:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175042432:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144890.582465:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175042432:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 124us (477us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144890.582471:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1910 00002000:00100000:3.0:1746144890.582475:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093369f80 x1830965175042432/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144890.582481:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369f80 with x1830965175042432 ext(0->4095) 00010000:00010000:3.0:1746144890.582485:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514934 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94398 expref: 58 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.582493:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514934 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94398 expref: 58 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:3.0:1746144890.582497:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093369f80 00000100:00100000:0.0:1746144890.585868:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.587262:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.587691:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175042560 00000100:00100000:2.0:1746144890.587698:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175042560 00000100:00100000:2.0:1746144890.588057:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5261 00000100:00100000:2.0:1746144890.588065:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+58:31565:x1830965175042560:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.588082:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.588095:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514942 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af943a6 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.588117:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.588121:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9439f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.588127:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144890.588130:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514942 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943a6 expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.588160:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9439f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.588173:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514942 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943a6 expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.588181:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:3.0:1746144890.588275:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175042688 00000100:00100000:3.0:1746144890.588279:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175042688 00010000:00010000:3.0:1746144890.588294:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514934 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94398 expref: 60 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.588821:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+60:31565:x1830965175042560:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 756us (2960us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.588827:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5261 00000100:00100000:3.0:1746144890.589072:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10676 00000100:00100000:3.0:1746144890.589078:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1985:x1830965175042688:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.589087:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.589102:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514934 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94398 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.589110:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514934 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94398 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.589124:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514934 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94398 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.589516:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.589518:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.589524:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9439f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.589530:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9439f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.589551:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9439f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.589560:0:9812:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9439f expref: 5 pid: 20722 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.589570:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172384000:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.590049:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44e6300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144890.596659:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172384000:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.596678:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.596787:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1985:x1830965175042688:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7708us (9527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.596795:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10676 00010000:00010000:3.0:1746144890.598723:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746144890.598939:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.599041:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175042944 00000100:00100000:1.0:1746144890.599049:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175042944 00002000:00100000:1.0:1746144890.599084:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e830000 x1830965175042944/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.599093:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e830000 with x1830965175042944 ext(0->4095) 00010000:00010000:1.0:1746144890.599100:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9439f expref: 6 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.599112:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9439f expref: 6 pid: 20722 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144890.599119:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e830000 00000100:00100000:1.0:1746144890.599147:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1911 00000100:00100000:1.0:1746144890.599154:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175042944:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144890.599301:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175042944:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 147us (366us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.599307:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1911 00002000:00100000:1.0:1746144890.599313:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e830000 x1830965175042944/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.599319:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e830000 with x1830965175042944 ext(0->4095) 00010000:00010000:1.0:1746144890.599323:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9439f expref: 6 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.599331:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9439f expref: 6 pid: 20722 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144890.599336:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e830000 00000100:00100000:0.0:1746144890.603501:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.603564:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175043072 00000100:00100000:3.0:1746144890.603572:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175043072 00010000:00010000:3.0:1746144890.603601:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9439f expref: 6 pid: 20722 timeout: 584 lvb_type: 0 00000100:00100000:0.0:1746144890.603683:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10677 00000100:00100000:0.0:1746144890.603692:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175043072:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144890.603702:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144890.603950:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9439f expref: 6 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:0.0:1746144890.603962:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9439f expref: 6 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:0.0:1746144890.603990:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af672751493b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9439f expref: 6 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:0.0:1746144890.604009:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144890.604011:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144890.604017:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514942 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943a6 expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144890.604024:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514942 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943a6 expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144890.604049:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514942 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943a6 expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144890.604060:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009336b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172384128:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144890.604730:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3180 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.607985:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009336b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172384128:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144890.608008:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144890.608062:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175043072:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4370us (4566us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.608075:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10677 00000100:00100000:0.0:1746144890.609144:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.609306:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175043328 00000100:00100000:1.0:1746144890.609312:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175043328 00002000:00100000:1.0:1746144890.609351:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336ad80 x1830965175043328/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.609359:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336ad80 with x1830965175043328 ext(0->4095) 00002000:00010000:1.0:1746144890.609363:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009336ad80 00000100:00100000:1.0:1746144890.609760:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3922 00000100:00100000:1.0:1746144890.609798:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1985:x1830965175043328:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144890.609941:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1985:x1830965175043328:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 144us (798us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.609948:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3922 00002000:00100000:1.0:1746144890.609953:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336ad80 x1830965175043328/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.609965:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336ad80 with x1830965175043328 ext(0->4095) 00002000:00010000:1.0:1746144890.609977:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009336ad80 00000100:00100000:0.0:1746144890.611991:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.612449:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175043456 00000100:00100000:2.0:1746144890.612456:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175043456 00000100:00100000:2.0:1746144890.612610:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5262 00000100:00100000:2.0:1746144890.612619:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175043456:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.612633:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.612645:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af943ad expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.612668:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514942 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943a6 expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.612674:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.612676:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.612679:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ad expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.612702:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514942 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943a6 expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.612712:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514942 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943a6 expref: 57 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.612722:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172384256:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.613135:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.615350:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172384256:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.615382:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ad expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.615396:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:3.0:1746144890.616185:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175043456:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3565us (4198us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.616193:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5262 00000100:00100000:0.0:1746144890.616299:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.616362:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175043584 00000100:00100000:3.0:1746144890.616367:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175043584 00010000:00010000:3.0:1746144890.616388:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514942 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943a6 expref: 58 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.616407:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10678 00000100:00100000:3.0:1746144890.616412:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1985:x1830965175043584:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.616421:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.616437:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514942 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943a6 expref: 58 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.616447:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514942 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943a6 expref: 58 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.616464:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514942 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943a6 expref: 58 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.616478:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.616480:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.616486:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ad expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.616495:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ad expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.616518:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ad expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.616528:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172384384:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.616585:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a44e6300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144890.618526:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172384384:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.618542:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.618846:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+57:1985:x1830965175043584:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2432us (2546us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.618855:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10678 00000100:00100000:0.0:1746144890.619213:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.619234:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.619372:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175043840 00000100:00100000:3.0:1746144890.619377:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175043840 00000100:00100000:3.0:1746144890.619413:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5263 00000100:00100000:3.0:1746144890.619573:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+57:31565:x1830965175043840:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144890.619588:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144890.619600:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af943b4 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.619622:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ad expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.619629:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.619631:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.619633:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943b4 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.619657:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ad expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.619668:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ad expref: 5 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.619677:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172384512:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144890.619726:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.620032:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175043968 00000100:00100000:2.0:1746144890.620035:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175043968 00002000:00100000:2.0:1746144890.620062:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336b100 x1830965175043968/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.620069:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336b100 with x1830965175043968 ext(0->4095) 00010000:00010000:2.0:1746144890.620074:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ad expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.620083:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ad expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.620088:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009336b100 00000100:00100000:2.0:1746144890.620101:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1912 00000100:00100000:2.0:1746144890.620106:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175043968:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144890.620231:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175043968:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 124us (995us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.620237:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1912 00002000:00100000:2.0:1746144890.620241:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336b100 x1830965175043968/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.620247:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336b100 with x1830965175043968 ext(0->4095) 00010000:00010000:2.0:1746144890.620251:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ad expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.620259:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ad expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.620264:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009336b100 00000100:00100000:3.0:1746144890.623591:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172384512:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144890.623615:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943b4 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.623629:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb68e00, rc 0) 00000100:00100000:3.0:1746144890.623674:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+58:31565:x1830965175043840:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4101us (4460us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.623681:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5263 00000100:00100000:0.0:1746144890.625344:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.626068:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.626148:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175044096 00000100:00100000:3.0:1746144890.626155:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175044096 00000100:00100000:3.0:1746144890.626191:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5264 00000100:00100000:3.0:1746144890.626196:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+58:31579:x1830965175044096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144890.626210:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144890.626222:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514957 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af943bb expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.626244:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.626248:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943b4 expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.626253:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144890.626256:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514957 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943bb expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.626281:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943b4 expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144890.626282:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175044224 00000100:00100000:2.0:1746144890.626286:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175044224 00010000:00010000:3.0:1746144890.626289:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514957 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943bb expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.626297:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb68800, rc 0) 00010000:00010000:2.0:1746144890.626304:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ad expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.626321:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10679 00000100:00100000:3.0:1746144890.626325:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+59:31579:x1830965175044096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 129us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.626326:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093369c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175044224:12345-192.168.202.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746144890.626331:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5264 00010000:00010000:2.0:1746144890.626333:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144890.626349:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ad expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.626356:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ad expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.626370:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514949 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ad expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.626390:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.626391:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.626396:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943b4 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.626406:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943b4 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.626423:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943b4 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.627212:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943b4 expref: 58 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.627222:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172384768:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.627274:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.629807:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172384768:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144890.629829:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144890.629874:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093369c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175044224:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3545us (3804us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144890.629883:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10679 00000100:00100000:0.0:1746144890.630985:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.631541:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175044480 00000100:00100000:1.0:1746144890.631548:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175044480 00002000:00100000:1.0:1746144890.631585:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093369880 x1830965175044480/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.631594:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369880 with x1830965175044480 ext(0->4095) 00010000:00010000:1.0:1746144890.631602:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943b4 expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.631613:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943b4 expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144890.631619:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093369880 00000100:00100000:1.0:1746144890.631642:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1913 00000100:00100000:1.0:1746144890.631648:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1983:x1830965175044480:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144890.631816:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1983:x1830965175044480:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 167us (832us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.631821:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1913 00002000:00100000:1.0:1746144890.631826:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093369880 x1830965175044480/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.631832:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369880 with x1830965175044480 ext(0->4095) 00010000:00010000:1.0:1746144890.631836:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943b4 expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.631845:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943b4 expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144890.631850:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093369880 00000100:00100000:0.0:1746144890.637049:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.637146:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175044608 00000100:00100000:2.0:1746144890.637154:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175044608 00010000:00010000:2.0:1746144890.637184:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943b4 expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.637211:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10680 00000100:00100000:2.0:1746144890.637217:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1984:x1830965175044608:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144890.637229:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144890.637245:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943b4 expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.637254:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943b4 expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.637275:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514950 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943b4 expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.637297:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.637299:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.637303:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514957 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943bb expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.637310:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514957 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943bb expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.637334:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514957 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943bb expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144890.637344:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172384896:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.638309:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.640068:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172384896:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144890.640090:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144890.640122:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175044608:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2904us (3080us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.640130:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10680 00000100:00100000:0.0:1746144890.641251:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.641311:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175044864 00000100:00100000:2.0:1746144890.641317:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175044864 00002000:00100000:2.0:1746144890.641350:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368380 x1830965175044864/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.641364:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368380 with x1830965175044864 ext(0->4095) 00002000:00010000:2.0:1746144890.641367:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093368380 00000100:00100000:2.0:1746144890.641406:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3923 00000100:00100000:2.0:1746144890.641411:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175044864:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144890.641529:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175044864:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 118us (280us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.641534:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3923 00002000:00100000:2.0:1746144890.641538:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368380 x1830965175044864/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.641544:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368380 with x1830965175044864 ext(0->4095) 00002000:00010000:2.0:1746144890.641547:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093368380 00000100:00100000:0.0:1746144890.645121:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.645390:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175044992 00000100:00100000:3.0:1746144890.645399:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175044992 00000100:00100000:3.0:1746144890.645433:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5265 00000100:00100000:3.0:1746144890.645440:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175044992:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144890.645454:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144890.645469:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af943c2 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.645496:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514957 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943bb expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.645503:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144890.645504:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144890.645507:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c2 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.645533:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514957 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943bb expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.645543:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514957 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943bb expref: 57 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.645554:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172385024:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144890.645615:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144890.650104:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172385024:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144890.650133:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c2 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.650149:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb69600, rc 0) 00000100:00100000:3.0:1746144890.650187:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175044992:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4747us (5073us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.650195:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5265 00000100:00100000:0.0:1746144890.650623:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.650957:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175045120 00000100:00100000:3.0:1746144890.650963:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175045120 00010000:00010000:3.0:1746144890.650998:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514957 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943bb expref: 58 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.651018:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10681 00000100:00100000:3.0:1746144890.651024:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175045120:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.651035:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.651051:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514957 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943bb expref: 58 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.651062:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514957 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943bb expref: 58 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.651081:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514957 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943bb expref: 58 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.651474:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.651477:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.651484:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c2 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.651492:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c2 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.651520:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c2 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.651531:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172385152:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.652542:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.654037:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.654177:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172385152:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144890.654193:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144890.654226:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+57:1984:x1830965175045120:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3202us (3604us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.654235:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10681 00000100:00100000:3.0:1746144890.654666:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175045248 00000100:00100000:3.0:1746144890.654671:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175045248 00000100:00100000:3.0:1746144890.654704:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5266 00000100:00100000:3.0:1746144890.654709:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+57:31565:x1830965175045248:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144890.654722:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144890.654735:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af943c9 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.654757:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c2 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.654785:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.654786:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.654789:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c9 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.654812:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c2 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.654821:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c2 expref: 5 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.654829:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172385280:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144890.654871:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.656114:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.656185:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175045504 00000100:00100000:0.0:1746144890.656189:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175045504 00002000:00100000:0.0:1746144890.656411:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612c000 x1830965175045504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144890.656427:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612c000 with x1830965175045504 ext(0->4095) 00010000:00010000:0.0:1746144890.656435:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c2 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:0.0:1746144890.656447:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c2 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:0.0:1746144890.656457:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612c000 00000100:00100000:0.0:1746144890.656474:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1914 00000100:00100000:0.0:1746144890.656481:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175045504:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144890.656683:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175045504:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 203us (572us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144890.656690:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1914 00002000:00100000:0.0:1746144890.656695:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612c000 x1830965175045504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144890.656702:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612c000 with x1830965175045504 ext(0->4095) 00010000:00010000:0.0:1746144890.656706:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c2 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:0.0:1746144890.656716:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c2 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:0.0:1746144890.656722:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612c000 00000100:00100000:3.0:1746144890.659474:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172385280:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144890.659500:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c9 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.659513:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb68a00, rc 0) 00000100:00100000:3.0:1746144890.659562:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+58:31565:x1830965175045248:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4851us (5529us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.659568:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5266 00000100:00100000:0.0:1746144890.660473:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.661001:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.661074:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175045632 00000100:00100000:3.0:1746144890.661082:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175045632 00000100:00100000:3.0:1746144890.661111:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5267 00000100:00100000:3.0:1746144890.661117:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+58:31579:x1830965175045632:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144890.661131:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144890.661144:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af672751496c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af943d0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.661164:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.661169:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c9 expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.661174:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144890.661177:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af672751496c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d0 expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144890.661178:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175045760 00000100:00100000:2.0:1746144890.661181:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175045760 00010000:00010000:2.0:1746144890.661200:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c2 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.661203:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c9 expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.661212:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af672751496c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d0 expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144890.661217:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10682 00000100:00100000:2.0:1746144890.661222:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175045760:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.661224:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb69c00, rc 0) 00010000:00010000:2.0:1746144890.661232:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144890.661250:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c2 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.661251:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+59:31579:x1830965175045632:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 134us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.661257:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5267 00010000:00010000:2.0:1746144890.661260:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c2 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.661275:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af672751495e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c2 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.661288:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.661290:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.661295:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c9 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.661301:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c9 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.661321:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c9 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.661330:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c9 expref: 58 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.661341:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172385536:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.661380:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.668172:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.668491:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172385536:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144890.668513:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144890.668559:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175045760:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7335us (7557us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.668568:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10682 00000100:00100000:3.0:1746144890.668784:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175046016 00000100:00100000:3.0:1746144890.668790:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175046016 00002000:00100000:3.0:1746144890.668822:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612d880 x1830965175046016/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144890.668830:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612d880 with x1830965175046016 ext(0->4095) 00010000:00010000:3.0:1746144890.668837:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c9 expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.668848:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c9 expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:3.0:1746144890.668859:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612d880 00000100:00100000:3.0:1746144890.668889:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1915 00000100:00100000:3.0:1746144890.668895:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1985:x1830965175046016:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144890.669042:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1985:x1830965175046016:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 147us (878us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144890.669047:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1915 00002000:00100000:3.0:1746144890.669052:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612d880 x1830965175046016/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144890.669063:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612d880 with x1830965175046016 ext(0->4095) 00010000:00010000:3.0:1746144890.669067:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c9 expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.669075:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c9 expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:3.0:1746144890.669080:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612d880 00000100:00100000:0.0:1746144890.673069:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.673317:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175046144 00000100:00100000:2.0:1746144890.673325:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175046144 00010000:00010000:2.0:1746144890.673359:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c9 expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.673381:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10683 00000100:00100000:2.0:1746144890.673387:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1985:x1830965175046144:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144890.673398:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144890.673414:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c9 expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.673423:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c9 expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.673442:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514965 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943c9 expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.674163:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.674166:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.674173:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af672751496c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d0 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.674182:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af672751496c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d0 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.674212:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af672751496c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d0 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144890.674222:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172385664:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.674292:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.677638:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172385664:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144890.677665:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144890.677716:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.677744:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175046400 00000100:00100000:0.0:1746144890.677749:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175046400 00002000:00100000:0.0:1746144890.677796:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612f480 x1830965175046400/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144890.677805:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612f480 with x1830965175046400 ext(0->4095) 00002000:00010000:0.0:1746144890.677809:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612f480 00000100:00100000:0.0:1746144890.677840:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3924 00000100:00100000:0.0:1746144890.677846:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1984:x1830965175046400:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144890.677964:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1984:x1830965175046400:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 117us (248us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144890.677979:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3924 00002000:00100000:0.0:1746144890.677984:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612f480 x1830965175046400/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144890.677992:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612f480 with x1830965175046400 ext(0->4095) 00002000:00010000:0.0:1746144890.677994:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612f480 00000100:00100000:2.0:1746144890.678550:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1985:x1830965175046144:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5161us (5488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.678557:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10683 00000100:00100000:0.0:1746144890.680172:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.680330:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175046528 00000100:00100000:3.0:1746144890.680335:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175046528 00000100:00100000:3.0:1746144890.680370:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5268 00000100:00100000:3.0:1746144890.680376:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009969a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175046528:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144890.680387:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144890.680400:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af943d7 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.680422:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af672751496c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d0 expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.680428:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144890.680430:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144890.680432:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d7 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.680457:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af672751496c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d0 expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.680471:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af672751496c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d0 expref: 57 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.680481:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172385792:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.681591:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.683511:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172385792:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.683536:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d7 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.683549:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb69600, rc 0) 00000100:00100000:2.0:1746144890.683585:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009969a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175046528:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3208us (3415us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.683592:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5268 00000100:00100000:0.0:1746144890.685469:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.685548:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175046656 00000100:00100000:2.0:1746144890.685553:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175046656 00010000:00010000:2.0:1746144890.685582:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af672751496c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d0 expref: 58 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.686170:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10684 00000100:00100000:2.0:1746144890.686179:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175046656:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144890.686189:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144890.686205:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af672751496c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d0 expref: 58 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.686215:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af672751496c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d0 expref: 58 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.686232:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af672751496c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d0 expref: 58 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.686258:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.686260:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.686266:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d7 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.686273:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d7 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.686300:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d7 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144890.686309:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172385920:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.686582:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.689086:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.689377:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172385920:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.689396:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.689424:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+57:1984:x1830965175046656:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3247us (3960us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.689433:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10684 00000100:00100000:2.0:1746144890.689544:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175046784 00000100:00100000:2.0:1746144890.689549:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175046784 00000100:00100000:2.0:1746144890.689582:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5269 00000100:00100000:2.0:1746144890.689587:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+57:31565:x1830965175046784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.689600:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.689613:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af943de expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.689632:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d7 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.689638:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.689639:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.689642:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943de expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.689662:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d7 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.689671:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d7 expref: 5 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.689680:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172386048:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.689716:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.691119:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.691443:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175047040 00000100:00100000:2.0:1746144890.691449:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175047040 00002000:00100000:2.0:1746144890.691484:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612df80 x1830965175047040/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.691493:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612df80 with x1830965175047040 ext(0->4095) 00010000:00010000:2.0:1746144890.691500:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d7 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.691516:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d7 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.691522:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612df80 00000100:00100000:2.0:1746144890.691537:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1916 00000100:00100000:2.0:1746144890.691544:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175047040:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144890.691555:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172386048:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144890.691574:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943de expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.691583:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:3.0:1746144890.691696:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+58:31565:x1830965175046784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2108us (2616us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.691702:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5269 00000100:00100000:2.0:1746144890.691856:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175047040:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 312us (740us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.691861:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1916 00002000:00100000:2.0:1746144890.691867:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612df80 x1830965175047040/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.691873:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612df80 with x1830965175047040 ext(0->4095) 00010000:00010000:2.0:1746144890.691877:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d7 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.691886:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d7 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.691891:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612df80 00000100:00100000:0.0:1746144890.693946:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.694034:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175047168 00000100:00100000:3.0:1746144890.694041:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175047168 00010000:00010000:3.0:1746144890.694066:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d7 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.694097:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10685 00000100:00100000:3.0:1746144890.694104:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175047168:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.694114:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.694131:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d7 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.694140:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d7 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.694156:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514973 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943d7 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.694181:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.694182:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.694188:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943de expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.694195:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943de expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.694222:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943de expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.694232:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172386176:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.694303:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.697300:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.697470:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175047424 00000100:00100000:2.0:1746144890.697478:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175047424 00002000:00100000:2.0:1746144890.697516:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612ed80 x1830965175047424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.697525:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ed80 with x1830965175047424 ext(0->4095) 00002000:00010000:2.0:1746144890.697529:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612ed80 00000100:00100000:2.0:1746144890.697545:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3925 00000100:00100000:2.0:1746144890.697552:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1985:x1830965175047424:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144890.697710:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1985:x1830965175047424:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 157us (415us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.697716:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3925 00002000:00100000:2.0:1746144890.697721:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612ed80 x1830965175047424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.697728:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ed80 with x1830965175047424 ext(0->4095) 00002000:00010000:2.0:1746144890.697730:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612ed80 00000100:00100000:3.0:1746144890.697831:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172386176:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.697848:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.697869:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175047168:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3766us (3928us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.697879:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10685 00000100:00100000:2.0:1746144890.702663:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.702741:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175047552 00000100:00100000:3.0:1746144890.702749:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175047552 00000100:00100000:3.0:1746144890.702815:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5270 00000100:00100000:3.0:1746144890.702822:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175047552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144890.702839:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144890.702853:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514981 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af943e5 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.702875:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943de expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.702882:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144890.702883:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144890.702886:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514981 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943e5 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.702910:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943de expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.702918:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943de expref: 57 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.702928:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172386304:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144890.704744:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144890.705808:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172386304:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144890.705835:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514981 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943e5 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.705849:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb68000, rc 0) 00000100:00100000:3.0:1746144890.706211:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175047552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3387us (3556us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.706218:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5270 00000100:00100000:0.0:1746144890.710639:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.710726:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175047680 00000100:00100000:1.0:1746144890.710734:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175047680 00002000:00100000:1.0:1746144890.710794:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88013612c380 x1830965175047680/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 496/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.710803:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612c380 with x1830965175047680 ext(0->7) 00010000:00010000:1.0:1746144890.710810:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943de expref: 58 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.710822:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943de expref: 58 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144890.710828:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612c380 00000100:00100000:1.0:1746144890.710858:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1917 00000100:00100000:1.0:1746144890.710865:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175047680:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144890.711145:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1984:x1830965175047680:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 280us (513us total) trans 4294967992 rc 0/0 00000100:00100000:1.0:1746144890.711152:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1917 00002000:00100000:1.0:1746144890.711157:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88013612c380 x1830965175047680/t4294967992(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 496/448 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.711164:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612c380 with x1830965175047680 ext(0->7) 00010000:00010000:1.0:1746144890.711168:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943de expref: 60 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.711176:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943de expref: 60 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144890.711181:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612c380 00000100:00100000:0.0:1746144890.720273:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.720359:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175047808 00000100:00100000:3.0:1746144890.720367:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175047808 00010000:00010000:3.0:1746144890.720394:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943de expref: 60 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.720416:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10686 00000100:00100000:3.0:1746144890.720422:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1982:x1830965175047808:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.720432:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746144890.720446:0:7098:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 1746144890 -> 1746144891 00002000:00010000:3.0:1746144890.720449:0:7098:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 1746144890 -> 1746144891 00010000:00010000:3.0:1746144890.720453:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943de expref: 60 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.720463:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943de expref: 60 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.720482:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af672751497a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943de expref: 60 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.723653:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.723658:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.723669:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514981 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943e5 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.723678:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514981 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943e5 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.723856:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514981 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943e5 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144890.723870:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172386432:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144890.726174:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.727010:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175048064 00000100:00100000:2.0:1746144890.727018:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175048064 00002000:00100000:2.0:1746144890.727059:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612ca80 x1830965175048064/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.727068:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ca80 with x1830965175048064 ext(0->4095) 00002000:00010000:2.0:1746144890.727072:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612ca80 00000100:00100000:2.0:1746144890.727099:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3926 00000100:00100000:2.0:1746144890.727107:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175048064:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144890.727247:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175048064:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 141us (1080us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.727254:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3926 00002000:00100000:2.0:1746144890.727259:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612ca80 x1830965175048064/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.727266:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ca80 with x1830965175048064 ext(0->4095) 00002000:00010000:2.0:1746144890.727268:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612ca80 00000100:00100000:2.0:1746144890.729193:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.729231:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172386432:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144890.729250:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144890.729289:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1982:x1830965175047808:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 8867us (9022us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.729298:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10686 00000100:00100000:0.0:1746144890.731742:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.731915:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175048192 00000100:00100000:3.0:1746144890.731922:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175048192 00000100:00100000:3.0:1746144890.732223:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5271 00000100:00100000:3.0:1746144890.732231:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+59:31579:x1830965175048192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144890.732247:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144890.732260:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af943ec expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.732282:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514981 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943e5 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.732288:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.732290:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.732293:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ec expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.732314:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514981 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943e5 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.732323:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514981 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943e5 expref: 5 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.732339:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172386560:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144890.732413:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a659c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.735310:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.735373:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175048320 00000100:00100000:1.0:1746144890.735381:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175048320 00000100:00100000:1.0:1746144890.735431:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5272 00000100:00100000:1.0:1746144890.735438:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+61:31565:x1830965175048320:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144890.735454:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144890.735468:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af943f3 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.735494:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.735499:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ec expref: 62 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.735504:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.735507:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943f3 expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.735536:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ec expref: 62 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.735548:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943f3 expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.735561:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500200, rc 0) 00000100:00100000:1.0:1746144890.735605:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+62:31565:x1830965175048320:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 167us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.735611:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5272 00000100:00100000:3.0:1746144890.736873:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172386560:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144890.736874:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.736930:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175048448 00000100:00100000:2.0:1746144890.736934:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175048448 00010000:00010000:3.0:1746144890.736936:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ec expref: 61 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.736947:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb69600, rc 0) 00010000:00010000:2.0:1746144890.736956:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514981 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943e5 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.736991:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+61:31579:x1830965175048192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4761us (5255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.736997:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5271 00000100:00100000:2.0:1746144890.737046:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10687 00000100:00100000:2.0:1746144890.737053:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175048448:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144890.737062:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144890.737151:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514981 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943e5 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.737161:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514981 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943e5 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.737182:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514981 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943e5 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.737204:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.737206:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.737212:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ec expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.737219:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ec expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.737241:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ec expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.737251:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ec expref: 60 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.737262:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172386816:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.737326:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.739505:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172386816:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144890.739523:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144890.739563:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175048448:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2511us (2689us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.739572:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10687 00000100:00100000:0.0:1746144890.740072:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.740179:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175048704 00000100:00100000:1.0:1746144890.740184:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175048704 00002000:00100000:1.0:1746144890.740211:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612ce00 x1830965175048704/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.740220:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ce00 with x1830965175048704 ext(0->4095) 00010000:00010000:1.0:1746144890.740226:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ec expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.740238:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ec expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144890.740243:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612ce00 00000100:00100000:1.0:1746144890.740256:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1918 00000100:00100000:1.0:1746144890.740260:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1985:x1830965175048704:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144890.740387:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1985:x1830965175048704:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 126us (315us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.740393:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1918 00002000:00100000:1.0:1746144890.740398:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612ce00 x1830965175048704/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.740410:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ce00 with x1830965175048704 ext(0->4095) 00010000:00010000:1.0:1746144890.740415:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ec expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.740423:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ec expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144890.740428:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612ce00 00000100:00100000:0.0:1746144890.743845:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.743926:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.744200:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175048832 00000100:00100000:3.0:1746144890.744208:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175048832 00000100:00100000:3.0:1746144890.744244:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5273 00000100:00100000:3.0:1746144890.744251:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175048832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144890.744266:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144890.744281:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af943fa expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.744304:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144890.744310:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943f3 expref: 60 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.744315:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144890.744319:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943fa expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.744352:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943f3 expref: 60 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.744363:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943fa expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.744372:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb68a00, rc 0) 00000100:00100000:3.0:1746144890.744420:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175048832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 168us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.744425:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5273 00000100:00100000:2.0:1746144890.744869:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175048960 00000100:00100000:2.0:1746144890.744874:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175048960 00010000:00010000:2.0:1746144890.744893:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ec expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.744915:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10688 00000100:00100000:2.0:1746144890.744920:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1982:x1830965175048960:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144890.744927:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144890.744943:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ec expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.744952:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ec expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.744976:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af6727514988 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943ec expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.744999:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.745001:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.745006:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943f3 expref: 60 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.745013:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943f3 expref: 60 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.745031:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943f3 expref: 60 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.745040:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943f3 expref: 60 pid: 20722 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.745050:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172387072:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144890.745099:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.747090:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172387072:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144890.747111:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144890.747377:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1982:x1830965175048960:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2455us (3449us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.747387:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10688 00000100:00100000:0.0:1746144890.747982:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.748491:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175049216 00000100:00100000:1.0:1746144890.748499:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175049216 00002000:00100000:1.0:1746144890.748537:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ce00 x1830965175049216/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.748546:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ce00 with x1830965175049216 ext(0->4095) 00010000:00010000:1.0:1746144890.748552:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943f3 expref: 60 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.748564:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943f3 expref: 60 pid: 20722 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144890.748570:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398ce00 00000100:00100000:1.0:1746144890.748598:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1919 00000100:00100000:1.0:1746144890.748605:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1985:x1830965175049216:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144890.748756:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1985:x1830965175049216:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 150us (773us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.748782:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1919 00002000:00100000:1.0:1746144890.748788:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ce00 x1830965175049216/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.748794:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ce00 with x1830965175049216 ext(0->4095) 00010000:00010000:1.0:1746144890.748799:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943f3 expref: 60 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:1.0:1746144890.748807:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943f3 expref: 60 pid: 20722 timeout: 584 lvb_type: 0 00002000:00010000:1.0:1746144890.748812:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398ce00 00000100:00100000:0.0:1746144890.751212:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.752227:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.752461:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175049472 00000100:00100000:3.0:1746144890.752468:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175049472 00010000:00010000:3.0:1746144890.752494:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943f3 expref: 60 pid: 20722 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.752515:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10689 00000100:00100000:3.0:1746144890.752521:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1985:x1830965175049472:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.752531:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.752547:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943f3 expref: 60 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.752556:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943f3 expref: 60 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.752573:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af672751498f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943f3 expref: 60 pid: 20722 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.752588:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.752589:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.752595:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943fa expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.752601:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943fa expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.752625:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943fa expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.752635:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172387200:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.752691:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a659c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.752906:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175049344 00000100:00100000:2.0:1746144890.752910:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175049344 00000100:00100000:2.0:1746144890.752945:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5274 00000100:00100000:2.0:1746144890.752950:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:31565:x1830965175049344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.752962:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.752980:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751499d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94401 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.752996:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943fa expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.753000:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.753001:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.753004:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751499d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94401 expref: 61 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.753019:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943fa expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.753031:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943fa expref: 5 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.753039:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172387328:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.754392:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144890.755520:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172387200:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.755534:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.755878:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1985:x1830965175049472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3354us (3650us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.755886:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10689 00000100:00100000:2.0:1746144890.756102:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172387328:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.756123:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751499d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94401 expref: 60 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.756135:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:2.0:1746144890.756151:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:31565:x1830965175049344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3201us (4946us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.756157:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5274 00000100:00100000:0.0:1746144890.758981:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.759268:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175049728 00000100:00100000:2.0:1746144890.759276:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175049728 00002000:00100000:2.0:1746144890.759314:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398d180 x1830965175049728/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.759324:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398d180 with x1830965175049728 ext(0->4095) 00010000:00010000:2.0:1746144890.759331:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943fa expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.759343:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943fa expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.759353:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398d180 00000100:00100000:2.0:1746144890.759405:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1920 00000100:00100000:2.0:1746144890.759413:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175049728:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144890.759568:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175049728:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 155us (601us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.759574:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1920 00002000:00100000:2.0:1746144890.759579:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398d180 x1830965175049728/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.759586:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398d180 with x1830965175049728 ext(0->4095) 00010000:00010000:2.0:1746144890.759590:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943fa expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.759599:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943fa expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.759603:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398d180 00000100:00100000:0.0:1746144890.762931:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.763199:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175049856 00000100:00100000:3.0:1746144890.763208:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175049856 00010000:00010000:3.0:1746144890.763236:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943fa expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.763269:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10690 00000100:00100000:3.0:1746144890.763276:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175049856:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.763289:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.763306:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943fa expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.763316:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943fa expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.763334:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514996 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af943fa expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.763363:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.763365:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.763371:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751499d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94401 expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.763378:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751499d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94401 expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.763405:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751499d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94401 expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.763416:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172387456:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.763485:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a659c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.769795:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.769898:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175050112 00000100:00100000:1.0:1746144890.769906:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175050112 00002000:00100000:1.0:1746144890.769942:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ea00 x1830965175050112/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.769951:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ea00 with x1830965175050112 ext(0->4095) 00002000:00010000:1.0:1746144890.769955:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398ea00 00000100:00100000:1.0:1746144890.769991:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3927 00000100:00100000:1.0:1746144890.769998:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1985:x1830965175050112:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144890.770398:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172387456:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.770412:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144890.770517:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1985:x1830965175050112:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 518us (756us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.770523:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3927 00002000:00100000:1.0:1746144890.770529:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ea00 x1830965175050112/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.770537:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ea00 with x1830965175050112 ext(0->4095) 00002000:00010000:1.0:1746144890.770540:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398ea00 00000100:00100000:3.0:1746144890.770905:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175049856:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7628us (7980us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.770915:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10690 00000100:00100000:0.0:1746144890.773090:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.773244:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175050240 00000100:00100000:2.0:1746144890.773252:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175050240 00000100:00100000:2.0:1746144890.773300:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5275 00000100:00100000:2.0:1746144890.773306:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175050240:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.773321:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.773335:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275149a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94408 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.773361:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751499d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94401 expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.773367:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.773369:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.773372:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275149a4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94408 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.773397:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751499d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94401 expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.773407:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751499d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94401 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:2.0:1746144890.773418:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172387584:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.773493:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.775351:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172387584:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.775379:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275149a4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94408 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.775393:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:2.0:1746144890.775434:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175050240:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2126us (2349us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.775441:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5275 00000100:00100000:0.0:1746144890.775638:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.775855:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175050368 00000100:00100000:3.0:1746144890.775860:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175050368 00010000:00010000:3.0:1746144890.775880:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751499d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94401 expref: 60 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.775904:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10691 00000100:00100000:3.0:1746144890.775909:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1984:x1830965175050368:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.775918:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.775933:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751499d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94401 expref: 60 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.775941:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751499d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94401 expref: 60 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.775957:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751499d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94401 expref: 60 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.775976:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.775978:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.775983:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275149a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94408 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.775990:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275149a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94408 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.776010:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275149a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94408 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.776019:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172387712:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.776069:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a659c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.779143:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.779289:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172387712:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.779306:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144890.779395:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175050624 00000100:00100000:1.0:1746144890.779400:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175050624 00002000:00100000:1.0:1746144890.779433:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398f800 x1830965175050624/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.779442:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398f800 with x1830965175050624 ext(0->4095) 00002000:00010000:1.0:1746144890.779446:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398f800 00000100:00100000:3.0:1746144890.779566:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1984:x1830965175050368:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3656us (3928us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.779575:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10691 00000100:00100000:0.0:1746144890.779708:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.779798:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3928 00000100:00100000:1.0:1746144890.779804:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175050624:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144890.779925:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175050624:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 122us (790us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.779931:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3928 00002000:00100000:1.0:1746144890.779935:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398f800 x1830965175050624/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.779942:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398f800 with x1830965175050624 ext(0->4095) 00002000:00010000:1.0:1746144890.779944:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398f800 00000100:00100000:3.0:1746144890.780090:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175050752 00000100:00100000:3.0:1746144890.780094:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175050752 00000100:00100000:3.0:1746144890.780109:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5276 00000100:00100000:3.0:1746144890.780113:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+59:31565:x1830965175050752:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144890.780120:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144890.780131:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9440f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.780148:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275149a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94408 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.780155:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.780156:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.780159:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9440f expref: 60 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.780179:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275149a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94408 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.780193:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275149a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94408 expref: 5 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.780202:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172387840:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144890.780247:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a659c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144890.782833:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172387840:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144890.782856:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9440f expref: 60 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.782870:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb68600, rc 0) 00000100:00100000:3.0:1746144890.783882:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:31565:x1830965175050752:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3761us (4168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.783891:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5276 00000100:00100000:1.0:1746144890.784862:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.784946:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.785012:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175050880 00000100:00100000:3.0:1746144890.785019:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175050880 00000100:00100000:3.0:1746144890.785270:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5277 00000100:00100000:3.0:1746144890.785277:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:31579:x1830965175050880:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144890.785293:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144890.785307:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275149b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94416 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.785328:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.785332:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9440f expref: 61 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.785342:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144890.785344:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275149b2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94416 expref: 61 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.785371:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9440f expref: 61 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.785381:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275149b2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94416 expref: 61 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.785389:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb68e00, rc 0) 00000100:00100000:3.0:1746144890.785427:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+61:31579:x1830965175050880:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 150us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.785433:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5277 00000100:00100000:3.0:1746144890.785450:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175051008 00000100:00100000:3.0:1746144890.785453:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175051008 00010000:00010000:3.0:1746144890.785463:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275149a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94408 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.785478:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10692 00000100:00100000:3.0:1746144890.785483:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175051008:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.785489:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.785506:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275149a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94408 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.785514:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275149a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94408 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.785528:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af67275149a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94408 expref: 6 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.785541:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.785542:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.785547:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9440f expref: 60 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.785554:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9440f expref: 60 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.785571:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9440f expref: 60 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.785580:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9440f expref: 60 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.785590:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172388096:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.785633:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a659c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.788452:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.789075:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172388096:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.789092:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.789556:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175051008:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4071us (4607us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.789566:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10692 00000100:00100000:2.0:1746144890.790052:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175051264 00000100:00100000:2.0:1746144890.790058:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175051264 00002000:00100000:2.0:1746144890.790090:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398fb80 x1830965175051264/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.790099:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398fb80 with x1830965175051264 ext(0->4095) 00010000:00010000:2.0:1746144890.790106:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9440f expref: 61 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.790117:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9440f expref: 61 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.790123:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398fb80 00000100:00100000:2.0:1746144890.790146:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1921 00000100:00100000:2.0:1746144890.790152:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1985:x1830965175051264:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144890.790278:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1985:x1830965175051264:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 126us (1833us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.790284:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1921 00002000:00100000:2.0:1746144890.790288:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398fb80 x1830965175051264/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.790295:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398fb80 with x1830965175051264 ext(0->4095) 00010000:00010000:2.0:1746144890.790299:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9440f expref: 61 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.790307:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9440f expref: 61 pid: 8432 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.790312:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398fb80 00000100:00100000:0.0:1746144890.793146:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.793699:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175051392 00000100:00100000:3.0:1746144890.793708:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175051392 00010000:00010000:3.0:1746144890.793736:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9440f expref: 61 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.793818:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10693 00000100:00100000:3.0:1746144890.793824:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1985:x1830965175051392:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.793836:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.793854:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9440f expref: 61 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.793864:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9440f expref: 61 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.793882:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af67275149ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9440f expref: 61 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.794090:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.794092:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.794098:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275149b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94416 expref: 60 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.794105:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275149b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94416 expref: 60 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.794387:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275149b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94416 expref: 60 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.794398:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172388224:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.794476:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.797909:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.797994:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172388224:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.798009:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.798043:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1985:x1830965175051392:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4219us (4902us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.798052:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10693 00000100:00100000:1.0:1746144890.798672:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175051648 00000100:00100000:1.0:1746144890.798678:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175051648 00002000:00100000:1.0:1746144890.798711:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ca80 x1830965175051648/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.798719:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ca80 with x1830965175051648 ext(0->4095) 00002000:00010000:1.0:1746144890.798723:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398ca80 00000100:00100000:1.0:1746144890.798747:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3929 00000100:00100000:1.0:1746144890.798753:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1984:x1830965175051648:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144890.798916:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1984:x1830965175051648:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 161us (1011us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.798922:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3929 00002000:00100000:1.0:1746144890.798926:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ca80 x1830965175051648/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.798932:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ca80 with x1830965175051648 ext(0->4095) 00002000:00010000:1.0:1746144890.798935:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398ca80 00000100:00100000:0.0:1746144890.801451:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.801864:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175051776 00000100:00100000:1.0:1746144890.801872:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175051776 00000100:00100000:1.0:1746144890.802132:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5278 00000100:00100000:1.0:1746144890.802139:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175051776:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144890.802154:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144890.802166:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9441d expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.802189:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275149b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94416 expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.802196:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.802198:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.802200:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9441d expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.802226:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275149b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94416 expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.802239:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275149b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94416 expref: 59 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144890.802249:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172388352:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144890.802601:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144890.804592:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172388352:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144890.804616:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9441d expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.804629:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500200, rc 0) 00000100:00100000:1.0:1746144890.804660:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175051776:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2522us (3217us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.804667:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5278 00000100:00100000:0.0:1746144890.805755:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.807216:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175051904 00000100:00100000:3.0:1746144890.807225:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175051904 00010000:00010000:3.0:1746144890.807256:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275149b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94416 expref: 60 pid: 8432 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.807285:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10694 00000100:00100000:3.0:1746144890.807291:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1985:x1830965175051904:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.807303:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.807321:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275149b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94416 expref: 60 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.807331:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275149b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94416 expref: 60 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.807348:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af67275149b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94416 expref: 60 pid: 8432 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.807376:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.807378:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.807384:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9441d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.807396:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9441d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.807423:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9441d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.807433:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172388480:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.807511:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.809302:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.809621:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175052032 00000100:00100000:1.0:1746144890.809627:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175052032 00000100:00100000:1.0:1746144890.810409:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5279 00000100:00100000:1.0:1746144890.810418:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+60:31565:x1830965175052032:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144890.810433:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144890.810448:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94424 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.810470:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9441d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.810481:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.810482:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.810485:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94424 expref: 61 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.810510:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9441d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.810525:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9441d expref: 5 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:1.0:1746144890.810535:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172388608:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144890.811839:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.813466:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.813646:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172388480:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.813662:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.814212:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1985:x1830965175051904:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6919us (8458us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.814221:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10694 00000100:00100000:2.0:1746144890.814668:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175052288 00000100:00100000:2.0:1746144890.814675:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175052288 00002000:00100000:2.0:1746144890.814707:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398dc00 x1830965175052288/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.814716:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398dc00 with x1830965175052288 ext(0->4095) 00010000:00010000:2.0:1746144890.814723:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9441d expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.814733:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9441d expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.814739:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398dc00 00000100:00100000:2.0:1746144890.814752:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1922 00000100:00100000:2.0:1746144890.814757:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175052288:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144890.814923:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175052288:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 165us (1460us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.814929:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1922 00002000:00100000:2.0:1746144890.814933:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398dc00 x1830965175052288/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.814939:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398dc00 with x1830965175052288 ext(0->4095) 00010000:00010000:2.0:1746144890.814943:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9441d expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.814951:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9441d expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:2.0:1746144890.814961:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398dc00 00000100:00100000:2.0:1746144890.816029:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172388608:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.816048:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94424 expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.816061:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500e00, rc 0) 00000100:00100000:2.0:1746144890.816091:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+60:31565:x1830965175052032:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5676us (6794us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.816097:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5279 00000100:00100000:0.0:1746144890.817884:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.817958:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175052416 00000100:00100000:2.0:1746144890.817972:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175052416 00000100:00100000:2.0:1746144890.818017:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5280 00000100:00100000:2.0:1746144890.818024:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+60:31579:x1830965175052416:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.818038:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.818051:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9442b expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.818072:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.818076:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94424 expref: 61 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.818081:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.818084:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149c7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9442b expref: 61 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.818112:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94424 expref: 61 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.818124:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149c7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9442b expref: 61 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.818132:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:2.0:1746144890.819516:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+61:31579:x1830965175052416:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1486us (1630us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.819524:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5280 00000100:00100000:1.0:1746144890.819736:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.819975:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175052544 00000100:00100000:3.0:1746144890.819981:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175052544 00010000:00010000:3.0:1746144890.820002:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9441d expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.820212:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10695 00000100:00100000:3.0:1746144890.820219:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175052544:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.820229:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.820245:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9441d expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.820255:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9441d expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.820273:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9441d expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.820297:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.820298:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.820304:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94424 expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.820312:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94424 expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.820336:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94424 expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.820345:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94424 expref: 60 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.820355:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172388864:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.820414:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65180 going to sleep for 11 seconds 00000100:00100000:3.0:1746144890.823548:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172388864:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.823565:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.824096:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175052544:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3875us (4357us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.824105:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10695 00000100:00100000:0.0:1746144890.824319:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.824400:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175052800 00000100:00100000:3.0:1746144890.824406:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175052800 00002000:00100000:3.0:1746144890.824435:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2d180 x1830965175052800/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144890.824442:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2d180 with x1830965175052800 ext(0->4095) 00010000:00010000:3.0:1746144890.824448:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94424 expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.824459:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94424 expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:3.0:1746144890.824464:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2d180 00000100:00100000:3.0:1746144890.824488:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1923 00000100:00100000:3.0:1746144890.824495:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1985:x1830965175052800:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144890.824618:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1985:x1830965175052800:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 123us (300us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144890.824623:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1923 00002000:00100000:3.0:1746144890.824628:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2d180 x1830965175052800/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144890.824634:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2d180 with x1830965175052800 ext(0->4095) 00010000:00010000:3.0:1746144890.824638:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94424 expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.824646:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94424 expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00002000:00010000:3.0:1746144890.824651:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2d180 00000100:00100000:0.0:1746144890.828119:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.828209:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175052928 00000100:00100000:3.0:1746144890.828216:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175052928 00010000:00010000:3.0:1746144890.828245:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94424 expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.828266:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10696 00000100:00100000:3.0:1746144890.828271:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1985:x1830965175052928:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.828282:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.828298:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94424 expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.828308:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94424 expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.828328:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94424 expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.828810:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.828812:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.828819:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9442b expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.828827:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9442b expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.828852:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9442b expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.828866:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172388992:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.828935:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.831656:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.831825:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175053184 00000100:00100000:2.0:1746144890.831832:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175053184 00002000:00100000:2.0:1746144890.831870:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2c380 x1830965175053184/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.831879:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2c380 with x1830965175053184 ext(0->4095) 00002000:00010000:2.0:1746144890.831883:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2c380 00000100:00100000:3.0:1746144890.832017:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172388992:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.832033:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.832066:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1985:x1830965175052928:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3794us (3955us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.832074:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10696 00000100:00100000:2.0:1746144890.832636:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3930 00000100:00100000:2.0:1746144890.832646:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1984:x1830965175053184:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144890.832796:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1984:x1830965175053184:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 152us (1146us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.832801:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3930 00002000:00100000:2.0:1746144890.832806:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2c380 x1830965175053184/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.832813:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2c380 with x1830965175053184 ext(0->4095) 00002000:00010000:2.0:1746144890.832816:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2c380 00000100:00100000:1.0:1746144890.834936:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.835033:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175053312 00000100:00100000:3.0:1746144890.835039:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175053312 00000100:00100000:3.0:1746144890.835282:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5281 00000100:00100000:3.0:1746144890.835288:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175053312:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144890.835302:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144890.835315:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af67275149ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94432 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.835335:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9442b expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.835342:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144890.835343:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144890.835346:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af67275149ce lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94432 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.835366:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9442b expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.835379:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9442b expref: 59 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.835388:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172389120:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144890.835444:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144890.836962:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172389120:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144890.836991:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af67275149ce lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94432 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.837003:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb68800, rc 0) 00000100:00100000:3.0:1746144890.837197:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175053312:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1907us (2265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.837203:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5281 00000100:00100000:0.0:1746144890.838854:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.838940:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175053440 00000100:00100000:3.0:1746144890.838946:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175053440 00010000:00010000:3.0:1746144890.838979:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9442b expref: 60 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.839026:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10697 00000100:00100000:3.0:1746144890.839032:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1985:x1830965175053440:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.839043:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.839060:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9442b expref: 60 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.839073:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9442b expref: 60 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.839090:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9442b expref: 60 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.839111:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.839113:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.839118:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af67275149ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94432 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.839125:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af67275149ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94432 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.839147:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af67275149ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94432 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.839156:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172389248:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.839600:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144890.842347:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172389248:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.842364:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.842396:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1985:x1830965175053440:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3364us (3546us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.842405:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10697 00000100:00100000:0.0:1746144890.844439:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144890.844480:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.844555:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175053696 00000100:00100000:3.0:1746144890.844561:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175053696 00000100:00100000:2.0:1746144890.844634:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175053824 00000100:00100000:2.0:1746144890.844638:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175053824 00002000:00100000:2.0:1746144890.844665:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2e300 x1830965175053824/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.844674:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2e300 with x1830965175053824 ext(0->4095) 00002000:00010000:2.0:1746144890.844678:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2e300 00000100:00100000:2.0:1746144890.844692:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3931 00000100:00100000:2.0:1746144890.844697:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175053824:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144890.844859:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175053824:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 161us (378us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.844865:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3931 00002000:00100000:2.0:1746144890.844870:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2e300 x1830965175053824/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.844877:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2e300 with x1830965175053824 ext(0->4095) 00002000:00010000:2.0:1746144890.844880:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2e300 00000100:00100000:3.0:1746144890.844942:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5282 00000100:00100000:3.0:1746144890.844947:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+59:31565:x1830965175053696:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144890.844956:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144890.844977:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94439 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.844997:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af67275149ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94432 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.845005:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.845006:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.845010:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94439 expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.845032:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af67275149ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94432 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.845041:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af67275149ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94432 expref: 5 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.845051:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172389376:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144890.845459:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.849079:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.849470:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172389376:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144890.849492:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94439 expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.849510:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb69a00, rc 0) 00000100:00100000:1.0:1746144890.850267:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175053952 00000100:00100000:1.0:1746144890.850273:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175053952 00000100:00100000:1.0:1746144890.850310:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5283 00000100:00100000:1.0:1746144890.850317:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+61:31579:x1830965175053952:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144890.850330:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144890.850343:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275149dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94440 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.850360:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.850364:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94439 expref: 62 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.850374:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.850377:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275149dc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94440 expref: 62 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.850403:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94439 expref: 62 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.850413:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275149dc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94440 expref: 62 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.850421:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500400, rc 0) 00000100:00100000:3.0:1746144890.850619:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+62:31565:x1830965175053696:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5670us (6182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.850626:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5282 00000100:00100000:1.0:1746144890.850955:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+61:31579:x1830965175053952:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 637us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.850960:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5283 00000100:00100000:0.0:1746144890.851332:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.851495:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175054080 00000100:00100000:3.0:1746144890.851499:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175054080 00010000:00010000:3.0:1746144890.851515:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af67275149ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94432 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.851533:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10698 00000100:00100000:3.0:1746144890.851538:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175054080:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.851546:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.851562:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af67275149ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94432 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.851572:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af67275149ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94432 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.851587:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af67275149ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94432 expref: 6 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:3.0:1746144890.851610:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.851612:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.851618:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94439 expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.851629:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94439 expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.851650:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94439 expref: 60 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.851659:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94439 expref: 60 pid: 10401 timeout: 584 lvb_type: 0 00000100:00100000:3.0:1746144890.851669:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172389632:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.851727:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144890.854106:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172389632:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.854121:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.854186:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175054080:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2646us (2853us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.854195:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10698 00000100:00100000:0.0:1746144890.856279:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.856417:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175054336 00000100:00100000:2.0:1746144890.856424:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175054336 00002000:00100000:2.0:1746144890.856463:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2f100 x1830965175054336/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.856472:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2f100 with x1830965175054336 ext(0->4095) 00010000:00010000:2.0:1746144890.856479:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94439 expref: 61 pid: 10401 timeout: 584 lvb_type: 0 00010000:00010000:2.0:1746144890.856490:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94439 expref: 61 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144890.856500:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2f100 00000100:00100000:2.0:1746144890.856517:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1924 00000100:00100000:2.0:1746144890.856524:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1985:x1830965175054336:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144890.856680:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1985:x1830965175054336:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 156us (406us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.856686:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1924 00002000:00100000:2.0:1746144890.856692:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2f100 x1830965175054336/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.856698:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2f100 with x1830965175054336 ext(0->4095) 00010000:00010000:2.0:1746144890.856702:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94439 expref: 61 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144890.856710:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94439 expref: 61 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144890.856715:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2f100 00000100:00100000:0.0:1746144890.859006:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.859113:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175054464 00000100:00100000:3.0:1746144890.859120:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175054464 00010000:00010000:3.0:1746144890.859143:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94439 expref: 61 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144890.859162:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10699 00000100:00100000:3.0:1746144890.859167:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1985:x1830965175054464:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.859176:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.859192:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94439 expref: 61 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.859201:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94439 expref: 61 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.859220:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af67275149d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94439 expref: 61 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.859244:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.859246:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.859251:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275149dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94440 expref: 60 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.859257:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275149dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94440 expref: 60 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.859282:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275149dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94440 expref: 60 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.859292:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172389760:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.859353:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.863284:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.863446:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175054720 00000100:00100000:1.0:1746144890.863453:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175054720 00002000:00100000:1.0:1746144890.863492:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2d880 x1830965175054720/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.863500:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2d880 with x1830965175054720 ext(0->4095) 00002000:00010000:1.0:1746144890.863505:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2d880 00000100:00100000:1.0:1746144890.863531:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3932 00000100:00100000:1.0:1746144890.863538:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1984:x1830965175054720:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144890.863671:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1984:x1830965175054720:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 134us (394us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.863681:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3932 00002000:00100000:1.0:1746144890.863686:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2d880 x1830965175054720/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.863692:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2d880 with x1830965175054720 ext(0->4095) 00002000:00010000:1.0:1746144890.863694:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2d880 00000100:00100000:3.0:1746144890.863788:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172389760:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.863802:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.863823:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1985:x1830965175054464:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4656us (4822us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.863831:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10699 00000100:00100000:0.0:1746144890.868156:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.868249:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175054848 00000100:00100000:1.0:1746144890.868257:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175054848 00000100:00100000:1.0:1746144890.868294:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5284 00000100:00100000:1.0:1746144890.868301:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175054848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144890.868315:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144890.868328:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94447 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.868349:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275149dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94440 expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.868355:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.868357:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.868360:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94447 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.868383:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275149dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94440 expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.868393:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275149dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94440 expref: 59 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144890.868408:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172389888:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144890.868489:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144890.871000:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172389888:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144890.871024:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94447 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.871037:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501200, rc 0) 00000100:00100000:1.0:1746144890.871073:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175054848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2772us (2924us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.871080:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5284 00000100:00100000:0.0:1746144890.871623:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.871944:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175054976 00000100:00100000:3.0:1746144890.871949:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175054976 00010000:00010000:3.0:1746144890.871980:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275149dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94440 expref: 60 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144890.871999:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10700 00000100:00100000:3.0:1746144890.872004:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1985:x1830965175054976:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.872013:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.872030:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275149dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94440 expref: 60 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.872038:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275149dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94440 expref: 60 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.872056:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af67275149dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94440 expref: 60 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.872080:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.872082:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.872087:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94447 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.872095:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94447 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.872117:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94447 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.872136:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172390016:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.872190:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.873353:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.873411:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175055104 00000100:00100000:1.0:1746144890.873416:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175055104 00000100:00100000:1.0:1746144890.873439:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5285 00000100:00100000:1.0:1746144890.873445:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:31565:x1830965175055104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144890.873456:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144890.873467:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9444e expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.873485:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94447 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.873492:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.873493:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.873496:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9444e expref: 61 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.873518:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94447 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.873528:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94447 expref: 5 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144890.873536:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172390144:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144890.873588:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:3.0:1746144890.875231:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172390016:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.875247:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.875279:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1985:x1830965175054976:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3273us (3655us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.875287:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10700 00000100:00100000:0.0:1746144890.877345:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.877417:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172390144:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144890.877438:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9444e expref: 60 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.877452:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500200, rc 0) 00000100:00100000:1.0:1746144890.877483:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:31565:x1830965175055104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4038us (4133us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.877490:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5285 00000100:00100000:2.0:1746144890.877687:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175055360 00000100:00100000:2.0:1746144890.877693:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175055360 00002000:00100000:2.0:1746144890.877725:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2c700 x1830965175055360/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.877734:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2c700 with x1830965175055360 ext(0->4095) 00010000:00010000:2.0:1746144890.877740:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94447 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144890.877755:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94447 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144890.877782:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2c700 00000100:00100000:2.0:1746144890.877807:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1925 00000100:00100000:2.0:1746144890.877815:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175055360:12345-192.168.202.16@tcp:3:ldlm_bl.0 00000100:00100000:2.0:1746144890.877947:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175055360:12345-192.168.202.16@tcp:3:ldlm_bl.0 Request processed in 132us (606us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.877953:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1925 00002000:00100000:2.0:1746144890.877958:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2c700 x1830965175055360/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.877975:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2c700 with x1830965175055360 ext(0->4095) 00010000:00010000:2.0:1746144890.877979:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94447 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144890.877988:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94447 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144890.877993:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2c700 00000100:00100000:0.0:1746144890.880940:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.881066:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175055488 00000100:00100000:3.0:1746144890.881073:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175055488 00010000:00010000:3.0:1746144890.881102:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94447 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144890.881162:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10701 00000100:00100000:3.0:1746144890.881170:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175055488:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.881181:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.881199:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94447 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.881209:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94447 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.881228:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af67275149e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94447 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.881254:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.881256:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.881262:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9444e expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.881268:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9444e expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.881295:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9444e expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.881305:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172390272:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.881677:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144890.883933:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172390272:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.883947:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.883985:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175055488:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2816us (3051us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.883994:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10701 00000100:00100000:0.0:1746144890.884377:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.884995:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175055744 00000100:00100000:1.0:1746144890.885002:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175055744 00002000:00100000:1.0:1746144890.885033:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2ca80 x1830965175055744/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.885042:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2ca80 with x1830965175055744 ext(0->4095) 00002000:00010000:1.0:1746144890.885046:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2ca80 00000100:00100000:1.0:1746144890.885067:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3933 00000100:00100000:1.0:1746144890.885073:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1984:x1830965175055744:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144890.885211:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1984:x1830965175055744:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 137us (835us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.885217:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3933 00002000:00100000:1.0:1746144890.885221:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2ca80 x1830965175055744/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.885229:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2ca80 with x1830965175055744 ext(0->4095) 00002000:00010000:1.0:1746144890.885231:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2ca80 00000100:00100000:0.0:1746144890.909571:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.909637:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175055872 00000100:00100000:1.0:1746144890.909645:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175055872 00000100:00100000:1.0:1746144890.909677:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5286 00000100:00100000:1.0:1746144890.909684:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175055872:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144890.909698:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144890.909711:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94455 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.909733:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9444e expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.909739:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.909741:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.909744:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94455 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.909783:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9444e expref: 59 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.909798:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9444e expref: 59 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144890.909809:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172390400:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144890.909882:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144890.911159:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172390400:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144890.911179:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94455 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.911190:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501a00, rc 0) 00000100:00100000:1.0:1746144890.911215:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175055872:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1532us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.911221:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5286 00000100:00100000:0.0:1746144890.932723:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.932913:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175056000 00000100:00100000:2.0:1746144890.932920:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175056000 00002000:00100000:2.0:1746144890.932958:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880135eaa680 x1830965175056000/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 496/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.932977:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135eaa680 with x1830965175056000 ext(0->7) 00010000:00010000:2.0:1746144890.932985:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9444e expref: 60 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144890.932997:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9444e expref: 60 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144890.933003:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135eaa680 00000100:00100000:0.0:1746144890.933500:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.933544:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1926 00000100:00100000:2.0:1746144890.933554:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1984:x1830965175056000:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144890.933856:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1984:x1830965175056000:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 304us (1138us total) trans 4294967993 rc 0/0 00000100:00100000:2.0:1746144890.933861:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1926 00002000:00100000:2.0:1746144890.933867:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880135eaa680 x1830965175056000/t4294967993(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 496/448 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.933874:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135eaa680 with x1830965175056000 ext(0->7) 00010000:00010000:2.0:1746144890.933879:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9444e expref: 62 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144890.933887:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9444e expref: 62 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144890.933892:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135eaa680 00000100:00100000:1.0:1746144890.934169:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175056128 00000100:00100000:1.0:1746144890.934174:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175056128 00000100:00100000:1.0:1746144890.934193:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5287 00000100:00100000:1.0:1746144890.934198:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+62:31565:x1830965175056128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144890.934206:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144890.934217:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9445c expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.934234:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.934238:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94455 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.934247:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144890.934250:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149f8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9445c expref: 63 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.934277:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94455 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.934288:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149f8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9445c expref: 63 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.934296:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500e00, rc 0) 00000100:00100000:1.0:1746144890.934325:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:31565:x1830965175056128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 126us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.934329:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5287 00000100:00100000:0.0:1746144890.940298:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.940381:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175056256 00000100:00100000:3.0:1746144890.940389:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175056256 00010000:00010000:3.0:1746144890.940418:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9444e expref: 63 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144890.940438:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10702 00000100:00100000:3.0:1746144890.940444:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1982:x1830965175056256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.940455:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.940470:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9444e expref: 63 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.940486:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9444e expref: 63 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.940504:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af67275149ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9444e expref: 63 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.940670:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.940672:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.940679:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94455 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.940687:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94455 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.940716:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94455 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.940726:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94455 expref: 5 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144890.940736:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172390656:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.941294:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.942862:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.942923:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175056512 00000100:00100000:1.0:1746144890.942928:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175056512 00002000:00100000:1.0:1746144890.942957:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea8a80 x1830965175056512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.942975:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8a80 with x1830965175056512 ext(0->4095) 00010000:00010000:1.0:1746144890.942982:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94455 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144890.942993:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94455 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144890.942999:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea8a80 00000100:00100000:1.0:1746144890.943022:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1927 00000100:00100000:1.0:1746144890.943028:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175056512:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144890.943158:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175056512:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 130us (299us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.943164:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1927 00002000:00100000:1.0:1746144890.943169:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea8a80 x1830965175056512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.943177:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8a80 with x1830965175056512 ext(0->4095) 00010000:00010000:1.0:1746144890.943181:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94455 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144890.943189:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94455 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144890.943194:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea8a80 00000100:00100000:3.0:1746144890.943264:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172390656:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.943277:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.943295:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1982:x1830965175056256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2851us (3005us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.943304:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10702 00000100:00100000:0.0:1746144890.945194:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.945260:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175056640 00000100:00100000:3.0:1746144890.945266:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175056640 00010000:00010000:3.0:1746144890.945288:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94455 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144890.945307:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10703 00000100:00100000:3.0:1746144890.945313:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175056640:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.945324:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.945339:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94455 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.945348:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94455 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.945366:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af67275149f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94455 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.946158:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.946161:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.946169:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9445c expref: 61 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.946177:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9445c expref: 61 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.946206:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9445c expref: 61 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.946217:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172390784:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.948476:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144890.951386:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172390784:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.951403:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.951436:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175056640:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6123us (6246us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.951444:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10703 00000100:00100000:0.0:1746144890.951944:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.952022:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175056896 00000100:00100000:2.0:1746144890.952027:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175056896 00002000:00100000:2.0:1746144890.952059:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea8700 x1830965175056896/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.952072:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8700 with x1830965175056896 ext(0->4095) 00002000:00010000:2.0:1746144890.952075:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea8700 00000100:00100000:2.0:1746144890.952097:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3934 00000100:00100000:2.0:1746144890.952102:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1983:x1830965175056896:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746144890.952238:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1983:x1830965175056896:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 135us (294us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.952243:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3934 00002000:00100000:2.0:1746144890.952248:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea8700 x1830965175056896/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.952253:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8700 with x1830965175056896 ext(0->4095) 00002000:00010000:2.0:1746144890.952255:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea8700 00000100:00100000:0.0:1746144890.954125:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.954312:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175057024 00000100:00100000:2.0:1746144890.954317:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175057024 00000100:00100000:2.0:1746144890.954498:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5288 00000100:00100000:2.0:1746144890.954506:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175057024:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.954519:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.954532:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94463 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.954554:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9445c expref: 61 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.954560:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.954562:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.954565:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94463 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.954588:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9445c expref: 61 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.954596:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9445c expref: 61 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144890.954606:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172390912:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.955264:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144890.956908:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172390912:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.956935:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94463 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.956949:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:2.0:1746144890.956989:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175057024:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2484us (2866us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.956995:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5288 00000100:00100000:0.0:1746144890.958909:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.959096:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175057152 00000100:00100000:3.0:1746144890.959102:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175057152 00010000:00010000:3.0:1746144890.959127:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9445c expref: 62 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144890.959145:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10704 00000100:00100000:3.0:1746144890.959150:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175057152:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.959161:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.959179:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9445c expref: 62 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.959190:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9445c expref: 62 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.959208:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af67275149f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9445c expref: 62 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.959362:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.959365:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.959370:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94463 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.959377:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94463 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.959402:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94463 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.959411:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172391040:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.959589:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.961392:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.962121:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175057280 00000100:00100000:2.0:1746144890.962129:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175057280 00000100:00100000:3.0:1746144890.962237:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172391040:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.962252:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.962286:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175057152:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3135us (3380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.962294:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10704 00000100:00100000:2.0:1746144890.962757:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5289 00000100:00100000:2.0:1746144890.962793:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+61:31565:x1830965175057280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.962807:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.962819:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9446a expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.962845:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94463 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.962852:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.962853:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.962856:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9446a expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.962878:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94463 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.962887:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94463 expref: 5 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144890.962898:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172391168:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144890.962939:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.964581:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.964876:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175057536 00000100:00100000:1.0:1746144890.964882:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175057536 00002000:00100000:1.0:1746144890.964915:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e39f80 x1830965175057536/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.964924:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e39f80 with x1830965175057536 ext(0->4095) 00010000:00010000:1.0:1746144890.964930:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94463 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144890.964940:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94463 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144890.964949:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e39f80 00000100:00100000:1.0:1746144890.964982:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1928 00000100:00100000:1.0:1746144890.964988:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175057536:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144890.965129:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175057536:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 141us (552us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.965135:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1928 00002000:00100000:1.0:1746144890.965139:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e39f80 x1830965175057536/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.965145:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e39f80 with x1830965175057536 ext(0->4095) 00010000:00010000:1.0:1746144890.965150:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94463 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144890.965157:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94463 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144890.965162:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e39f80 00000100:00100000:2.0:1746144890.965587:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172391168:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144890.965611:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9446a expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.965622:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:2.0:1746144890.965641:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+62:31565:x1830965175057280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2878us (4256us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.965647:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5289 00000100:00100000:0.0:1746144890.968954:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.969313:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175057664 00000100:00100000:2.0:1746144890.969322:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175057664 00000100:00100000:2.0:1746144890.969365:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5290 00000100:00100000:2.0:1746144890.969371:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+62:31579:x1830965175057664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.969385:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.969398:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a0d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94471 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.969419:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.969423:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9446a expref: 63 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.969429:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.969432:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a0d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94471 expref: 63 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.969459:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9446a expref: 63 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.969470:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a0d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94471 expref: 63 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.969478:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:2.0:1746144890.969508:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+63:31579:x1830965175057664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 137us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.969513:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5290 00000100:00100000:0.0:1746144890.970759:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.970861:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175057792 00000100:00100000:3.0:1746144890.970866:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175057792 00010000:00010000:3.0:1746144890.970887:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94463 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144890.970905:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10705 00000100:00100000:3.0:1746144890.970910:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175057792:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.970920:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.970937:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94463 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.970950:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94463 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.970979:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af67275149ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94463 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.971002:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.971004:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.971009:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9446a expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.971016:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9446a expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.971037:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9446a expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.971046:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9446a expref: 62 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144890.971057:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172391424:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.971118:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.973387:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.973567:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172391424:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.973583:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.973615:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175057792:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2705us (2860us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.973627:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10705 00000100:00100000:2.0:1746144890.973696:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175058048 00000100:00100000:2.0:1746144890.973701:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175058048 00002000:00100000:2.0:1746144890.973731:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e39500 x1830965175058048/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.973745:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e39500 with x1830965175058048 ext(0->4095) 00010000:00010000:2.0:1746144890.973751:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9446a expref: 63 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144890.973760:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9446a expref: 63 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144890.973793:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e39500 00000100:00100000:2.0:1746144890.974397:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1929 00000100:00100000:2.0:1746144890.974405:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1985:x1830965175058048:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144890.974533:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1985:x1830965175058048:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 130us (1150us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.974539:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1929 00002000:00100000:2.0:1746144890.974545:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e39500 x1830965175058048/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.974552:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e39500 with x1830965175058048 ext(0->4095) 00010000:00010000:2.0:1746144890.974556:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9446a expref: 63 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144890.974564:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9446a expref: 63 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144890.974569:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e39500 00000100:00100000:0.0:1746144890.978500:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.978577:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175058176 00000100:00100000:3.0:1746144890.978584:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175058176 00010000:00010000:3.0:1746144890.978611:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9446a expref: 63 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144890.978633:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10706 00000100:00100000:3.0:1746144890.978639:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1983:x1830965175058176:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.978650:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.978666:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9446a expref: 63 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.978676:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9446a expref: 63 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.978694:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9446a expref: 63 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.978717:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.978719:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.978724:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94471 expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.978732:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94471 expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.978758:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94471 expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.978786:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172391552:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.978853:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144890.980976:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172391552:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.980992:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.981023:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1983:x1830965175058176:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2384us (2529us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.981031:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10706 00000100:00100000:0.0:1746144890.981503:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.981958:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175058432 00000100:00100000:1.0:1746144890.981977:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175058432 00002000:00100000:1.0:1746144890.982006:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e3aa00 x1830965175058432/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.982014:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3aa00 with x1830965175058432 ext(0->4095) 00002000:00010000:1.0:1746144890.982017:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e3aa00 00000100:00100000:1.0:1746144890.982041:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3935 00000100:00100000:1.0:1746144890.982048:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175058432:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144890.982185:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175058432:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 137us (682us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144890.982191:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3935 00002000:00100000:1.0:1746144890.982196:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e3aa00 x1830965175058432/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144890.982202:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3aa00 with x1830965175058432 ext(0->4095) 00002000:00010000:1.0:1746144890.982205:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e3aa00 00000100:00100000:0.0:1746144890.984222:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.984334:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175058560 00000100:00100000:1.0:1746144890.984340:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175058560 00000100:00100000:1.0:1746144890.984377:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5291 00000100:00100000:1.0:1746144890.984382:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175058560:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144890.984395:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144890.984408:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a14 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94478 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.984428:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94471 expref: 61 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.984434:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.984436:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144890.984438:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a14 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94478 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.984462:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94471 expref: 61 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.984475:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94471 expref: 61 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144890.984485:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172391680:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144890.984549:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144890.986541:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172391680:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144890.986566:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a14 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94478 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.986582:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500c00, rc 0) 00000100:00100000:1.0:1746144890.986613:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175058560:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2230us (2396us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.986620:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5291 00000100:00100000:0.0:1746144890.987528:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.987713:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175058688 00000100:00100000:3.0:1746144890.987719:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175058688 00010000:00010000:3.0:1746144890.987741:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94471 expref: 62 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144890.987777:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10707 00000100:00100000:3.0:1746144890.987784:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175058688:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.987793:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.987810:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94471 expref: 62 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.987819:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94471 expref: 62 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.987837:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94471 expref: 62 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.987862:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.987864:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.987869:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94478 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.987875:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94478 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.987898:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94478 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144890.987909:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172391808:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144890.987977:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.991388:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.991492:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172391808:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144890.991508:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144890.991629:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1985:x1830965175058688:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3845us (4103us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144890.991638:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10707 00000100:00100000:2.0:1746144890.992415:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175058944 00000100:00100000:2.0:1746144890.992421:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175058944 00002000:00100000:2.0:1746144890.992459:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e38000 x1830965175058944/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/0 e 0 to 0 dl 1746144901 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.992467:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38000 with x1830965175058944 ext(0->4095) 00002000:00010000:2.0:1746144890.992471:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e38000 00000100:00100000:2.0:1746144890.992494:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3936 00000100:00100000:2.0:1746144890.992500:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175058944:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144890.992635:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175058944:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 135us (1252us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144890.992640:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3936 00002000:00100000:2.0:1746144890.992645:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e38000 x1830965175058944/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:531/0 lens 488/4536 e 0 to 0 dl 1746144901 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144890.992651:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38000 with x1830965175058944 ext(0->4095) 00002000:00010000:2.0:1746144890.992654:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e38000 00000100:00100000:0.0:1746144890.993484:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144890.993993:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175059072 00000100:00100000:1.0:1746144890.993998:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175059072 00000100:00100000:1.0:1746144890.994030:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5292 00000100:00100000:1.0:1746144890.994035:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+61:31565:x1830965175059072:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144890.994045:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144890.994056:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9447f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.994077:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a14 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94478 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.994087:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.994088:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144890.994091:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9447f expref: 62 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.994113:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94478 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.994121:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94478 expref: 5 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144890.994130:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172391936:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144890.994183:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144890.996096:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144890.996136:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175059200 00000100:00100000:2.0:1746144890.996143:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175059200 00000100:00100000:2.0:1746144890.996316:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5293 00000100:00100000:2.0:1746144890.996325:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+63:31579:x1830965175059200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144890.996340:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144890.996355:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a22 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94486 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.996377:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144890.996382:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9447f expref: 64 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.996391:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144890.996395:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a22 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94486 expref: 64 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.996424:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9447f expref: 64 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.996436:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a22 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94486 expref: 64 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144890.996445:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:2.0:1746144890.996632:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+64:31579:x1830965175059200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 307us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144890.996639:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5293 00000100:00100000:1.0:1746144890.996895:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172391936:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144890.996910:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9447f expref: 63 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144890.996919:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500200, rc 0) 00000100:00100000:1.0:1746144890.996949:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:31565:x1830965175059072:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2913us (3466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144890.996954:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5292 00000100:00100000:0.0:1746144890.998704:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144890.998789:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175059328 00000100:00100000:3.0:1746144890.998796:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175059328 00010000:00010000:3.0:1746144890.998823:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94478 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144890.998889:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10708 00000100:00100000:3.0:1746144890.998897:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175059328:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144890.998908:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144890.998926:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a14 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94478 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.998941:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a14 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94478 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.998960:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a14 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94478 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144890.999333:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.999336:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144890.999344:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9447f expref: 62 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.999353:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9447f expref: 62 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.999384:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9447f expref: 62 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144890.999395:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9447f expref: 62 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144890.999405:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172392192:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.000308:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 10 seconds 00000100:00100000:3.0:1746144891.001203:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172392192:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.001217:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.001244:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175059328:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2348us (2545us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.001256:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10708 00000100:00100000:0.0:1746144891.002742:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.002891:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175059584 00000100:00100000:1.0:1746144891.002898:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175059584 00002000:00100000:1.0:1746144891.002946:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e38700 x1830965175059584/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.002961:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38700 with x1830965175059584 ext(0->4095) 00010000:00010000:1.0:1746144891.002978:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9447f expref: 63 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.002990:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9447f expref: 63 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.002995:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e38700 00000100:00100000:1.0:1746144891.003025:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1930 00000100:00100000:1.0:1746144891.003031:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1985:x1830965175059584:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144891.003177:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1985:x1830965175059584:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 146us (439us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.003184:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1930 00002000:00100000:1.0:1746144891.003189:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e38700 x1830965175059584/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.003195:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38700 with x1830965175059584 ext(0->4095) 00010000:00010000:1.0:1746144891.003200:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9447f expref: 63 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.003209:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9447f expref: 63 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.003214:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e38700 00000100:00080000:2.0:1746144891.004802:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144891.007341:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.007407:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175059712 00000100:00100000:3.0:1746144891.007416:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175059712 00010000:00010000:3.0:1746144891.007446:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9447f expref: 63 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.007480:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10709 00000100:00100000:3.0:1746144891.007487:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1985:x1830965175059712:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.007500:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.007545:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9447f expref: 63 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.007556:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9447f expref: 63 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.007668:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514a1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9447f expref: 63 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.007683:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.007685:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.007690:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94486 expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.007698:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94486 expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.007725:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94486 expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.007736:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172392320:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.008563:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.013115:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.013209:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172392320:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.013225:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.013258:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175059712:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5771us (7531us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.013267:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10709 00000100:00100000:3.0:1746144891.013462:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175059968 00000100:00100000:3.0:1746144891.013468:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175059968 00002000:00100000:3.0:1746144891.013498:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e3a680 x1830965175059968/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.013506:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3a680 with x1830965175059968 ext(0->4095) 00002000:00010000:3.0:1746144891.013509:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e3a680 00000100:00100000:3.0:1746144891.013654:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3937 00000100:00100000:3.0:1746144891.013661:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175059968:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144891.013974:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175059968:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 304us (858us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.013980:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3937 00002000:00100000:3.0:1746144891.013985:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e3a680 x1830965175059968/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.013993:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3a680 with x1830965175059968 ext(0->4095) 00002000:00010000:3.0:1746144891.013996:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e3a680 00000100:00100000:0.0:1746144891.018557:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.018622:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175060096 00000100:00100000:1.0:1746144891.018630:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175060096 00000100:00100000:1.0:1746144891.018696:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5294 00000100:00100000:1.0:1746144891.018703:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175060096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144891.018717:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144891.018730:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9448d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.018754:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a22 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94486 expref: 61 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.018793:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144891.018795:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144891.018798:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.018829:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94486 expref: 61 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.018839:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94486 expref: 61 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.018851:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172392448:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144891.018926:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00080000:2.0:1746144891.019002:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746144891.023162:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172392448:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144891.023187:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.023204:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500c00, rc 0) 00000100:00100000:1.0:1746144891.023239:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175060096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4537us (4690us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.023245:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5294 00000100:00100000:0.0:1746144891.025136:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144891.025400:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.025453:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175060352 00000100:00100000:2.0:1746144891.025460:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175060352 00010000:00010000:2.0:1746144891.025491:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94486 expref: 62 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.025519:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10710 00000100:00100000:2.0:1746144891.025526:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175060352:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.025537:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144891.025542:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175060224 00000100:00100000:1.0:1746144891.025546:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175060224 00010000:00010000:2.0:1746144891.025560:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a22 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94486 expref: 63 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.025570:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a22 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94486 expref: 63 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.025580:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5295 00000100:00100000:1.0:1746144891.025586:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:31565:x1830965175060224:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.025588:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a22 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94486 expref: 63 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.025599:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.025611:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.025613:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.025619:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.025627:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.025633:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94494 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.025650:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.025661:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.025662:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.025664:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94494 expref: 63 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.025684:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.025697:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 5 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.025711:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 5 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.025712:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172392704:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.025719:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 5 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.025730:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172392576:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.025791:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144891.025798:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144891.030045:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172392704:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144891.030077:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94494 expref: 63 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.030091:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501a00, rc 0) 00000100:00100000:1.0:1746144891.030141:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:31565:x1830965175060224:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4554us (5009us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.030149:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5295 00000100:00100000:2.0:1746144891.030228:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172392576:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.030242:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.030271:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175060352:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4746us (4872us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.030279:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10710 00000100:00100000:0.0:1746144891.031404:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.031501:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175060608 00000100:00100000:3.0:1746144891.031507:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175060608 00002000:00100000:3.0:1746144891.031537:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230e680 x1830965175060608/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.031545:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230e680 with x1830965175060608 ext(0->4095) 00010000:00010000:3.0:1746144891.031551:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.031562:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.031568:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230e680 00000100:00100000:3.0:1746144891.031581:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1931 00000100:00100000:3.0:1746144891.031586:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175060608:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144891.031728:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175060608:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 140us (326us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.031733:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1931 00002000:00100000:3.0:1746144891.031738:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230e680 x1830965175060608/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.031745:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230e680 with x1830965175060608 ext(0->4095) 00010000:00010000:3.0:1746144891.031749:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.031758:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.031782:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230e680 00000100:00100000:0.0:1746144891.033977:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.034040:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175060736 00000100:00100000:2.0:1746144891.034047:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175060736 00010000:00010000:2.0:1746144891.034074:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.034102:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10711 00000100:00100000:2.0:1746144891.034108:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175060736:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.034118:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.034134:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.034144:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.034163:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514a29 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9448d expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.034187:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.034189:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.034195:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94494 expref: 61 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.034202:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94494 expref: 61 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.034249:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94494 expref: 61 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.034259:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172392832:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.034328:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.042546:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172392832:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.042570:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.042615:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175060736:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 8507us (8652us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.042625:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10711 00000100:00100000:0.0:1746144891.043252:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.043426:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175060992 00000100:00100000:1.0:1746144891.043431:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175060992 00002000:00100000:1.0:1746144891.043459:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230dc00 x1830965175060992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.043469:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230dc00 with x1830965175060992 ext(0->4095) 00002000:00010000:1.0:1746144891.043473:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230dc00 00000100:00100000:1.0:1746144891.043497:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3938 00000100:00100000:1.0:1746144891.043502:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175060992:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144891.044449:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175060992:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 944us (1196us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.044457:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3938 00002000:00100000:1.0:1746144891.044464:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230dc00 x1830965175060992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.044478:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230dc00 with x1830965175060992 ext(0->4095) 00002000:00010000:1.0:1746144891.044482:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230dc00 00000100:00100000:0.0:1746144891.048205:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.048268:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175061120 00000100:00100000:1.0:1746144891.048276:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175061120 00000100:00100000:1.0:1746144891.048318:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5296 00000100:00100000:1.0:1746144891.048324:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175061120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144891.048340:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144891.048353:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514a37 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9449b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.048376:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94494 expref: 61 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.048383:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144891.048385:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144891.048388:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514a37 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9449b expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.048410:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94494 expref: 61 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.048419:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94494 expref: 61 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.048429:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172392960:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144891.048888:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144891.054074:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172392960:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144891.054102:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514a37 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9449b expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.054115:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501200, rc 0) 00000100:00100000:1.0:1746144891.054159:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175061120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5834us (5961us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.054167:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5296 00000100:00100000:0.0:1746144891.059209:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.060338:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175061248 00000100:00100000:1.0:1746144891.060347:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175061248 00002000:00100000:1.0:1746144891.060386:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009230ed80 x1830965175061248/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.060395:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230ed80 with x1830965175061248 ext(0->7) 00010000:00010000:1.0:1746144891.060402:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94494 expref: 62 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.060414:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94494 expref: 62 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.060420:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230ed80 00000100:00100000:1.0:1746144891.060449:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1932 00000100:00100000:1.0:1746144891.060456:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175061248:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144891.060752:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1985:x1830965175061248:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 295us (1548us total) trans 4294967994 rc 0/0 00000100:00100000:1.0:1746144891.060758:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1932 00002000:00100000:1.0:1746144891.060781:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009230ed80 x1830965175061248/t4294967994(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/448 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.060788:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230ed80 with x1830965175061248 ext(0->7) 00010000:00010000:1.0:1746144891.060792:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94494 expref: 64 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.060801:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94494 expref: 64 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.060805:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230ed80 00000100:00100000:0.0:1746144891.063752:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.064244:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175061376 00000100:00100000:2.0:1746144891.064251:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175061376 00010000:00010000:2.0:1746144891.064282:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94494 expref: 64 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.064314:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10712 00000100:00100000:2.0:1746144891.064320:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1982:x1830965175061376:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.064331:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.064346:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94494 expref: 64 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.064359:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94494 expref: 64 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.064376:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727514a30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94494 expref: 64 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.066160:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.066165:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.066175:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514a37 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9449b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.066183:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514a37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9449b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.066222:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514a37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9449b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.066235:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172393088:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.066320:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.073703:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172393088:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.073726:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.073953:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1982:x1830965175061376:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 9630us (10205us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.073972:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10712 00000100:00100000:0.0:1746144891.074313:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.077209:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175061632 00000100:00100000:3.0:1746144891.077220:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175061632 00002000:00100000:3.0:1746144891.077261:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230e300 x1830965175061632/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.077270:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230e300 with x1830965175061632 ext(0->4095) 00002000:00010000:3.0:1746144891.077275:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230e300 00000100:00100000:3.0:1746144891.077312:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3939 00000100:00100000:3.0:1746144891.077318:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175061632:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144891.077487:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175061632:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 168us (3174us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.077493:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3939 00002000:00100000:3.0:1746144891.077499:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230e300 x1830965175061632/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.077506:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230e300 with x1830965175061632 ext(0->4095) 00002000:00010000:3.0:1746144891.077508:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230e300 00000100:00100000:0.0:1746144891.078074:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.078189:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175061760 00000100:00100000:2.0:1746144891.078193:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175061760 00000100:00100000:2.0:1746144891.078473:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5297 00000100:00100000:2.0:1746144891.078481:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:31565:x1830965175061760:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.078491:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.078503:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af944a2 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.078521:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514a37 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9449b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.078528:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.078529:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.078532:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a2 expref: 64 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.078554:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514a37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9449b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.078564:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514a37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9449b expref: 5 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.078574:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172393216:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144891.080276:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.082461:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.083814:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175061888 00000100:00100000:3.0:1746144891.083822:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175061888 00000100:00100000:3.0:1746144891.083859:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5298 00000100:00100000:3.0:1746144891.083864:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+65:31579:x1830965175061888:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.083879:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.083891:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af944a9 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.083913:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.083917:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a2 expref: 66 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.083922:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.083925:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a45 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a9 expref: 66 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.083955:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a2 expref: 66 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.083974:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a45 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a9 expref: 66 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.083982:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb68000, rc 0) 00000100:00100000:3.0:1746144891.084024:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31579:x1830965175061888:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 160us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.084029:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5298 00000100:00100000:2.0:1746144891.084337:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172393216:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.084356:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a2 expref: 65 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.084368:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:2.0:1746144891.084386:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+65:31565:x1830965175061760:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5908us (6314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.084392:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5297 00000100:00100000:1.0:1746144891.084800:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.084955:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175062016 00000100:00100000:2.0:1746144891.084959:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175062016 00010000:00010000:2.0:1746144891.084985:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514a37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9449b expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.085010:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10713 00000100:00100000:2.0:1746144891.085015:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175062016:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.085022:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.085038:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514a37 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9449b expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.085047:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514a37 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9449b expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.085062:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514a37 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9449b expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.085073:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.085074:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.085079:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a2 expref: 64 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.085090:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a2 expref: 64 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.085108:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a2 expref: 64 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.085116:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a2 expref: 64 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.085127:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172393472:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.085181:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.086669:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172393472:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.086686:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.087211:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175062016:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2191us (2407us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.087220:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10713 00000100:00100000:0.0:1746144891.088213:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.088297:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175062272 00000100:00100000:1.0:1746144891.088304:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175062272 00002000:00100000:1.0:1746144891.088337:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230ca80 x1830965175062272/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.088346:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230ca80 with x1830965175062272 ext(0->4095) 00010000:00010000:1.0:1746144891.088352:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a2 expref: 65 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.088362:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a2 expref: 65 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.088367:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230ca80 00000100:00100000:1.0:1746144891.088444:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1933 00000100:00100000:1.0:1746144891.088519:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1984:x1830965175062272:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144891.088652:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1984:x1830965175062272:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 201us (440us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.088660:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1933 00002000:00100000:1.0:1746144891.088664:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230ca80 x1830965175062272/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.088671:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230ca80 with x1830965175062272 ext(0->4095) 00010000:00010000:1.0:1746144891.088675:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a2 expref: 65 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.088682:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a2 expref: 65 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.088688:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230ca80 00000100:00100000:0.0:1746144891.095822:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.095987:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175062400 00000100:00100000:2.0:1746144891.095995:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175062400 00010000:00010000:2.0:1746144891.096032:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a2 expref: 65 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.096191:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10714 00000100:00100000:2.0:1746144891.096199:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1982:x1830965175062400:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.096211:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.098726:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a2 expref: 65 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.098746:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a2 expref: 65 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.098780:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a2 expref: 65 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.098810:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.098812:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.098819:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a9 expref: 64 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.098826:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a9 expref: 64 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.098862:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a9 expref: 64 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.098873:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172393600:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.099987:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.104131:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172393600:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.104156:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.104319:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1982:x1830965175062400:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 8119us (8501us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.104328:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10714 00000100:00100000:0.0:1746144891.105431:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.105583:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175062656 00000100:00100000:1.0:1746144891.105589:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175062656 00002000:00100000:1.0:1746144891.105622:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230df80 x1830965175062656/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.105631:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230df80 with x1830965175062656 ext(0->4095) 00002000:00010000:1.0:1746144891.105635:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230df80 00000100:00100000:1.0:1746144891.105945:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3940 00000100:00100000:1.0:1746144891.105952:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1984:x1830965175062656:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144891.106102:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1984:x1830965175062656:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 149us (673us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.106108:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3940 00002000:00100000:1.0:1746144891.106113:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230df80 x1830965175062656/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.106124:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230df80 with x1830965175062656 ext(0->4095) 00002000:00010000:1.0:1746144891.106126:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230df80 00000100:00100000:0.0:1746144891.109868:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.109956:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175062784 00000100:00100000:2.0:1746144891.109971:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175062784 00000100:00100000:2.0:1746144891.110017:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5299 00000100:00100000:2.0:1746144891.110023:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175062784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.110038:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.110051:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af944b0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.110074:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a9 expref: 63 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.110081:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.110083:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.110085:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b0 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.110111:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a9 expref: 63 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.110122:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a9 expref: 63 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.110133:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172393728:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144891.112039:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.113492:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172393728:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.113521:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b0 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.113540:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:2.0:1746144891.113571:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175062784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3548us (3711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.113579:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5299 00000100:00100000:0.0:1746144891.115516:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.116093:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175062912 00000100:00100000:2.0:1746144891.116100:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175062912 00010000:00010000:2.0:1746144891.116127:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a9 expref: 64 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.116395:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10715 00000100:00100000:2.0:1746144891.116403:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1985:x1830965175062912:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.116414:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.116431:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a9 expref: 64 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.116441:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a9 expref: 64 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.116460:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944a9 expref: 64 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.116671:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.116673:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.116679:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b0 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.116692:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b0 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.116719:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b0 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.116729:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172393856:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144891.117029:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.117148:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175063040 00000100:00100000:3.0:1746144891.117152:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175063040 00000100:00100000:3.0:1746144891.117178:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5300 00000100:00100000:3.0:1746144891.117184:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+64:31565:x1830965175063040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.117194:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144891.117194:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00010000:00010000:3.0:1746144891.117203:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af944b7 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.117218:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b0 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.117224:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.117225:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.117228:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b7 expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.117246:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b0 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.117255:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b0 expref: 5 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.117263:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172393984:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.117283:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.119587:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172393856:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.119610:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.119642:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1985:x1830965175062912:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3240us (4128us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.119651:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10715 00000100:00100000:3.0:1746144891.119729:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172393984:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.119746:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b7 expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.119758:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb68e00, rc 0) 00000100:00100000:3.0:1746144891.119803:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+64:31565:x1830965175063040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2619us (2773us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.119808:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5300 00000100:00100000:0.0:1746144891.120393:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.121017:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175063296 00000100:00100000:3.0:1746144891.121022:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175063296 00002000:00100000:3.0:1746144891.121050:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230d500 x1830965175063296/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.121058:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230d500 with x1830965175063296 ext(0->4095) 00010000:00010000:3.0:1746144891.121064:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b0 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.121078:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b0 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.121084:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230d500 00000100:00100000:3.0:1746144891.121346:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1934 00000100:00100000:3.0:1746144891.121353:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175063296:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144891.121749:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175063296:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 395us (1355us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.121756:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1934 00002000:00100000:3.0:1746144891.121780:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230d500 x1830965175063296/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.121787:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230d500 with x1830965175063296 ext(0->4095) 00010000:00010000:3.0:1746144891.121791:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b0 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.121799:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b0 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.121804:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230d500 00000100:00100000:0.0:1746144891.124857:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.124954:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175063424 00000100:00100000:2.0:1746144891.124970:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175063424 00010000:00010000:2.0:1746144891.124999:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b0 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.125020:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10716 00000100:00100000:2.0:1746144891.125027:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175063424:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.125037:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.125053:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b0 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.125063:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b0 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.125081:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514a4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b0 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.125534:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.125536:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.125543:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b7 expref: 63 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.125550:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b7 expref: 63 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.125577:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b7 expref: 63 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.125586:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172394112:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.125737:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.128381:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172394112:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.128401:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.128430:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175063424:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3404us (3578us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.128439:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10716 00000100:00100000:0.0:1746144891.129018:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.129222:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175063680 00000100:00100000:3.0:1746144891.129229:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175063680 00002000:00100000:3.0:1746144891.129260:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230f100 x1830965175063680/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.129268:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230f100 with x1830965175063680 ext(0->4095) 00002000:00010000:3.0:1746144891.129272:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230f100 00000100:00100000:3.0:1746144891.129557:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3941 00000100:00100000:3.0:1746144891.129564:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1983:x1830965175063680:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:3.0:1746144891.129691:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1983:x1830965175063680:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 128us (674us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.129697:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3941 00002000:00100000:3.0:1746144891.129702:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230f100 x1830965175063680/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.129710:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230f100 with x1830965175063680 ext(0->4095) 00002000:00010000:3.0:1746144891.129712:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230f100 00000100:00100000:0.0:1746144891.146704:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.146784:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175063808 00000100:00100000:3.0:1746144891.146791:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175063808 00000100:00100000:3.0:1746144891.146827:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5301 00000100:00100000:3.0:1746144891.146834:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175063808:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.146848:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.146862:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af944be expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.146886:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b7 expref: 63 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.146893:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.146895:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.146898:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944be expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.146926:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b7 expref: 63 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.146935:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b7 expref: 63 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.146945:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172394240:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.147027:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.148492:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172394240:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.148513:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944be expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.148525:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb69800, rc 0) 00000100:00100000:3.0:1746144891.148551:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175063808:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1717us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.148557:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5301 00000100:00100000:0.0:1746144891.156948:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144891.157006:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.157083:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175064064 00000100:00100000:1.0:1746144891.157091:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175064064 00002000:00100000:1.0:1746144891.157125:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880093e80a80 x1830965175064064/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.157133:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e80a80 with x1830965175064064 ext(0->7) 00010000:00010000:1.0:1746144891.157140:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b7 expref: 64 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.157150:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b7 expref: 64 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.157156:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e80a80 00000100:00100000:1.0:1746144891.157181:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1935 00000100:00100000:1.0:1746144891.157186:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1985:x1830965175064064:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144891.157451:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1985:x1830965175064064:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 263us (443us total) trans 4294967995 rc 0/0 00000100:00100000:1.0:1746144891.157457:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1935 00002000:00100000:1.0:1746144891.157461:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880093e80a80 x1830965175064064/t4294967995(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/448 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.157467:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e80a80 with x1830965175064064 ext(0->7) 00010000:00010000:1.0:1746144891.157471:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b7 expref: 66 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.157483:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b7 expref: 66 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.157488:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e80a80 00000100:00100000:3.0:1746144891.157909:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175063936 00000100:00100000:3.0:1746144891.157913:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175063936 00000100:00100000:3.0:1746144891.157934:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5302 00000100:00100000:3.0:1746144891.157939:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31565:x1830965175063936:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.157946:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.157957:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a61 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af944c5 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.157983:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.157988:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944be expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.157992:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144891.157994:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a61 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944c5 expref: 67 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.158022:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944be expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.158031:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a61 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944c5 expref: 67 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.158038:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb69a00, rc 0) 00000100:00100000:3.0:1746144891.158377:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+67:31565:x1830965175063936:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 436us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.158383:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5302 00000100:00100000:0.0:1746144891.162083:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.163643:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175064192 00000100:00100000:2.0:1746144891.163653:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175064192 00010000:00010000:2.0:1746144891.163689:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b7 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.163730:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10717 00000100:00100000:2.0:1746144891.163737:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175064192:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.163750:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.163782:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b7 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.163792:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b7 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.163810:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727514a53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944b7 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.163837:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.163839:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.163846:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944be expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.163853:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944be expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.163879:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944be expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.163887:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944be expref: 5 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.163901:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172394496:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.163981:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.166649:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.166735:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172394496:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.166755:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.166814:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175064192:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3077us (4738us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.166823:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10717 00000100:00100000:3.0:1746144891.166907:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175064448 00000100:00100000:3.0:1746144891.166912:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175064448 00002000:00100000:3.0:1746144891.166938:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e80000 x1830965175064448/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.166947:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e80000 with x1830965175064448 ext(0->4095) 00010000:00010000:3.0:1746144891.166953:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944be expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.166972:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944be expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.166981:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e80000 00000100:00100000:3.0:1746144891.167882:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1936 00000100:00100000:3.0:1746144891.167890:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175064448:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144891.168034:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175064448:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 145us (1392us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.168040:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1936 00002000:00100000:3.0:1746144891.168044:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e80000 x1830965175064448/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.168051:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e80000 with x1830965175064448 ext(0->4095) 00010000:00010000:3.0:1746144891.168055:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944be expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.168064:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944be expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.168069:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e80000 00000100:00100000:0.0:1746144891.170880:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.170977:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175064576 00000100:00100000:2.0:1746144891.170983:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175064576 00010000:00010000:2.0:1746144891.171011:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944be expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.171041:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10718 00000100:00100000:2.0:1746144891.171047:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175064576:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.171059:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.171075:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944be expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.171086:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944be expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.171102:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a5a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944be expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.171115:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.171118:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.171123:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944c5 expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.171130:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944c5 expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.171154:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944c5 expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.171163:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172394624:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.171225:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.173624:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.174137:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172394624:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.174158:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.174192:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175064576:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3145us (3317us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.174201:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10718 00000100:00100000:1.0:1746144891.174604:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175064832 00000100:00100000:1.0:1746144891.174610:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175064832 00002000:00100000:1.0:1746144891.174638:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e82a00 x1830965175064832/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.174647:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82a00 with x1830965175064832 ext(0->4095) 00002000:00010000:1.0:1746144891.174651:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e82a00 00000100:00100000:1.0:1746144891.174675:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3942 00000100:00100000:1.0:1746144891.174682:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175064832:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144891.174834:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175064832:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 152us (1215us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.174839:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3942 00002000:00100000:1.0:1746144891.174844:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e82a00 x1830965175064832/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.174851:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82a00 with x1830965175064832 ext(0->4095) 00002000:00010000:1.0:1746144891.174853:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e82a00 00000100:00100000:0.0:1746144891.178589:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.178852:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175064960 00000100:00100000:3.0:1746144891.178859:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175064960 00000100:00100000:3.0:1746144891.178891:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5303 00000100:00100000:3.0:1746144891.178897:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175064960:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.178911:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.178926:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a68 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af944cc expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.178952:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944c5 expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.178959:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.178969:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.178973:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a68 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944cc expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.178997:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944c5 expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.179007:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944c5 expref: 65 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.179016:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172394752:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.179077:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.181117:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.181192:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172394752:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.181211:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a68 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944cc expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.181223:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb69800, rc 0) 00000100:00100000:2.0:1746144891.181304:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175065088 00000100:00100000:2.0:1746144891.181308:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175065088 00010000:00010000:2.0:1746144891.181331:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944c5 expref: 66 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.181358:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10719 00000100:00100000:2.0:1746144891.181363:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1985:x1830965175065088:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.181373:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.181388:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944c5 expref: 66 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.181402:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944c5 expref: 66 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.181418:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944c5 expref: 66 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.181446:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175064960:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2548us (2863us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.181452:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5303 00010000:00010000:2.0:1746144891.182186:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.182189:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.182196:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944cc expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.182202:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944cc expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.182226:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944cc expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.182235:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172394880:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.182289:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.184188:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.184559:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172394880:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.184578:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.184665:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175065344 00000100:00100000:3.0:1746144891.184672:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175065344 00002000:00100000:3.0:1746144891.184706:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e82300 x1830965175065344/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.184714:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82300 with x1830965175065344 ext(0->4095) 00002000:00010000:3.0:1746144891.184718:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e82300 00000100:00100000:3.0:1746144891.184746:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3943 00000100:00100000:3.0:1746144891.184752:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175065344:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144891.185017:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1985:x1830965175065088:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3653us (3903us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.185026:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10719 00000100:00100000:3.0:1746144891.186148:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175065344:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 1394us (1961us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.186155:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3943 00002000:00100000:3.0:1746144891.186161:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e82300 x1830965175065344/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.186168:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82300 with x1830965175065344 ext(0->4095) 00002000:00010000:3.0:1746144891.186171:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e82300 00000100:00100000:0.0:1746144891.187746:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.187836:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175065472 00000100:00100000:3.0:1746144891.187843:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175065472 00000100:00100000:3.0:1746144891.187869:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5304 00000100:00100000:3.0:1746144891.187874:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+65:31565:x1830965175065472:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.187886:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.187900:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af944d3 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.187923:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a68 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944cc expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.187933:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.187934:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.187937:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944d3 expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.187959:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944cc expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.187980:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944cc expref: 5 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.187990:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172395008:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.188046:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.191796:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.191988:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175065600 00000100:00100000:2.0:1746144891.191995:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175065600 00000100:00100000:2.0:1746144891.192040:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5305 00000100:00100000:2.0:1746144891.192047:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+67:31579:x1830965175065600:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.192062:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.192076:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a76 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af944da expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.192096:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.192101:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944d3 expref: 68 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.192106:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.192109:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a76 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944da expref: 68 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.192137:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944d3 expref: 68 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.192148:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a76 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944da expref: 68 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.192157:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:2.0:1746144891.192186:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+68:31579:x1830965175065600:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 141us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.192192:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5305 00000100:00100000:2.0:1746144891.194231:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172395008:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.194254:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944d3 expref: 67 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.194272:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb68800, rc 0) 00000100:00100000:2.0:1746144891.194315:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+67:31565:x1830965175065472:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6440us (6573us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.194322:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5304 00000100:00100000:0.0:1746144891.194684:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.194906:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175065728 00000100:00100000:3.0:1746144891.194911:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175065728 00010000:00010000:3.0:1746144891.194930:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944cc expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.194946:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10720 00000100:00100000:3.0:1746144891.194951:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175065728:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.194960:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.194984:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a68 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944cc expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.194993:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a68 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944cc expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.195013:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69800/0x4076af6727514a68 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944cc expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.195036:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.195038:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.195043:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944d3 expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.195051:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944d3 expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.195071:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944d3 expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.195080:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944d3 expref: 66 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.195091:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172395264:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.195136:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.198138:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.198313:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175065984 00000100:00100000:2.0:1746144891.198319:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175065984 00002000:00100000:2.0:1746144891.198359:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e83800 x1830965175065984/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.198367:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83800 with x1830965175065984 ext(0->4095) 00010000:00010000:2.0:1746144891.198373:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944d3 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.198383:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944d3 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.198388:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e83800 00000100:00100000:2.0:1746144891.198403:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1937 00000100:00100000:2.0:1746144891.198408:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1985:x1830965175065984:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144891.198542:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1985:x1830965175065984:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 133us (409us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.198547:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1937 00002000:00100000:2.0:1746144891.198552:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e83800 x1830965175065984/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.198562:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83800 with x1830965175065984 ext(0->4095) 00010000:00010000:2.0:1746144891.198566:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944d3 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.198574:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944d3 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.198579:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e83800 00000100:00100000:3.0:1746144891.199070:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172395264:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.199084:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.199868:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175065728:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4914us (5182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.199875:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10720 00000100:00100000:0.0:1746144891.202077:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.202147:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175066112 00000100:00100000:3.0:1746144891.202152:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175066112 00010000:00010000:3.0:1746144891.202174:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944d3 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.202364:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10721 00000100:00100000:3.0:1746144891.202372:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175066112:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.202382:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.202399:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944d3 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.202410:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944d3 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.202428:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514a6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944d3 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.202712:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.202714:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.202722:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944da expref: 66 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.202728:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944da expref: 66 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.202758:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944da expref: 66 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.202793:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172395392:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.202867:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.206596:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.206678:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175066368 00000100:00100000:1.0:1746144891.206685:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175066368 00002000:00100000:1.0:1746144891.206720:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e81500 x1830965175066368/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.206735:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e81500 with x1830965175066368 ext(0->4095) 00002000:00010000:1.0:1746144891.206739:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e81500 00000100:00100000:3.0:1746144891.206822:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172395392:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.206838:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.206870:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175066112:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4499us (4797us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.206878:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10721 00000100:00100000:1.0:1746144891.207197:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3944 00000100:00100000:1.0:1746144891.207204:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175066368:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144891.207339:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175066368:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 135us (749us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.207345:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3944 00002000:00100000:1.0:1746144891.207349:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e81500 x1830965175066368/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.207355:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e81500 with x1830965175066368 ext(0->4095) 00002000:00010000:1.0:1746144891.207357:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e81500 00000100:00100000:0.0:1746144891.210067:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.210169:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175066496 00000100:00100000:2.0:1746144891.210177:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175066496 00000100:00100000:2.0:1746144891.210222:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5306 00000100:00100000:2.0:1746144891.210230:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175066496:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.210243:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.210258:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514a7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af944e1 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.210282:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944da expref: 65 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.210289:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.210290:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.210293:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514a7d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e1 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.210317:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944da expref: 65 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.210330:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944da expref: 65 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.210339:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172395520:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144891.210401:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.211986:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172395520:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.212009:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514a7d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e1 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.212021:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d200, rc 0) 00000100:00100000:2.0:1746144891.212046:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175066496:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1817us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.212051:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5306 00000100:00100000:0.0:1746144891.213399:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.213583:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175066624 00000100:00100000:3.0:1746144891.213590:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175066624 00010000:00010000:3.0:1746144891.213614:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944da expref: 66 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.213642:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10722 00000100:00100000:3.0:1746144891.213648:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175066624:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.213659:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.213676:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944da expref: 66 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.213684:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944da expref: 66 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.213701:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514a76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944da expref: 66 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.213725:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.213726:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.213731:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514a7d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e1 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.213742:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514a7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e1 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.213786:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514a7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e1 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.213797:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172395648:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.213856:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.218247:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144891.218282:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.218424:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175066880 00000100:00100000:2.0:1746144891.218431:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175066880 00002000:00100000:2.0:1746144891.218470:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e83480 x1830965175066880/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.218480:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83480 with x1830965175066880 ext(0->4095) 00002000:00010000:2.0:1746144891.218485:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e83480 00000100:00100000:2.0:1746144891.218512:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3945 00000100:00100000:2.0:1746144891.218520:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175066880:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144891.218658:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175066880:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 139us (418us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.218667:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3945 00002000:00100000:2.0:1746144891.218673:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e83480 x1830965175066880/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.218679:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83480 with x1830965175066880 ext(0->4095) 00002000:00010000:2.0:1746144891.218682:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e83480 00000100:00100000:3.0:1746144891.218735:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175067008 00000100:00100000:3.0:1746144891.218739:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175067008 00000100:00100000:3.0:1746144891.218760:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5307 00000100:00100000:3.0:1746144891.218779:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31565:x1830965175067008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.218787:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.218799:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af944e8 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.218821:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514a7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e1 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.218827:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.218828:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.218831:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e8 expref: 67 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.218853:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514a7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e1 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.218867:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514a7d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e1 expref: 5 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.218876:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172395776:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.218922:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65180 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.218948:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172395648:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.218960:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.218989:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175066624:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5341us (5593us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.218997:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10722 00000100:00100000:0.0:1746144891.222181:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.222949:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172395776:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.222981:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e8 expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.222995:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb68000, rc 0) 00000100:00100000:3.0:1746144891.223560:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31565:x1830965175067008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4779us (5276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.223568:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5307 00000100:00100000:3.0:1746144891.223893:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175067136 00000100:00100000:3.0:1746144891.223899:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175067136 00000100:00100000:3.0:1746144891.223925:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5308 00000100:00100000:3.0:1746144891.223930:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31579:x1830965175067136:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.223944:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.223955:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a8b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af944ef expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.223986:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.223989:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e8 expref: 67 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.223995:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.223997:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a8b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944ef expref: 67 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.224024:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e8 expref: 67 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.224032:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a8b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944ef expref: 67 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.224040:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb69a00, rc 0) 00000100:00100000:3.0:1746144891.224067:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+67:31579:x1830965175067136:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 136us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.224071:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5308 00000100:00100000:1.0:1746144891.225142:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.225892:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175067264 00000100:00100000:3.0:1746144891.225898:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175067264 00010000:00010000:3.0:1746144891.225923:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514a7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e1 expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.226234:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10723 00000100:00100000:3.0:1746144891.226242:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175067264:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.226255:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.226272:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514a7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e1 expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.226281:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514a7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e1 expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.226297:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514a7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e1 expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.226321:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.226322:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.226329:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e8 expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.226335:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e8 expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.226362:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e8 expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.226371:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e8 expref: 66 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.226381:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172396032:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.227498:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.230935:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.231016:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172396032:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.231034:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.231078:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175067264:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4837us (5938us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.231087:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10723 00000100:00100000:1.0:1746144891.231364:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175067520 00000100:00100000:1.0:1746144891.231370:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175067520 00002000:00100000:1.0:1746144891.231401:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167e300 x1830965175067520/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.231410:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167e300 with x1830965175067520 ext(0->4095) 00010000:00010000:1.0:1746144891.231417:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e8 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.231427:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e8 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.231432:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009167e300 00000100:00100000:1.0:1746144891.231460:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1938 00000100:00100000:1.0:1746144891.231466:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175067520:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144891.231605:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175067520:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 138us (676us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.231610:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1938 00002000:00100000:1.0:1746144891.231614:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167e300 x1830965175067520/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.231620:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167e300 with x1830965175067520 ext(0->4095) 00010000:00010000:1.0:1746144891.231624:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e8 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.231632:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e8 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.231637:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009167e300 00000100:00100000:0.0:1746144891.234157:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.234292:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175067648 00000100:00100000:3.0:1746144891.234299:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175067648 00010000:00010000:3.0:1746144891.234322:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e8 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.234351:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10724 00000100:00100000:3.0:1746144891.234357:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175067648:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.234368:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.234384:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e8 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.234394:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e8 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.234411:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af6727514a84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944e8 expref: 67 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.234481:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.234483:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.234489:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944ef expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.234496:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944ef expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.234523:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944ef expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.234534:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172396160:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.234986:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.238544:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.238632:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172396160:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.238647:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.238681:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175067648:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4323us (4529us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.238689:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10724 00000100:00100000:2.0:1746144891.238751:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175067904 00000100:00100000:2.0:1746144891.238756:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175067904 00002000:00100000:2.0:1746144891.238807:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167c380 x1830965175067904/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.238815:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167c380 with x1830965175067904 ext(0->4095) 00002000:00010000:2.0:1746144891.238818:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167c380 00000100:00100000:2.0:1746144891.239054:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3946 00000100:00100000:2.0:1746144891.239061:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175067904:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144891.239197:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175067904:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 137us (658us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.239203:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3946 00002000:00100000:2.0:1746144891.239208:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167c380 x1830965175067904/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.239215:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167c380 with x1830965175067904 ext(0->4095) 00002000:00010000:2.0:1746144891.239218:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167c380 00000100:00100000:0.0:1746144891.241197:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.241658:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175068032 00000100:00100000:2.0:1746144891.241665:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175068032 00000100:00100000:2.0:1746144891.241727:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5309 00000100:00100000:2.0:1746144891.241735:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175068032:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.241748:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.241784:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af944f6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.241805:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944ef expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.241812:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.241813:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.241816:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944f6 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.241840:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944ef expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.241850:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944ef expref: 65 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.241860:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172396288:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144891.242517:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.246724:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.246828:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175068160 00000100:00100000:3.0:1746144891.246836:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175068160 00010000:00010000:3.0:1746144891.246865:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a8b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944ef expref: 66 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.246888:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10725 00000100:00100000:3.0:1746144891.246894:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175068160:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.246906:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.246922:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a8b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944ef expref: 66 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.246932:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944ef expref: 66 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.246952:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.246954:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.246975:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944f6 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.246984:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944f6 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.247011:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944f6 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.247022:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172396416:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.247560:0:8432:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69a00/0x4076af6727514a8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944ef expref: 66 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.248537:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65180 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.248822:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172396288:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.248847:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944f6 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.248861:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:2.0:1746144891.248890:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175068032:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7156us (7698us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.248897:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5309 00000100:00100000:1.0:1746144891.250027:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.250324:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175068288 00000100:00100000:2.0:1746144891.250330:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175068288 00000100:00100000:2.0:1746144891.250361:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5310 00000100:00100000:2.0:1746144891.250367:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31565:x1830965175068288:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.250379:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.250389:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af944fd expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.250408:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944f6 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.250414:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.250415:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.250418:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944fd expref: 67 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.250437:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944f6 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.250446:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944f6 expref: 5 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.250461:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172396544:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144891.250515:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.252434:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.252560:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172396416:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.252575:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144891.252693:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175068544 00000100:00100000:1.0:1746144891.252698:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175068544 00002000:00100000:1.0:1746144891.252729:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167df80 x1830965175068544/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.252737:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167df80 with x1830965175068544 ext(0->4095) 00010000:00010000:1.0:1746144891.252744:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944f6 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.252754:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944f6 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.252779:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009167df80 00000100:00100000:3.0:1746144891.252854:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175068160:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5958us (6136us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.252862:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10725 00000100:00100000:1.0:1746144891.252923:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1939 00000100:00100000:1.0:1746144891.252930:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175068544:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144891.253647:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172396544:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.253666:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944fd expref: 66 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.253677:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:2.0:1746144891.253697:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31565:x1830965175068288:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3330us (3672us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.253703:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5310 00000100:00100000:1.0:1746144891.254137:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175068544:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1200us (1698us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.254142:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1939 00002000:00100000:1.0:1746144891.254148:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167df80 x1830965175068544/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.254155:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167df80 with x1830965175068544 ext(0->4095) 00010000:00010000:1.0:1746144891.254160:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944f6 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.254169:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944f6 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.254174:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009167df80 00000100:00100000:0.0:1746144891.258029:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.258118:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175068672 00000100:00100000:3.0:1746144891.258126:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175068672 00010000:00010000:3.0:1746144891.258153:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944f6 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.258173:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10726 00000100:00100000:3.0:1746144891.258179:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175068672:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.258192:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.258208:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944f6 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.258221:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944f6 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.258238:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514a92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944f6 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.258264:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.258266:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.258272:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944fd expref: 65 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.258277:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944fd expref: 65 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.258304:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944fd expref: 65 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.258313:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172396672:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.259223:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.262481:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.262559:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172396672:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.262575:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.262612:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175068672:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4433us (4592us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.262621:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10726 00000100:00100000:1.0:1746144891.263292:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175068928 00000100:00100000:1.0:1746144891.263299:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175068928 00002000:00100000:1.0:1746144891.263331:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167ca80 x1830965175068928/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.263341:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167ca80 with x1830965175068928 ext(0->4095) 00002000:00010000:1.0:1746144891.263345:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167ca80 00000100:00100000:1.0:1746144891.263684:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3947 00000100:00100000:1.0:1746144891.263691:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1985:x1830965175068928:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144891.263862:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1985:x1830965175068928:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 171us (1387us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.263867:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3947 00002000:00100000:1.0:1746144891.263872:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167ca80 x1830965175068928/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.263878:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167ca80 with x1830965175068928 ext(0->4095) 00002000:00010000:1.0:1746144891.263880:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167ca80 00000100:00100000:0.0:1746144891.282432:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.282534:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175069056 00000100:00100000:2.0:1746144891.282543:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175069056 00000100:00100000:2.0:1746144891.282579:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5311 00000100:00100000:2.0:1746144891.282586:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175069056:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.282601:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.282615:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94504 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.282639:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944fd expref: 65 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.282645:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.282648:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.282650:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94504 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.282678:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944fd expref: 65 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.282689:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944fd expref: 65 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.282699:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172396800:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144891.283796:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.299634:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172396800:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.299668:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94504 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.299684:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:2.0:1746144891.299732:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175069056:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 17145us (17305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.299739:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5311 00000100:00100000:1.0:1746144891.306632:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.306717:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.306794:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175069184 00000100:00100000:3.0:1746144891.306802:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175069184 00000100:00100000:3.0:1746144891.306834:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5312 00000100:00100000:3.0:1746144891.306840:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31565:x1830965175069184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.306855:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.306867:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9450b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.306887:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.306892:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94504 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.306897:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144891.306900:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9450b expref: 67 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.306926:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94504 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.306936:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9450b expref: 67 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.306943:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb68a00, rc 0) 00000100:00100000:3.0:1746144891.306984:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+67:31565:x1830965175069184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 145us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.306989:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5312 00000100:00100000:3.0:1746144891.307011:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175069312 00000100:00100000:3.0:1746144891.307013:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175069312 00002000:00100000:3.0:1746144891.307029:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800932a9880 x1830965175069312/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.307042:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a9880 with x1830965175069312 ext(0->7) 00010000:00010000:3.0:1746144891.307046:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944fd expref: 67 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.307055:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944fd expref: 67 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.307060:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932a9880 00000100:00100000:3.0:1746144891.307069:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1940 00000100:00100000:3.0:1746144891.307073:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175069312:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144891.307303:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+69:1984:x1830965175069312:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 228us (585us total) trans 4294967996 rc 0/0 00000100:00100000:3.0:1746144891.307308:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1940 00002000:00100000:3.0:1746144891.307313:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800932a9880 x1830965175069312/t4294967996(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/448 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.307319:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a9880 with x1830965175069312 ext(0->7) 00010000:00010000:3.0:1746144891.307323:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944fd expref: 69 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.307331:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944fd expref: 69 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.307335:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932a9880 00000100:00100000:0.0:1746144891.308997:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.309486:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175069440 00000100:00100000:3.0:1746144891.309492:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175069440 00010000:00010000:3.0:1746144891.309516:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944fd expref: 69 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.309544:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10727 00000100:00100000:3.0:1746144891.309552:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+69:1983:x1830965175069440:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.309562:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.309577:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944fd expref: 69 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.309590:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944fd expref: 69 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.309607:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514a99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af944fd expref: 69 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.309633:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.309635:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.309640:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94504 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.309646:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94504 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.309672:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94504 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.309681:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94504 expref: 5 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.309696:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172397056:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.310255:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65180 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.313466:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172397056:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.313487:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.313531:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+68:1983:x1830965175069440:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3978us (4537us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.313539:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10727 00000100:00100000:0.0:1746144891.314619:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.314793:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175069696 00000100:00100000:3.0:1746144891.314799:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175069696 00002000:00100000:3.0:1746144891.314829:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167f100 x1830965175069696/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.314837:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167f100 with x1830965175069696 ext(0->4095) 00010000:00010000:3.0:1746144891.314843:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94504 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.314854:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94504 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.314860:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009167f100 00000100:00100000:3.0:1746144891.314880:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1941 00000100:00100000:3.0:1746144891.314886:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175069696:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144891.315228:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175069696:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 342us (610us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.315238:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1941 00002000:00100000:3.0:1746144891.315242:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167f100 x1830965175069696/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.315249:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167f100 with x1830965175069696 ext(0->4095) 00010000:00010000:3.0:1746144891.315254:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94504 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.315261:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94504 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.315267:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009167f100 00000100:00100000:0.0:1746144891.317487:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.317954:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175069824 00000100:00100000:3.0:1746144891.317970:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175069824 00010000:00010000:3.0:1746144891.318000:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94504 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.318032:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10728 00000100:00100000:3.0:1746144891.318038:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175069824:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.318049:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.318064:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94504 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.318072:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94504 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.318089:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514aa0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94504 expref: 6 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.318111:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.318113:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.318118:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9450b expref: 67 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.318125:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9450b expref: 67 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.318152:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9450b expref: 67 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.318162:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172397184:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.318275:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.322438:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.322638:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172397184:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.322653:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.322687:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175069824:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4649us (5207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.322696:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10728 00000100:00100000:2.0:1746144891.322780:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175070080 00000100:00100000:2.0:1746144891.322786:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175070080 00002000:00100000:2.0:1746144891.322819:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167f480 x1830965175070080/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.322828:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167f480 with x1830965175070080 ext(0->4095) 00002000:00010000:2.0:1746144891.322832:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167f480 00000100:00100000:2.0:1746144891.323102:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3948 00000100:00100000:2.0:1746144891.323110:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+68:1985:x1830965175070080:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144891.324153:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+68:1985:x1830965175070080:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1043us (1720us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.324160:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3948 00002000:00100000:2.0:1746144891.324165:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167f480 x1830965175070080/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.324172:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167f480 with x1830965175070080 ext(0->4095) 00002000:00010000:2.0:1746144891.324176:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167f480 00000100:00100000:0.0:1746144891.328808:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.328906:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175070208 00000100:00100000:2.0:1746144891.328913:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175070208 00000100:00100000:2.0:1746144891.328959:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5313 00000100:00100000:2.0:1746144891.328976:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175070208:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.328990:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.329002:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514aae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94512 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.329025:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9450b expref: 67 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.329031:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.329032:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.329035:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514aae lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94512 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.329057:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9450b expref: 67 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.329070:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9450b expref: 67 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.329079:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172397312:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144891.329312:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.332587:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172397312:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.332619:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514aae lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94512 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.332634:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:2.0:1746144891.332678:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175070208:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3702us (3915us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.332687:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5313 00000100:00100000:0.0:1746144891.334128:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.334217:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175070336 00000100:00100000:1.0:1746144891.334224:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175070336 00002000:00100000:1.0:1746144891.334256:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880135ea4e00 x1830965175070336/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.334266:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4e00 with x1830965175070336 ext(0->7) 00010000:00010000:1.0:1746144891.334273:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9450b expref: 68 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.334285:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9450b expref: 68 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.334292:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea4e00 00000100:00100000:1.0:1746144891.334317:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1942 00000100:00100000:1.0:1746144891.334322:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+68:1985:x1830965175070336:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144891.334565:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1985:x1830965175070336:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 241us (441us total) trans 4294967997 rc 0/0 00000100:00100000:1.0:1746144891.334571:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1942 00002000:00100000:1.0:1746144891.334576:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880135ea4e00 x1830965175070336/t4294967997(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/448 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.334582:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4e00 with x1830965175070336 ext(0->7) 00010000:00010000:1.0:1746144891.334586:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9450b expref: 70 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.334594:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9450b expref: 70 pid: 8432 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.334599:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea4e00 00000100:00100000:0.0:1746144891.340095:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.340199:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175070464 00000100:00100000:3.0:1746144891.340208:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175070464 00010000:00010000:3.0:1746144891.340519:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9450b expref: 70 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.340549:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10729 00000100:00100000:3.0:1746144891.340555:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1984:x1830965175070464:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.340568:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.340583:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9450b expref: 70 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.340592:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9450b expref: 70 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.340608:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68a00/0x4076af6727514aa7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9450b expref: 70 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.341190:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.341193:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.341199:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514aae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94512 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.341206:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514aae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94512 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.341233:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514aae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94512 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.341243:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172397440:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.341316:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.345464:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172397440:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.345482:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.345913:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+69:1984:x1830965175070464:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5355us (5824us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.345924:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10729 00000100:00100000:0.0:1746144891.347024:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.347085:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175070720 00000100:00100000:1.0:1746144891.347091:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175070720 00002000:00100000:1.0:1746144891.347126:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea6300 x1830965175070720/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.347134:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea6300 with x1830965175070720 ext(0->4095) 00002000:00010000:1.0:1746144891.347138:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea6300 00000100:00100000:1.0:1746144891.347193:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3949 00000100:00100000:1.0:1746144891.347200:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175070720:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144891.347331:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175070720:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 131us (309us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.347337:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3949 00002000:00100000:1.0:1746144891.347342:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea6300 x1830965175070720/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.347353:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea6300 with x1830965175070720 ext(0->4095) 00002000:00010000:1.0:1746144891.347356:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea6300 00000100:00100000:0.0:1746144891.353340:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.354950:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175070848 00000100:00100000:2.0:1746144891.354968:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175070848 00000100:00100000:2.0:1746144891.355015:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5314 00000100:00100000:2.0:1746144891.355022:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+69:31565:x1830965175070848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.355038:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.355051:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94519 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.355074:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514aae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94512 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.355085:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.355086:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.355089:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94519 expref: 70 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.355113:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514aae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94512 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.355123:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514aae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94512 expref: 5 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.355133:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172397568:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144891.355202:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.355283:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.355489:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175070976 00000100:00100000:3.0:1746144891.355493:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175070976 00000100:00100000:3.0:1746144891.355510:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5315 00000100:00100000:3.0:1746144891.355514:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009969a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+71:31579:x1830965175070976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.355520:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.355525:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514abc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94520 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.355537:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.355540:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94519 expref: 72 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.355545:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.355547:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514abc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94520 expref: 72 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.355564:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94519 expref: 72 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.355572:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514abc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94520 expref: 72 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.355579:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb68600, rc 0) 00000100:00100000:3.0:1746144891.355597:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009969a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+72:31579:x1830965175070976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 82us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.355602:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5315 00000100:00100000:3.0:1746144891.358353:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172397568:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.358381:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94519 expref: 71 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.358394:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:3.0:1746144891.358435:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+71:31565:x1830965175070848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3413us (5101us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.358442:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5314 00000100:00100000:0.0:1746144891.358814:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.358893:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175071104 00000100:00100000:3.0:1746144891.358898:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175071104 00010000:00010000:3.0:1746144891.358918:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514aae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94512 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.358987:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10730 00000100:00100000:3.0:1746144891.358994:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175071104:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.359004:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.359019:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514aae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94512 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.359029:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514aae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94512 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.359046:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514aae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94512 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.359095:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.359097:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.359103:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94519 expref: 70 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.359110:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94519 expref: 70 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.359135:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94519 expref: 70 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.359145:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94519 expref: 70 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.359155:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172397824:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.359202:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.363201:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.363336:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172397824:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.363353:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.363387:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175071104:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4393us (4573us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.363396:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10730 00000100:00100000:2.0:1746144891.363552:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175071360 00000100:00100000:2.0:1746144891.363557:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175071360 00002000:00100000:2.0:1746144891.363589:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea5f80 x1830965175071360/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.363597:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5f80 with x1830965175071360 ext(0->4095) 00010000:00010000:2.0:1746144891.363603:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94519 expref: 71 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.363614:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94519 expref: 71 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.363619:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea5f80 00000100:00100000:2.0:1746144891.363641:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1943 00000100:00100000:2.0:1746144891.363647:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+71:1985:x1830965175071360:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144891.363759:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+71:1985:x1830965175071360:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 112us (565us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.363785:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1943 00002000:00100000:2.0:1746144891.363790:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea5f80 x1830965175071360/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.363796:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5f80 with x1830965175071360 ext(0->4095) 00010000:00010000:2.0:1746144891.363800:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94519 expref: 71 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.363808:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94519 expref: 71 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.363812:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea5f80 00000100:00100000:0.0:1746144891.369400:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.369487:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175071488 00000100:00100000:3.0:1746144891.369494:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175071488 00010000:00010000:3.0:1746144891.369521:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94519 expref: 71 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.369543:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10731 00000100:00100000:3.0:1746144891.369549:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+71:1985:x1830965175071488:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.369559:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.369576:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94519 expref: 71 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.369585:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94519 expref: 71 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.369603:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ab5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94519 expref: 71 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.369628:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.369630:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.369635:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514abc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94520 expref: 70 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.369642:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514abc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94520 expref: 70 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.369665:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514abc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94520 expref: 70 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.369675:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172397952:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.370684:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.374646:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172397952:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.374665:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.374703:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1985:x1830965175071488:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5153us (5309us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.374712:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10731 00000100:00100000:0.0:1746144891.376233:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.376313:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175071744 00000100:00100000:1.0:1746144891.376321:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175071744 00002000:00100000:1.0:1746144891.376355:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea6d80 x1830965175071744/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.376364:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea6d80 with x1830965175071744 ext(0->4095) 00002000:00010000:1.0:1746144891.376368:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea6d80 00000100:00100000:1.0:1746144891.376396:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3950 00000100:00100000:1.0:1746144891.376403:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1982:x1830965175071744:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144891.376540:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1982:x1830965175071744:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 136us (310us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.376546:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3950 00002000:00100000:1.0:1746144891.376550:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea6d80 x1830965175071744/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.376557:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea6d80 with x1830965175071744 ext(0->4095) 00002000:00010000:1.0:1746144891.376559:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea6d80 00000100:00100000:0.0:1746144891.380834:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.381469:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175071872 00000100:00100000:3.0:1746144891.381477:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175071872 00000100:00100000:3.0:1746144891.381522:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5316 00000100:00100000:3.0:1746144891.381528:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175071872:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.381543:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.381557:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94527 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.381579:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514abc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94520 expref: 69 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.381586:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.381587:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.381590:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94527 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.381612:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514abc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94520 expref: 69 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.381620:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514abc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94520 expref: 69 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.381629:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172398080:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.382231:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.386434:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172398080:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.386460:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94527 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.386477:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb69c00, rc 0) 00000100:00100000:3.0:1746144891.386519:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175071872:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4991us (5691us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.386526:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5316 00000100:00100000:0.0:1746144891.386698:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.386866:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175072000 00000100:00100000:3.0:1746144891.386871:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175072000 00010000:00010000:3.0:1746144891.386893:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514abc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94520 expref: 70 pid: 8432 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.386913:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10732 00000100:00100000:3.0:1746144891.386919:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1985:x1830965175072000:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.386931:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.386948:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514abc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94520 expref: 70 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.386956:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514abc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94520 expref: 70 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.386983:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68600/0x4076af6727514abc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94520 expref: 70 pid: 8432 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.387006:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.387008:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.387014:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94527 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.387025:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94527 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.387049:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94527 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.387059:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172398208:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.387108:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.387229:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.388011:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175072128 00000100:00100000:3.0:1746144891.388015:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175072128 00000100:00100000:3.0:1746144891.388047:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5317 00000100:00100000:3.0:1746144891.388052:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+70:31565:x1830965175072128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.388064:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.388074:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9452e expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.388089:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94527 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.388094:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.388096:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.388098:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9452e expref: 71 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.388113:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94527 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.388126:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94527 expref: 5 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.388133:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172398336:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.389136:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.390280:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172398336:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.390305:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9452e expref: 71 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144891.390308:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172398208:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144891.390319:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144891.390320:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb68800, rc 0) 00000100:00100000:0.0:1746144891.390590:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+71:1985:x1830965175072000:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3670us (3890us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144891.390599:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10732 00000100:00100000:2.0:1746144891.390730:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+70:31565:x1830965175072128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2675us (3499us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.390736:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5317 00000100:00100000:1.0:1746144891.390893:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.390909:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175072384 00000100:00100000:2.0:1746144891.390914:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175072384 00002000:00100000:2.0:1746144891.390942:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932a9f80 x1830965175072384/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.390951:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a9f80 with x1830965175072384 ext(0->4095) 00010000:00010000:2.0:1746144891.390957:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94527 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.390975:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94527 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.390980:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932a9f80 00000100:00100000:2.0:1746144891.390994:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1944 00000100:00100000:2.0:1746144891.391000:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175072384:12345-192.168.202.16@tcp:3:ldlm_bl.0 00000100:00100000:2.0:1746144891.391136:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175072384:12345-192.168.202.16@tcp:3:ldlm_bl.0 Request processed in 136us (242us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.391141:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1944 00002000:00100000:2.0:1746144891.391146:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932a9f80 x1830965175072384/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.391153:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a9f80 with x1830965175072384 ext(0->4095) 00010000:00010000:2.0:1746144891.391157:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94527 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.391166:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94527 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.391171:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932a9f80 00000100:00100000:0.0:1746144891.395885:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.395968:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175072512 00000100:00100000:2.0:1746144891.395977:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175072512 00010000:00010000:2.0:1746144891.396010:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94527 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.396041:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10733 00000100:00100000:2.0:1746144891.396048:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175072512:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.396059:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.396076:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94527 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.396086:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94527 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.396105:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69c00/0x4076af6727514ac3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94527 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.396132:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.396134:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.396140:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9452e expref: 69 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.396147:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9452e expref: 69 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.396176:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9452e expref: 69 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.396186:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172398464:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.396251:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.400097:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.400162:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175072768 00000100:00100000:1.0:1746144891.400170:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175072768 00002000:00100000:1.0:1746144891.400206:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea7100 x1830965175072768/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.400215:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea7100 with x1830965175072768 ext(0->4095) 00002000:00010000:1.0:1746144891.400220:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea7100 00000100:00100000:1.0:1746144891.400250:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3951 00000100:00100000:1.0:1746144891.400256:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1984:x1830965175072768:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144891.400398:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1984:x1830965175072768:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 142us (309us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.400404:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3951 00002000:00100000:1.0:1746144891.400415:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea7100 x1830965175072768/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.400421:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea7100 with x1830965175072768 ext(0->4095) 00002000:00010000:1.0:1746144891.400423:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea7100 00000100:00100000:2.0:1746144891.400742:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172398464:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.400782:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.400807:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175072512:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4760us (4930us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.400816:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10733 00000100:00100000:0.0:1746144891.405650:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.405751:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175072896 00000100:00100000:2.0:1746144891.405759:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175072896 00000100:00100000:2.0:1746144891.405831:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5318 00000100:00100000:2.0:1746144891.405838:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175072896:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.405854:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.405868:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94535 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.405894:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9452e expref: 69 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.405901:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.405902:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.405905:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94535 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.405929:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9452e expref: 69 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.405939:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9452e expref: 69 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.405953:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172398592:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144891.407456:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.408163:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172398592:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.408190:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94535 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.408204:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:2.0:1746144891.408250:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175072896:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2412us (2606us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.408257:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5318 00000100:00100000:0.0:1746144891.408468:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.414806:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175073024 00000100:00100000:3.0:1746144891.414819:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175073024 00002000:00100000:3.0:1746144891.414864:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880092587100 x1830965175073024/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.414874:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092587100 with x1830965175073024 ext(0->7) 00010000:00010000:3.0:1746144891.414882:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9452e expref: 70 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.414895:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9452e expref: 70 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.414901:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092587100 00000100:00100000:3.0:1746144891.414933:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1945 00000100:00100000:3.0:1746144891.414940:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1985:x1830965175073024:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144891.415235:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1985:x1830965175073024:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 294us (6766us total) trans 4294967998 rc 0/0 00000100:00100000:3.0:1746144891.415241:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1945 00002000:00100000:3.0:1746144891.415246:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880092587100 x1830965175073024/t4294967998(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/448 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.415257:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092587100 with x1830965175073024 ext(0->7) 00010000:00010000:3.0:1746144891.415261:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9452e expref: 72 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.415270:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9452e expref: 72 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.415275:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092587100 00000100:00100000:0.0:1746144891.422824:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.423055:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175073152 00000100:00100000:2.0:1746144891.423063:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175073152 00010000:00010000:2.0:1746144891.423099:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9452e expref: 72 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.423172:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10734 00000100:00100000:2.0:1746144891.423181:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1983:x1830965175073152:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.423193:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.423211:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9452e expref: 72 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.423221:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9452e expref: 72 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.423243:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68800/0x4076af6727514aca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9452e expref: 72 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.424025:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.424028:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.424036:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94535 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.424044:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94535 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.424076:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94535 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.424087:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172398720:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.427677:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a5448480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.435760:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.436181:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175073280 00000100:00100000:2.0:1746144891.436189:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175073280 00000100:00100000:2.0:1746144891.436229:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5319 00000100:00100000:2.0:1746144891.436236:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+72:31565:x1830965175073280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.436252:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.436265:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9453c expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.436290:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94535 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.436301:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.436302:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.436305:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9453c expref: 73 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.436330:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94535 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.436340:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94535 expref: 5 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.436350:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172398848:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144891.436640:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4380900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.436894:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172398720:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.436910:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.436933:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+73:1983:x1830965175073152:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 13754us (14116us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.436941:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10734 00000100:00100000:0.0:1746144891.441279:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.441935:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175073536 00000100:00100000:1.0:1746144891.441943:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175073536 00002000:00100000:1.0:1746144891.441991:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092587800 x1830965175073536/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.442000:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092587800 with x1830965175073536 ext(0->4095) 00010000:00010000:1.0:1746144891.442007:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94535 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.442019:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94535 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.442025:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092587800 00000100:00100000:1.0:1746144891.442570:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1946 00000100:00100000:1.0:1746144891.442579:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175073536:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144891.442745:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175073536:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 167us (1472us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.442750:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1946 00002000:00100000:1.0:1746144891.442755:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092587800 x1830965175073536/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.442779:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092587800 with x1830965175073536 ext(0->4095) 00010000:00010000:1.0:1746144891.442785:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94535 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.442793:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94535 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.442798:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092587800 00000100:00100000:2.0:1746144891.443370:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172398848:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.443395:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9453c expref: 72 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.443408:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:2.0:1746144891.443434:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+72:31565:x1830965175073280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7199us (7683us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.443443:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5319 00000100:00100000:0.0:1746144891.445977:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.446595:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175073664 00000100:00100000:2.0:1746144891.446603:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175073664 00010000:00010000:2.0:1746144891.446638:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94535 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.446675:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10735 00000100:00100000:2.0:1746144891.446683:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092586300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175073664:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.446695:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.446714:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94535 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.446724:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94535 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.446743:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ad1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94535 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.446972:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.446974:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.446981:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9453c expref: 71 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.446989:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9453c expref: 71 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.447020:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9453c expref: 71 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.447030:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172398976:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.448244:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4380900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.451747:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.451856:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172398976:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.451878:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.451997:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092586300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175073664:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5313us (6024us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.452006:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10735 00000100:00100000:3.0:1746144891.452450:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175073920 00000100:00100000:3.0:1746144891.452455:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175073920 00002000:00100000:3.0:1746144891.452488:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092584a80 x1830965175073920/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.452496:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092584a80 with x1830965175073920 ext(0->4095) 00002000:00010000:3.0:1746144891.452500:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092584a80 00000100:00100000:3.0:1746144891.452522:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3952 00000100:00100000:3.0:1746144891.452528:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1984:x1830965175073920:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144891.452681:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1984:x1830965175073920:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 152us (945us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.452687:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3952 00002000:00100000:3.0:1746144891.452692:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092584a80 x1830965175073920/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.452698:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092584a80 with x1830965175073920 ext(0->4095) 00002000:00010000:3.0:1746144891.452704:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092584a80 00000100:00100000:0.0:1746144891.457607:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.457732:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175074048 00000100:00100000:2.0:1746144891.457741:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175074048 00000100:00100000:2.0:1746144891.457803:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5320 00000100:00100000:2.0:1746144891.457811:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175074048:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.457827:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.457840:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94543 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.457867:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9453c expref: 71 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.457874:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.457876:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.457879:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94543 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.457904:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9453c expref: 71 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.457919:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9453c expref: 71 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.457930:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172399104:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144891.457997:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4380900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.460388:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172399104:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.460507:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94543 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.460521:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7dc00, rc 0) 00000100:00100000:2.0:1746144891.461824:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175074048:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4009us (4218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.461833:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5320 00000100:00100000:0.0:1746144891.463244:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.464741:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175074176 00000100:00100000:1.0:1746144891.464750:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175074176 00002000:00100000:1.0:1746144891.464806:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880092584380 x1830965175074176/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.464815:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092584380 with x1830965175074176 ext(0->7) 00010000:00010000:1.0:1746144891.464824:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9453c expref: 72 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.464836:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9453c expref: 72 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.464842:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092584380 00000100:00100000:1.0:1746144891.464872:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1947 00000100:00100000:1.0:1746144891.464880:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1984:x1830965175074176:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144891.465176:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+74:1984:x1830965175074176:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 296us (1934us total) trans 4294967999 rc 0/0 00000100:00100000:1.0:1746144891.465182:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1947 00002000:00100000:1.0:1746144891.465188:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880092584380 x1830965175074176/t4294967999(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/448 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.465194:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092584380 with x1830965175074176 ext(0->7) 00010000:00010000:1.0:1746144891.465198:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9453c expref: 74 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.465207:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9453c expref: 74 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.465212:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092584380 00000100:00100000:0.0:1746144891.474004:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.474166:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175074304 00000100:00100000:2.0:1746144891.474175:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175074304 00010000:00010000:2.0:1746144891.474210:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9453c expref: 74 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.475606:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10736 00000100:00100000:2.0:1746144891.475621:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+74:1983:x1830965175074304:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.475635:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.475657:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9453c expref: 74 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.475675:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9453c expref: 74 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.475695:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514ad8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9453c expref: 74 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.475726:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.475728:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.475734:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94543 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.475741:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94543 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.475791:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94543 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.475803:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172399232:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.475879:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4380900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.482106:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.482264:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175074432 00000100:00100000:2.0:1746144891.482274:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175074432 00000100:00100000:2.0:1746144891.482320:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5321 00000100:00100000:2.0:1746144891.482328:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+74:31565:x1830965175074432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.482345:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.482359:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ae6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9454a expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.482388:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94543 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.482394:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.482395:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.482398:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ae6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9454a expref: 75 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.482423:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94543 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.482432:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94543 expref: 5 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.482443:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172399360:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144891.484184:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.484354:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f540 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.484455:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172399232:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.484475:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144891.485191:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175074688 00000100:00100000:0.0:1746144891.485197:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175074688 00002000:00100000:0.0:1746144891.485233:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4b480 x1830965175074688/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144891.485242:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b480 with x1830965175074688 ext(0->4095) 00010000:00010000:0.0:1746144891.485249:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94543 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:0.0:1746144891.485260:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94543 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:0.0:1746144891.485270:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb4b480 00000100:00100000:3.0:1746144891.489381:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+75:1983:x1830965175074304:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 13755us (15374us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.489393:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10736 00000100:00100000:0.0:1746144891.489884:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1948 00000100:00100000:0.0:1746144891.489896:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175074688:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144891.490075:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175074688:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 182us (5895us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144891.490080:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1948 00002000:00100000:0.0:1746144891.490087:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4b480 x1830965175074688/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144891.490095:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b480 with x1830965175074688 ext(0->4095) 00010000:00010000:0.0:1746144891.490103:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94543 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:0.0:1746144891.490114:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94543 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:0.0:1746144891.490120:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb4b480 00000100:00100000:3.0:1746144891.490298:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172399360:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.490322:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ae6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9454a expref: 74 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.490334:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:3.0:1746144891.490363:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+74:31565:x1830965175074432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 8037us (8266us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.490369:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5321 00000100:00100000:0.0:1746144891.494196:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144891.495397:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.495571:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175074816 00000100:00100000:3.0:1746144891.495580:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175074816 00000100:00100000:3.0:1746144891.495629:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5322 00000100:00100000:3.0:1746144891.495636:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+74:31579:x1830965175074816:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.495652:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.495667:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94551 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.495696:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.495702:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ae6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9454a expref: 75 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.495707:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.495711:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94551 expref: 75 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.495743:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ae6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9454a expref: 75 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.495753:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94551 expref: 75 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.495777:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094199a00, rc 0) 00000100:00100000:2.0:1746144891.495932:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175074944 00000100:00100000:2.0:1746144891.495936:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175074944 00010000:00010000:2.0:1746144891.495956:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94543 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.495995:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10737 00000100:00100000:2.0:1746144891.496001:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175074944:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.496008:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.496026:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94543 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.496039:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94543 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.496053:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514adf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94543 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.496076:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.496078:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.496084:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ae6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9454a expref: 75 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.496090:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ae6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9454a expref: 75 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.496109:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ae6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9454a expref: 75 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.496118:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ae6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9454a expref: 75 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.496128:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172399616:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.496453:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+75:31579:x1830965175074816:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 816us (2263us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.496459:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5322 00000100:00100000:2.0:1746144891.496641:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.501891:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172399616:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.501913:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.501968:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175074944:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5959us (6567us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.501981:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10737 00000100:00100000:0.0:1746144891.503089:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.503637:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175075072 00000100:00100000:2.0:1746144891.503644:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175075072 00010000:00010000:2.0:1746144891.503678:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ae6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9454a expref: 75 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.503715:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10738 00000100:00100000:2.0:1746144891.503721:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+75:1984:x1830965175075072:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.503732:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.503751:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ae6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9454a expref: 75 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.503779:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ae6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9454a expref: 75 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.503800:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ae6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9454a expref: 75 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.503826:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.503829:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.503834:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94551 expref: 74 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.503841:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94551 expref: 74 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.503869:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94551 expref: 74 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.503880:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172399744:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.503953:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.506271:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172399744:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.506288:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.506503:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+74:1984:x1830965175075072:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2780us (3415us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.506512:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10738 00000100:00100000:0.0:1746144891.508882:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.509025:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175075328 00000100:00100000:1.0:1746144891.509033:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175075328 00002000:00100000:1.0:1746144891.509069:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4aa00 x1830965175075328/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.509077:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4aa00 with x1830965175075328 ext(0->4095) 00002000:00010000:1.0:1746144891.509082:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4aa00 00000100:00100000:1.0:1746144891.509108:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3953 00000100:00100000:1.0:1746144891.509114:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+74:1985:x1830965175075328:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144891.509264:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+74:1985:x1830965175075328:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 149us (386us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.509273:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3953 00002000:00100000:1.0:1746144891.509278:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4aa00 x1830965175075328/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.509285:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4aa00 with x1830965175075328 ext(0->4095) 00002000:00010000:1.0:1746144891.509288:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4aa00 00000100:00100000:0.0:1746144891.519458:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.519607:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175075456 00000100:00100000:3.0:1746144891.519616:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175075456 00000100:00100000:3.0:1746144891.519668:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5323 00000100:00100000:3.0:1746144891.519675:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175075456:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.519691:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.519707:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94558 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.519731:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94551 expref: 73 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.519738:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.519739:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.519742:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94558 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.519799:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94551 expref: 73 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.519809:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94551 expref: 73 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.519825:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172399872:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.519915:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.527946:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172399872:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.527983:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94558 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.527998:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7d200, rc 0) 00000100:00100000:3.0:1746144891.528049:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175075456:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 8373us (8598us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.528057:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5323 00000100:00100000:0.0:1746144891.532654:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.532831:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175075584 00000100:00100000:2.0:1746144891.532839:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175075584 00002000:00100000:2.0:1746144891.532880:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009bb4a680 x1830965175075584/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.532890:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4a680 with x1830965175075584 ext(0->7) 00010000:00010000:2.0:1746144891.532899:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94551 expref: 74 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.532912:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94551 expref: 74 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.532919:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb4a680 00000100:00100000:2.0:1746144891.532951:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1949 00000100:00100000:2.0:1746144891.532967:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+74:1983:x1830965175075584:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144891.533248:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1983:x1830965175075584:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 290us (602us total) trans 4294968000 rc 0/0 00000100:00100000:2.0:1746144891.533258:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1949 00002000:00100000:2.0:1746144891.533264:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009bb4a680 x1830965175075584/t4294968000(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/448 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.533271:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4a680 with x1830965175075584 ext(0->7) 00010000:00010000:2.0:1746144891.533276:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94551 expref: 76 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.533285:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94551 expref: 76 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.533291:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb4a680 00000100:00100000:0.0:1746144891.541834:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144891.541880:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.541902:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175075840 00000100:00100000:3.0:1746144891.541913:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175075840 00000100:00100000:3.0:1746144891.541969:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5324 00000100:00100000:3.0:1746144891.541977:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+76:31565:x1830965175075840:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.541992:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.542006:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9455f expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.542030:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.542036:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94558 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.542042:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144891.542045:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9455f expref: 77 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.542076:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94558 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.542086:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9455f expref: 77 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.542094:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7d400, rc 0) 00000100:00100000:3.0:1746144891.542149:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+77:31565:x1830965175075840:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 173us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.542155:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5324 00000100:00100000:2.0:1746144891.542207:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175075712 00000100:00100000:2.0:1746144891.542211:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175075712 00010000:00010000:2.0:1746144891.542227:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94551 expref: 77 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.542243:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10739 00000100:00100000:2.0:1746144891.542247:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1982:x1830965175075712:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.542257:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.542273:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94551 expref: 77 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.542282:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94551 expref: 77 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.542296:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514aed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94551 expref: 77 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.542309:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.542310:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.542315:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94558 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.542322:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94558 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.542339:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94558 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.542349:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94558 expref: 5 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.542359:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172400128:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.542403:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.546384:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.546460:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175076096 00000100:00100000:1.0:1746144891.546471:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175076096 00002000:00100000:1.0:1746144891.546524:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ae41180 x1830965175076096/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.546537:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae41180 with x1830965175076096 ext(0->4095) 00010000:00010000:1.0:1746144891.546545:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94558 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.546557:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94558 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.546564:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ae41180 00000100:00100000:2.0:1746144891.546584:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172400128:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.546610:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.546665:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1982:x1830965175075712:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4415us (4782us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.546677:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10739 00000100:00100000:1.0:1746144891.546724:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1950 00000100:00100000:1.0:1746144891.546732:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175076096:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144891.547033:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175076096:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 300us (658us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.547038:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1950 00002000:00100000:1.0:1746144891.547044:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ae41180 x1830965175076096/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.547055:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae41180 with x1830965175076096 ext(0->4095) 00010000:00010000:1.0:1746144891.547059:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94558 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.547067:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94558 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.547072:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ae41180 00000100:00100000:0.0:1746144891.550744:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.550844:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175076224 00000100:00100000:2.0:1746144891.550856:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175076224 00010000:00010000:2.0:1746144891.550899:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94558 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.550940:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10740 00000100:00100000:2.0:1746144891.550946:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175076224:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.550968:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.550991:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94558 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.551001:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94558 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.551023:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514af4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94558 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.551455:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.551458:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.551467:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9455f expref: 75 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.551478:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9455f expref: 75 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.551513:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9455f expref: 75 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.551526:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172400256:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.551622:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.555451:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172400256:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.555479:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.555531:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae43480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175076224:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4583us (4798us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.555546:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10740 00000100:00100000:0.0:1746144891.556571:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.557242:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175076480 00000100:00100000:1.0:1746144891.557251:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175076480 00002000:00100000:1.0:1746144891.557294:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ae40700 x1830965175076480/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.557303:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae40700 with x1830965175076480 ext(0->4095) 00002000:00010000:1.0:1746144891.557308:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae40700 00000100:00100000:1.0:1746144891.557334:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3954 00000100:00100000:1.0:1746144891.557339:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965175076480:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144891.557511:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965175076480:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 172us (942us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.557517:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3954 00002000:00100000:1.0:1746144891.557522:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ae40700 x1830965175076480/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.557528:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae40700 with x1830965175076480 ext(0->4095) 00002000:00010000:1.0:1746144891.557531:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae40700 00000100:00100000:0.0:1746144891.566923:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.567153:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175076608 00000100:00100000:2.0:1746144891.567163:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175076608 00000100:00100000:2.0:1746144891.567682:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5325 00000100:00100000:2.0:1746144891.567692:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175076608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.567711:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.567729:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94566 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.567756:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9455f expref: 75 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.567796:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.567798:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.567801:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94566 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.567831:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9455f expref: 75 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.567842:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9455f expref: 75 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.567854:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172400384:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144891.567940:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.571515:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172400384:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.571553:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94566 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.571571:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d200, rc 0) 00000100:00100000:2.0:1746144891.571624:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175076608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3934us (4711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.571632:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5325 00000100:00100000:0.0:1746144891.584940:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.585217:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175076736 00000100:00100000:3.0:1746144891.585225:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175076736 00002000:00100000:3.0:1746144891.585263:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009ae40a80 x1830965175076736/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.585271:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae40a80 with x1830965175076736 ext(0->7) 00010000:00010000:3.0:1746144891.585279:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9455f expref: 76 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.585292:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9455f expref: 76 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.585304:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ae40a80 00000100:00100000:3.0:1746144891.585333:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1951 00000100:00100000:3.0:1746144891.585340:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1985:x1830965175076736:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144891.586816:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1985:x1830965175076736:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 1470us (1877us total) trans 4294968001 rc 0/0 00000100:00100000:3.0:1746144891.586824:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1951 00002000:00100000:3.0:1746144891.586833:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009ae40a80 x1830965175076736/t4294968001(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/448 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.586840:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae40a80 with x1830965175076736 ext(0->7) 00010000:00010000:3.0:1746144891.586847:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9455f expref: 78 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.586858:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9455f expref: 78 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.586864:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ae40a80 00000100:00100000:0.0:1746144891.598480:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.598575:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175076864 00000100:00100000:2.0:1746144891.598584:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175076864 00010000:00010000:2.0:1746144891.598618:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9455f expref: 78 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.598657:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10741 00000100:00100000:2.0:1746144891.598664:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1985:x1830965175076864:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.598676:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.598692:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9455f expref: 78 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.598702:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9455f expref: 78 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.598721:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514afb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9455f expref: 78 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.599514:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.599517:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.599524:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94566 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.599532:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94566 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.599562:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94566 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.599573:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172400512:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144891.600588:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746144891.601598:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.603130:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.604274:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175076992 00000100:00100000:2.0:1746144891.604283:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175076992 00000100:00100000:3.0:1746144891.605011:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5326 00000100:00100000:3.0:1746144891.605021:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+78:31565:x1830965175076992:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.605036:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.605048:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9456d expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.605071:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94566 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.605078:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.605079:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.605082:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9456d expref: 79 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.605108:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94566 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.605118:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94566 expref: 5 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.605129:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172400640:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.605210:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.607016:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.607601:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172400512:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.607622:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.607669:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+79:1985:x1830965175076864:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 9005us (9195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.607678:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10741 00000100:00100000:3.0:1746144891.608491:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175077248 00000100:00100000:3.0:1746144891.608497:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175077248 00002000:00100000:3.0:1746144891.608531:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b463480 x1830965175077248/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.608541:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463480 with x1830965175077248 ext(0->4095) 00010000:00010000:3.0:1746144891.608548:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94566 expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.608559:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94566 expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.608565:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b463480 00000100:00100000:3.0:1746144891.608580:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1952 00000100:00100000:3.0:1746144891.608586:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175077248:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144891.608790:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172400640:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.608807:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9456d expref: 78 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.608818:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7dc00, rc 0) 00000100:00100000:3.0:1746144891.609400:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175077248:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 812us (2385us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.609406:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1952 00002000:00100000:3.0:1746144891.609412:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b463480 x1830965175077248/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.609420:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463480 with x1830965175077248 ext(0->4095) 00010000:00010000:3.0:1746144891.609424:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94566 expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.609434:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94566 expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.609439:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b463480 00000100:00100000:2.0:1746144891.610077:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+78:31565:x1830965175076992:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5057us (6951us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.610083:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5326 00000100:00100000:0.0:1746144891.616486:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.617454:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175077376 00000100:00100000:2.0:1746144891.617467:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175077376 00010000:00010000:2.0:1746144891.617501:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94566 expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.617529:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10742 00000100:00100000:2.0:1746144891.617536:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175077376:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.617547:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.617566:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94566 expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.617576:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94566 expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.617601:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b02 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94566 expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.617625:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.617627:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.617633:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9456d expref: 77 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.617644:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9456d expref: 77 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.618401:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9456d expref: 77 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.618414:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172400768:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.618544:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.621480:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.621565:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172400768:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.621580:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.621625:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175077376:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4089us (5145us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.621634:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10742 00000100:00100000:2.0:1746144891.621704:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175077632 00000100:00100000:2.0:1746144891.621709:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175077632 00002000:00100000:2.0:1746144891.621740:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b460700 x1830965175077632/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.621749:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460700 with x1830965175077632 ext(0->4095) 00002000:00010000:2.0:1746144891.621752:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b460700 00000100:00100000:2.0:1746144891.621793:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3955 00000100:00100000:2.0:1746144891.621799:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1984:x1830965175077632:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144891.621924:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1984:x1830965175077632:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 125us (450us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.621930:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3955 00002000:00100000:2.0:1746144891.621935:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b460700 x1830965175077632/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.621942:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460700 with x1830965175077632 ext(0->4095) 00002000:00010000:2.0:1746144891.621944:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b460700 00000100:00100000:0.0:1746144891.631721:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.631856:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175077760 00000100:00100000:2.0:1746144891.631863:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175077760 00000100:00100000:2.0:1746144891.631985:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5327 00000100:00100000:2.0:1746144891.631994:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175077760:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.632008:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.632021:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b10 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94574 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.632048:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9456d expref: 77 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.632054:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.632055:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.632058:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b10 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94574 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.632082:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9456d expref: 77 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.632092:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9456d expref: 77 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.632102:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172400896:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144891.632185:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.646409:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172400896:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.646436:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b10 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94574 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.646449:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:2.0:1746144891.646483:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175077760:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 14491us (14769us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.646489:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5327 00000100:00100000:0.0:1746144891.652605:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.652665:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175077888 00000100:00100000:1.0:1746144891.652672:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175077888 00002000:00100000:1.0:1746144891.652706:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009b460a80 x1830965175077888/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.652714:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460a80 with x1830965175077888 ext(0->7) 00010000:00010000:1.0:1746144891.652722:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9456d expref: 78 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.652733:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9456d expref: 78 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.652739:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b460a80 00000100:00100000:1.0:1746144891.652772:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1953 00000100:00100000:1.0:1746144891.652778:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1983:x1830965175077888:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144891.653034:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+80:1983:x1830965175077888:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 256us (435us total) trans 4294968002 rc 0/0 00000100:00100000:1.0:1746144891.653039:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1953 00002000:00100000:1.0:1746144891.653045:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009b460a80 x1830965175077888/t4294968002(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/448 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.653051:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460a80 with x1830965175077888 ext(0->7) 00010000:00010000:1.0:1746144891.653055:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9456d expref: 80 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.653064:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9456d expref: 80 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:1.0:1746144891.653073:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b460a80 00000100:00100000:0.0:1746144891.656280:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.656374:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175078016 00000100:00100000:3.0:1746144891.656382:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175078016 00010000:00010000:3.0:1746144891.656410:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9456d expref: 80 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.656443:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10743 00000100:00100000:3.0:1746144891.656449:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+80:1984:x1830965175078016:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.656461:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746144891.656474:0:7098:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 1746144891 -> 1746144892 00002000:00010000:3.0:1746144891.656476:0:7098:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 1746144891 -> 1746144892 00010000:00010000:3.0:1746144891.656480:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9456d expref: 80 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.656491:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9456d expref: 80 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.656510:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514b09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9456d expref: 80 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.656536:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.656538:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.656544:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94574 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.656551:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94574 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.656578:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94574 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.656592:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172401024:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.656656:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.658467:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172401024:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.658483:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.658507:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+79:1984:x1830965175078016:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2058us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.658514:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10743 00000100:00100000:0.0:1746144891.668065:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.668272:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175078272 00000100:00100000:2.0:1746144891.668280:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175078272 00002000:00100000:2.0:1746144891.668321:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b462d80 x1830965175078272/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.668330:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b462d80 with x1830965175078272 ext(0->4095) 00002000:00010000:2.0:1746144891.668334:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b462d80 00000100:00100000:2.0:1746144891.668362:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3956 00000100:00100000:2.0:1746144891.668368:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175078272:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144891.668510:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175078272:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 142us (457us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.668515:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3956 00002000:00100000:2.0:1746144891.668519:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b462d80 x1830965175078272/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.668525:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b462d80 with x1830965175078272 ext(0->4095) 00002000:00010000:2.0:1746144891.668528:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b462d80 00000100:00100000:0.0:1746144891.670290:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.670451:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175078400 00000100:00100000:2.0:1746144891.670456:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175078400 00000100:00100000:2.0:1746144891.671116:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5328 00000100:00100000:2.0:1746144891.671125:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+79:31579:x1830965175078400:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.671239:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.671252:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9457b expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.671273:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b10 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94574 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.671284:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.671285:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.671288:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9457b expref: 80 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.671311:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94574 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.671320:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94574 expref: 5 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.671330:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172401152:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144891.672078:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.674941:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172401152:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.674977:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9457b expref: 80 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.674992:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:2.0:1746144891.675037:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+80:31579:x1830965175078400:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3913us (4750us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.675044:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5328 00000100:00100000:0.0:1746144891.677894:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.678263:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175078528 00000100:00100000:3.0:1746144891.678271:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175078528 00010000:00010000:3.0:1746144891.678304:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94574 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.678342:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10744 00000100:00100000:3.0:1746144891.678348:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175078528:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.678361:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.678378:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b10 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94574 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.678389:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b10 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94574 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.678408:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b10 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94574 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.678434:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.678436:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.678442:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9457b expref: 79 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.678450:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9457b expref: 79 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.678478:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9457b expref: 79 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.678489:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172401280:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.678561:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.679894:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.680039:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175078656 00000100:00100000:2.0:1746144891.680045:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175078656 00000100:00100000:2.0:1746144891.680077:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5329 00000100:00100000:2.0:1746144891.680082:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+80:31565:x1830965175078656:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.680095:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.680105:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94582 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.680121:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9457b expref: 81 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.680127:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.680128:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.680131:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94582 expref: 81 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.680148:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9457b expref: 81 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.680157:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9457b expref: 81 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.680165:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172401408:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144891.680224:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.680902:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172401280:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.680914:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.680950:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175078528:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2601us (3063us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.680966:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10744 00000100:00100000:0.0:1746144891.681190:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.681414:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175078912 00000100:00100000:2.0:1746144891.681417:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175078912 00002000:00100000:2.0:1746144891.681441:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b461f80 x1830965175078912/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.681450:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b461f80 with x1830965175078912 ext(0->4095) 00010000:00010000:2.0:1746144891.681455:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9457b expref: 82 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.681469:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9457b expref: 82 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.681474:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b461f80 00000100:00100000:2.0:1746144891.681487:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1954 00000100:00100000:2.0:1746144891.681493:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1982:x1830965175078912:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746144891.681627:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1982:x1830965175078912:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 133us (435us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.681633:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1954 00002000:00100000:2.0:1746144891.681638:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b461f80 x1830965175078912/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1746144891.681858:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172401408:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.681871:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94582 expref: 82 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.681882:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:3.0:1746144891.681913:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+82:31565:x1830965175078656:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1830us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.681917:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5329 00002000:00100000:2.0:1746144891.681983:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b461f80 with x1830965175078912 ext(0->4095) 00010000:00010000:2.0:1746144891.681989:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9457b expref: 81 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.681997:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9457b expref: 81 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.682002:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b461f80 00000100:00100000:0.0:1746144891.683580:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144891.683693:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.683749:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175079168 00000100:00100000:3.0:1746144891.683754:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175079168 00000100:00100000:3.0:1746144891.684024:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5330 00000100:00100000:3.0:1746144891.684031:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175079168:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.684044:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.684056:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94589 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.684074:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.684078:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94582 expref: 80 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.684083:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144891.684085:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94589 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.684111:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94582 expref: 80 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.684120:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94589 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.684128:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094198000, rc 0) 00000100:00100000:3.0:1746144891.684157:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175079168:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 126us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.684162:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5330 00000100:00100000:2.0:1746144891.684317:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175079040 00000100:00100000:2.0:1746144891.684322:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175079040 00010000:00010000:2.0:1746144891.684338:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9457b expref: 81 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.684356:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10745 00000100:00100000:2.0:1746144891.684361:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+81:1984:x1830965175079040:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.684369:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.684383:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9457b expref: 81 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.684391:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9457b expref: 81 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.684405:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9457b expref: 81 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.684416:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.684417:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.684423:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94582 expref: 80 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.684429:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94582 expref: 80 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.684447:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94582 expref: 80 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.684461:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94582 expref: 80 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.684471:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172401664:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.684802:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.686427:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172401664:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.686445:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.686472:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+80:1984:x1830965175079040:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2111us (2778us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.686480:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10745 00000100:00100000:0.0:1746144891.686999:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.687054:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175079424 00000100:00100000:2.0:1746144891.687059:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175079424 00002000:00100000:2.0:1746144891.687088:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358efb80 x1830965175079424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.687097:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358efb80 with x1830965175079424 ext(0->4095) 00010000:00010000:2.0:1746144891.687103:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94582 expref: 80 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.687113:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94582 expref: 80 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.687118:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801358efb80 00000100:00100000:2.0:1746144891.687131:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1955 00000100:00100000:2.0:1746144891.687137:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+80:1985:x1830965175079424:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144891.687333:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+80:1985:x1830965175079424:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 196us (335us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.687339:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1955 00002000:00100000:2.0:1746144891.687344:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358efb80 x1830965175079424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.687350:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358efb80 with x1830965175079424 ext(0->4095) 00010000:00010000:2.0:1746144891.687355:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94582 expref: 80 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.687363:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94582 expref: 80 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.687367:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801358efb80 00000100:00100000:0.0:1746144891.689098:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144891.689170:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.689248:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175079552 00000100:00100000:1.0:1746144891.689253:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175079552 00000100:00100000:1.0:1746144891.689291:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5331 00000100:00100000:1.0:1746144891.689298:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+80:31565:x1830965175079552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144891.689309:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144891.689321:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94590 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.689341:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144891.689346:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94589 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.689351:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144891.689354:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94590 expref: 81 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.689383:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94589 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.689395:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94590 expref: 81 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.689404:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501800, rc 0) 00000100:00100000:1.0:1746144891.689429:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+81:31565:x1830965175079552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 132us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.689438:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5331 00000100:00100000:2.0:1746144891.689501:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175079680 00000100:00100000:2.0:1746144891.689504:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175079680 00010000:00010000:2.0:1746144891.689520:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94582 expref: 81 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.689537:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10746 00000100:00100000:2.0:1746144891.689541:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+81:1982:x1830965175079680:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.689549:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.689565:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94582 expref: 81 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.689575:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94582 expref: 81 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.689589:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94582 expref: 81 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.689601:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.689602:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.689607:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94589 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.689618:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94589 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.689636:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94589 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.689647:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94589 expref: 5 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.690300:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172401920:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.690358:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.692294:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172401920:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.692313:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.692337:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358edc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+80:1982:x1830965175079680:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2795us (3167us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.692345:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10746 00000100:00100000:0.0:1746144891.692701:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.692876:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175079936 00000100:00100000:2.0:1746144891.692881:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175079936 00002000:00100000:2.0:1746144891.692908:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358ef800 x1830965175079936/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.692916:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358ef800 with x1830965175079936 ext(0->4095) 00010000:00010000:2.0:1746144891.692922:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94589 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.692933:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94589 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.692939:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801358ef800 00000100:00100000:2.0:1746144891.692953:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1956 00000100:00100000:2.0:1746144891.692972:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175079936:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746144891.693106:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175079936:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 147us (405us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.693111:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1956 00002000:00100000:2.0:1746144891.693116:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358ef800 x1830965175079936/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.693123:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358ef800 with x1830965175079936 ext(0->4095) 00010000:00010000:2.0:1746144891.693127:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94589 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.693135:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94589 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.693140:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801358ef800 00000100:00100000:0.0:1746144891.694458:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.694616:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175080064 00000100:00100000:2.0:1746144891.694620:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175080064 00010000:00010000:2.0:1746144891.694645:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94589 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.694679:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10747 00000100:00100000:2.0:1746144891.694685:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175080064:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.694694:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.694711:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94589 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.694721:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94589 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.694741:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514b25 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94589 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.694789:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.694791:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.694798:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94590 expref: 79 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.694805:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94590 expref: 79 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.695510:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94590 expref: 79 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.695522:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172402048:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.696246:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.698857:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172402048:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144891.698878:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144891.698918:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175080064:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4231us (4462us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144891.698927:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10747 00000100:00100000:0.0:1746144891.699394:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.699431:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175080320 00000100:00100000:2.0:1746144891.699436:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175080320 00002000:00100000:2.0:1746144891.699463:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358ef100 x1830965175080320/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.699472:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358ef100 with x1830965175080320 ext(0->4095) 00002000:00010000:2.0:1746144891.699475:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801358ef100 00000100:00100000:2.0:1746144891.699501:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3957 00000100:00100000:2.0:1746144891.699507:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+80:1984:x1830965175080320:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144891.699674:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+80:1984:x1830965175080320:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 163us (276us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.699680:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3957 00002000:00100000:2.0:1746144891.699685:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358ef100 x1830965175080320/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.699692:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358ef100 with x1830965175080320 ext(0->4095) 00002000:00010000:2.0:1746144891.699694:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801358ef100 00000100:00100000:0.0:1746144891.704265:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.704419:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175080448 00000100:00100000:3.0:1746144891.704427:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175080448 00000100:00100000:3.0:1746144891.704477:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5332 00000100:00100000:3.0:1746144891.704485:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175080448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.704501:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.704514:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b33 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94597 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.704545:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94590 expref: 79 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.704552:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.704553:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.704557:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b33 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94597 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.704585:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94590 expref: 79 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.704596:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94590 expref: 79 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.704606:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172402176:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.704674:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.708426:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172402176:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.708458:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b33 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94597 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.708476:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:3.0:1746144891.708523:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175080448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4039us (4265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.708537:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5332 00000100:00100000:0.0:1746144891.710626:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.710723:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175080576 00000100:00100000:3.0:1746144891.710732:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175080576 00002000:00100000:3.0:1746144891.710905:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8801358eea00 x1830965175080576/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.710916:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358eea00 with x1830965175080576 ext(0->7) 00010000:00010000:3.0:1746144891.710926:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94590 expref: 80 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.710940:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94590 expref: 80 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.710947:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801358eea00 00000100:00100000:3.0:1746144891.710987:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1957 00000100:00100000:3.0:1746144891.710995:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+80:1985:x1830965175080576:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144891.712677:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1985:x1830965175080576:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 1673us (2049us total) trans 4294968003 rc 0/0 00000100:00100000:3.0:1746144891.712690:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1957 00002000:00100000:3.0:1746144891.712701:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8801358eea00 x1830965175080576/t4294968003(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/448 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.712711:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358eea00 with x1830965175080576 ext(0->7) 00010000:00010000:3.0:1746144891.712721:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94590 expref: 82 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.712739:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94590 expref: 82 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.712745:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801358eea00 00000100:00100000:0.0:1746144891.718879:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.719592:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175080704 00000100:00100000:2.0:1746144891.719602:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175080704 00010000:00010000:2.0:1746144891.719646:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94590 expref: 82 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:2.0:1746144891.719685:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10748 00000100:00100000:2.0:1746144891.719692:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1983:x1830965175080704:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.719705:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.719727:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94590 expref: 82 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.719738:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94590 expref: 82 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.719781:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514b2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94590 expref: 82 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.719811:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.719813:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.719820:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b33 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94597 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.719827:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94597 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.719859:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94597 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.719870:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172402304:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144891.719953:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.723580:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172402304:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144891.723611:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144891.723668:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+81:1983:x1830965175080704:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3975us (4798us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144891.723679:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10748 00000100:00100000:0.0:1746144891.724299:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.724391:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175080960 00000100:00100000:3.0:1746144891.724398:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175080960 00002000:00100000:3.0:1746144891.724440:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358edc00 x1830965175080960/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.724450:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358edc00 with x1830965175080960 ext(0->4095) 00002000:00010000:3.0:1746144891.724455:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801358edc00 00000100:00100000:3.0:1746144891.724480:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3958 00000100:00100000:3.0:1746144891.724487:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175080960:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144891.724653:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175080960:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 167us (356us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.724658:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3958 00002000:00100000:3.0:1746144891.724662:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358edc00 x1830965175080960/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.724669:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358edc00 with x1830965175080960 ext(0->4095) 00002000:00010000:3.0:1746144891.724671:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801358edc00 00000100:00100000:0.0:1746144891.725238:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.725674:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175081088 00000100:00100000:3.0:1746144891.725679:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175081088 00000100:00100000:3.0:1746144891.725951:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5333 00000100:00100000:3.0:1746144891.725970:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+81:31565:x1830965175081088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.725985:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.726002:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9459e expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.726026:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b33 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94597 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.726033:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.726035:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.726037:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9459e expref: 82 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.726067:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94597 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.726078:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94597 expref: 5 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.726090:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172402432:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.726162:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.726606:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.726642:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175081216 00000100:00100000:1.0:1746144891.726647:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175081216 00000100:00100000:1.0:1746144891.726684:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5334 00000100:00100000:1.0:1746144891.726690:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+83:31579:x1830965175081216:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144891.726697:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144891.726705:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514b41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af945a5 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.726718:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.726722:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9459e expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.726727:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144891.726730:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514b41 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945a5 expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.726750:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9459e expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.726780:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514b41 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945a5 expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.726791:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501200, rc 0) 00000100:00100000:1.0:1746144891.726815:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31579:x1830965175081216:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 125us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.726821:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5334 00000100:00100000:3.0:1746144891.729221:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172402432:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.729250:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9459e expref: 83 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.729265:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:3.0:1746144891.729302:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+83:31565:x1830965175081088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3345us (4065us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.729314:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5333 00000100:00100000:0.0:1746144891.729486:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.729758:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175081344 00000100:00100000:1.0:1746144891.729796:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175081344 00010000:00010000:1.0:1746144891.729825:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94597 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.730211:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10749 00000100:00100000:1.0:1746144891.730218:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175081344:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144891.730231:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144891.730251:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b33 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94597 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.730263:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b33 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94597 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.730285:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b33 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94597 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.730313:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.730315:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.730322:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9459e expref: 82 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.730331:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9459e expref: 82 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.730359:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9459e expref: 82 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.730374:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9459e expref: 82 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.730385:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172402688:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144891.730452:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144891.734201:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172402688:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144891.734225:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144891.734813:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175081344:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4593us (5325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.734825:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10749 00000100:00100000:0.0:1746144891.735828:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.735890:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175081600 00000100:00100000:2.0:1746144891.735898:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175081600 00002000:00100000:2.0:1746144891.735946:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b462300 x1830965175081600/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.735965:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b462300 with x1830965175081600 ext(0->4095) 00010000:00010000:2.0:1746144891.735974:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9459e expref: 83 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.735989:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9459e expref: 83 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.735995:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b462300 00000100:00100000:2.0:1746144891.736025:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1958 00000100:00100000:2.0:1746144891.736035:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1984:x1830965175081600:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144891.736227:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1984:x1830965175081600:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 194us (406us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.736233:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1958 00002000:00100000:2.0:1746144891.736238:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b462300 x1830965175081600/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.736245:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b462300 with x1830965175081600 ext(0->4095) 00010000:00010000:2.0:1746144891.736249:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9459e expref: 83 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.736257:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9459e expref: 83 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.736263:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b462300 00000100:00100000:0.0:1746144891.740342:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.740414:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175081728 00000100:00100000:1.0:1746144891.740424:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175081728 00010000:00010000:1.0:1746144891.740462:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9459e expref: 83 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.741091:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10750 00000100:00100000:1.0:1746144891.741100:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1982:x1830965175081728:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144891.741116:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144891.741139:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9459e expref: 83 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.741153:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9459e expref: 83 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.741178:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9459e expref: 83 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.741302:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.741305:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.741313:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514b41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945a5 expref: 82 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.741321:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514b41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945a5 expref: 82 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.741356:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514b41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945a5 expref: 82 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144891.741368:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172402816:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144891.741459:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.745095:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.745238:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175081984 00000100:00100000:3.0:1746144891.745248:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175081984 00002000:00100000:3.0:1746144891.745291:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b4fa300 x1830965175081984/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.745302:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4fa300 with x1830965175081984 ext(0->4095) 00002000:00010000:3.0:1746144891.745312:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4fa300 00000100:00100000:3.0:1746144891.745341:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3959 00000100:00100000:3.0:1746144891.745348:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1983:x1830965175081984:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:3.0:1746144891.745523:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1983:x1830965175081984:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 174us (438us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.745529:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3959 00002000:00100000:3.0:1746144891.745535:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b4fa300 x1830965175081984/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.745543:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4fa300 with x1830965175081984 ext(0->4095) 00002000:00010000:3.0:1746144891.745545:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4fa300 00000100:00100000:1.0:1746144891.745638:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172402816:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144891.745658:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144891.745683:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1982:x1830965175081728:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4585us (5358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.745692:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10750 00000100:00100000:0.0:1746144891.752570:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.752684:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175082112 00000100:00100000:3.0:1746144891.752696:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175082112 00000100:00100000:1.0:1746144891.752871:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5335 00000100:00100000:1.0:1746144891.752881:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175082112:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144891.752900:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144891.752918:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af945ac expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.752947:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514b41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945a5 expref: 81 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.752965:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144891.752967:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144891.752970:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ac expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.752999:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514b41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945a5 expref: 81 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.753011:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514b41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945a5 expref: 81 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.753021:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172402944:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144891.753099:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144891.754643:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172402944:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144891.754669:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ac expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.754684:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500e00, rc 0) 00000100:00100000:1.0:1746144891.754729:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175082112:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1849us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.754736:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5335 00000100:00100000:0.0:1746144891.755613:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.756045:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175082240 00000100:00100000:1.0:1746144891.756052:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175082240 00010000:00010000:1.0:1746144891.756085:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514b41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945a5 expref: 82 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:0.0:1746144891.756755:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144891.756800:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175082368 00000100:00100000:0.0:1746144891.756804:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175082368 00000100:00100000:0.0:1746144891.756844:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5336 00000100:00100000:0.0:1746144891.756851:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+83:31565:x1830965175082368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144891.756867:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144891.756887:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af945b3 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144891.756914:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144891.756920:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ac expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144891.756926:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746144891.756930:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945b3 expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144891.756977:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ac expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144891.756987:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945b3 expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144891.756996:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:0.0:1746144891.757032:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31565:x1830965175082368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 182us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144891.757038:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5336 00000100:00100000:1.0:1746144891.757509:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10751 00000100:00100000:1.0:1746144891.757516:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1985:x1830965175082240:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144891.757525:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144891.757546:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514b41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945a5 expref: 83 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.757565:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514b41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945a5 expref: 83 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.757587:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514b41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945a5 expref: 83 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.757607:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.757609:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.757615:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ac expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.757622:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ac expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.757641:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ac expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.757649:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ac expref: 5 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.757665:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172403200:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144891.757723:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.761238:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.761876:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172403200:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144891.761901:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144891.761954:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1985:x1830965175082240:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4438us (6343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.761973:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10751 00000100:00100000:2.0:1746144891.762226:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175082624 00000100:00100000:2.0:1746144891.762233:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175082624 00002000:00100000:2.0:1746144891.762276:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc4a80 x1830965175082624/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.762285:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4a80 with x1830965175082624 ext(0->4095) 00010000:00010000:2.0:1746144891.762294:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ac expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.762308:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ac expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.762314:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bbc4a80 00000100:00100000:2.0:1746144891.762717:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1959 00000100:00100000:2.0:1746144891.762726:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175082624:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144891.762920:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175082624:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 195us (1694us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.762927:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1959 00002000:00100000:2.0:1746144891.762932:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc4a80 x1830965175082624/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.762939:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4a80 with x1830965175082624 ext(0->4095) 00010000:00010000:2.0:1746144891.762943:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ac expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.762952:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ac expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.762967:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bbc4a80 00000100:00100000:0.0:1746144891.766693:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.766995:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175082752 00000100:00100000:1.0:1746144891.767005:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175082752 00010000:00010000:1.0:1746144891.767043:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ac expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.767079:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10752 00000100:00100000:1.0:1746144891.767086:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175082752:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144891.767099:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144891.767121:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ac expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.767133:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ac expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.767155:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514b48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ac expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.767175:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.767178:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.767185:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945b3 expref: 81 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.767192:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945b3 expref: 81 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.767224:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945b3 expref: 81 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144891.767234:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172403328:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144891.767317:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.776628:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.776880:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175083008 00000100:00100000:3.0:1746144891.776890:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175083008 00002000:00100000:3.0:1746144891.776942:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc5500 x1830965175083008/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.776953:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc5500 with x1830965175083008 ext(0->4095) 00002000:00010000:3.0:1746144891.776969:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc5500 00000100:00100000:3.0:1746144891.777049:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3960 00000100:00100000:3.0:1746144891.777059:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1984:x1830965175083008:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144891.777279:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1984:x1830965175083008:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 221us (661us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.777287:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3960 00002000:00100000:3.0:1746144891.777293:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc5500 x1830965175083008/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.777300:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc5500 with x1830965175083008 ext(0->4095) 00002000:00010000:3.0:1746144891.777303:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc5500 00000100:00100000:1.0:1746144891.778145:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172403328:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144891.778169:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144891.778200:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175082752:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 11115us (11518us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.778208:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10752 00000100:00100000:0.0:1746144891.785243:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.785547:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175083136 00000100:00100000:3.0:1746144891.785558:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175083136 00000100:00100000:3.0:1746144891.785609:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5337 00000100:00100000:3.0:1746144891.785619:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175083136:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.785640:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.785659:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b56 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af945ba expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.785691:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945b3 expref: 81 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.785699:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.785700:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.785703:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b56 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ba expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.785734:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945b3 expref: 81 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.785747:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945b3 expref: 81 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.785758:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172403456:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.786883:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.788754:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.788903:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172403456:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.788930:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b56 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ba expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.788945:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:3.0:1746144891.789017:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175083136:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3399us (3785us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.789025:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5337 00000100:00100000:2.0:1746144891.789082:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175083264 00000100:00100000:2.0:1746144891.789090:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175083264 00002000:00100000:2.0:1746144891.789139:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009bbc4e00 x1830965175083264/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.789148:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4e00 with x1830965175083264 ext(0->7) 00010000:00010000:2.0:1746144891.789156:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945b3 expref: 82 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.789168:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945b3 expref: 82 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.789180:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bbc4e00 00000100:00100000:2.0:1746144891.789282:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1960 00000100:00100000:2.0:1746144891.789291:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1982:x1830965175083264:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144891.790044:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1982:x1830965175083264:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 753us (1296us total) trans 4294968004 rc 0/0 00000100:00100000:2.0:1746144891.790050:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1960 00002000:00100000:2.0:1746144891.790057:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009bbc4e00 x1830965175083264/t4294968004(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 496/448 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.790064:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4e00 with x1830965175083264 ext(0->7) 00010000:00010000:2.0:1746144891.790070:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945b3 expref: 84 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.790079:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945b3 expref: 84 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.790085:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bbc4e00 00000100:00100000:0.0:1746144891.793029:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.793220:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175083392 00000100:00100000:1.0:1746144891.793229:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175083392 00010000:00010000:1.0:1746144891.793267:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945b3 expref: 84 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.793344:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10753 00000100:00100000:1.0:1746144891.793352:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1983:x1830965175083392:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144891.793366:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144891.793387:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945b3 expref: 84 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.793403:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945b3 expref: 84 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.793428:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727514b4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945b3 expref: 84 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.793459:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.793462:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.793470:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ba expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.793478:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ba expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.793516:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ba expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144891.793528:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172403584:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144891.793649:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144891.795058:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172403584:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144891.795078:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144891.795110:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1983:x1830965175083392:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1758us (2089us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.795119:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10753 00000100:00100000:0.0:1746144891.795280:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.795514:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175083648 00000100:00100000:3.0:1746144891.795539:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175083648 00002000:00100000:3.0:1746144891.795829:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc6d80 x1830965175083648/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.795839:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc6d80 with x1830965175083648 ext(0->4095) 00002000:00010000:3.0:1746144891.795844:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc6d80 00000100:00100000:3.0:1746144891.795860:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3961 00000100:00100000:3.0:1746144891.795867:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175083648:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144891.796532:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175083648:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 664us (1251us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.796543:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3961 00002000:00100000:3.0:1746144891.796549:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc6d80 x1830965175083648/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.796557:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc6d80 with x1830965175083648 ext(0->4095) 00002000:00010000:3.0:1746144891.796560:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc6d80 00000100:00100000:0.0:1746144891.800502:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.800591:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175083776 00000100:00100000:3.0:1746144891.800600:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175083776 00000100:00100000:3.0:1746144891.800642:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5338 00000100:00100000:3.0:1746144891.800648:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+83:31579:x1830965175083776:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.800666:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.800684:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af945c1 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.800717:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b56 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ba expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.801176:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.801180:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.801185:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c1 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.801220:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ba expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.801232:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ba expref: 5 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.801250:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172403712:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.801512:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.804040:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144891.804312:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.804416:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172403712:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.804444:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c1 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.804462:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:3.0:1746144891.804504:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31579:x1830965175083776:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3855us (4010us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.804514:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5338 00000100:00100000:3.0:1746144891.804542:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175083904 00000100:00100000:3.0:1746144891.804548:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175083904 00000100:00100000:3.0:1746144891.804586:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5339 00000100:00100000:3.0:1746144891.804594:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31565:x1830965175083904:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.804608:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.804621:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af945c8 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.804641:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.804647:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c1 expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.804652:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.804655:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c8 expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.804688:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c1 expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.804697:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c8 expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.804704:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:3.0:1746144891.804719:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31565:x1830965175083904:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 127us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.804724:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5339 00000100:00100000:1.0:1746144891.804900:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175084032 00000100:00100000:1.0:1746144891.804905:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175084032 00010000:00010000:1.0:1746144891.804924:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ba expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.805146:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10754 00000100:00100000:1.0:1746144891.805153:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175084032:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144891.805162:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144891.805183:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b56 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ba expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.805194:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b56 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ba expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.805211:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514b56 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945ba expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.805350:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.805352:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.805359:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c1 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.805367:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c1 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.805388:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c1 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.805399:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c1 expref: 84 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.805410:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172403968:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144891.806522:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144891.808325:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172403968:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144891.808345:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144891.808382:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175084032:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3229us (4068us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.808392:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10754 00000100:00100000:0.0:1746144891.809489:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.809656:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175084288 00000100:00100000:3.0:1746144891.809664:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175084288 00002000:00100000:3.0:1746144891.809706:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417ce00 x1830965175084288/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.809716:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417ce00 with x1830965175084288 ext(0->4095) 00010000:00010000:3.0:1746144891.809724:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c1 expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.809737:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c1 expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.809743:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417ce00 00000100:00100000:3.0:1746144891.809759:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1961 00000100:00100000:3.0:1746144891.809785:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175084288:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144891.809971:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175084288:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 187us (484us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.809979:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1961 00002000:00100000:3.0:1746144891.809984:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417ce00 x1830965175084288/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.809991:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417ce00 with x1830965175084288 ext(0->4095) 00010000:00010000:3.0:1746144891.809996:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c1 expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.810005:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c1 expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:3.0:1746144891.810010:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417ce00 00000100:00100000:2.0:1746144891.813937:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.814053:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144891.814119:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175084416 00000100:00100000:0.0:1746144891.814129:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175084416 00000100:00100000:0.0:1746144891.814179:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5340 00000100:00100000:0.0:1746144891.814186:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175084416:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144891.814201:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144891.814219:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af945cf expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144891.814246:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144891.814252:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c8 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144891.814257:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746144891.814260:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945cf expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144891.814297:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c8 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144891.814308:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945cf expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144891.814317:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:0.0:1746144891.814361:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175084416:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 175us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144891.814369:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5340 00000100:00100000:1.0:1746144891.814478:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175084544 00000100:00100000:1.0:1746144891.814483:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175084544 00010000:00010000:1.0:1746144891.814498:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c1 expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.814529:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10755 00000100:00100000:1.0:1746144891.814534:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1982:x1830965175084544:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144891.814542:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144891.814560:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c1 expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.814570:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c1 expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.814588:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514b5d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c1 expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.814603:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.814605:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.814610:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c8 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.814617:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c8 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.814636:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c8 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.814647:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c8 expref: 84 pid: 8430 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.814657:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172404224:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144891.814715:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a79540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.818865:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.818995:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172404224:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144891.819018:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144891.819060:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1982:x1830965175084544:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4525us (5006us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.819071:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10755 00000100:00100000:2.0:1746144891.819168:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175084800 00000100:00100000:2.0:1746144891.819175:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175084800 00002000:00100000:2.0:1746144891.819221:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417c000 x1830965175084800/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.819232:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417c000 with x1830965175084800 ext(0->4095) 00010000:00010000:2.0:1746144891.819244:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c8 expref: 84 pid: 8430 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.819258:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c8 expref: 84 pid: 8430 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.819265:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417c000 00000100:00100000:2.0:1746144891.819293:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1962 00000100:00100000:2.0:1746144891.819300:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175084800:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144891.819466:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175084800:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 166us (610us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.819473:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1962 00002000:00100000:2.0:1746144891.819478:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417c000 x1830965175084800/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.819484:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417c000 with x1830965175084800 ext(0->4095) 00010000:00010000:2.0:1746144891.819489:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c8 expref: 84 pid: 8430 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.819497:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c8 expref: 84 pid: 8430 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.819503:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417c000 00000100:00100000:0.0:1746144891.821390:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.821446:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175084928 00000100:00100000:3.0:1746144891.821453:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175084928 00000100:00100000:0.0:1746144891.821468:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.821505:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175085056 00000100:00100000:1.0:1746144891.821511:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175085056 00010000:00010000:1.0:1746144891.821529:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c8 expref: 85 pid: 8430 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.821548:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10756 00000100:00100000:1.0:1746144891.821553:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175085056:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144891.821564:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144891.821579:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c8 expref: 85 pid: 8430 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.821589:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c8 expref: 85 pid: 8430 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.821611:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945c8 expref: 85 pid: 8430 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.821627:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.821629:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.821636:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945cf expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.821643:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945cf expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.821672:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945cf expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144891.821681:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172404352:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144891.821739:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a00c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.821842:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5341 00000100:00100000:3.0:1746144891.821849:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31565:x1830965175084928:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.821859:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.821870:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af945d6 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.821887:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945cf expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.821892:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.821894:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.821897:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b72 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945d6 expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.821924:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945cf expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.821933:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945cf expref: 5 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.821942:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172404480:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.822000:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144891.824143:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172404352:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144891.824164:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144891.824213:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175085056:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2658us (2742us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.824227:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10756 00000100:00100000:0.0:1746144891.824341:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.824406:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175085312 00000100:00100000:2.0:1746144891.824412:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175085312 00002000:00100000:2.0:1746144891.824447:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417c380 x1830965175085312/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.824456:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417c380 with x1830965175085312 ext(0->4095) 00010000:00010000:2.0:1746144891.824464:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945cf expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.824475:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945cf expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.824480:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417c380 00000100:00100000:2.0:1746144891.824492:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1963 00000100:00100000:2.0:1746144891.824497:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175085312:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144891.824632:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175085312:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 135us (291us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.824637:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1963 00002000:00100000:2.0:1746144891.824641:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417c380 x1830965175085312/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.824648:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417c380 with x1830965175085312 ext(0->4095) 00010000:00010000:2.0:1746144891.824651:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945cf expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.824659:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945cf expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.824664:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417c380 00000100:00100000:3.0:1746144891.824816:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172404480:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.824834:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b72 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945d6 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.824848:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:3.0:1746144891.824870:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31565:x1830965175084928:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3022us (3489us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.824876:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5341 00000100:00100000:0.0:1746144891.826522:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144891.826598:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.826640:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175085440 00000100:00100000:3.0:1746144891.826644:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175085440 00000100:00100000:3.0:1746144891.826677:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5342 00000100:00100000:3.0:1746144891.826684:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31579:x1830965175085440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.826695:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.826709:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b79 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af945dd expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.826729:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.826735:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b72 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945d6 expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.826740:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.826748:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b79 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945dd expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.826798:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b72 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945d6 expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.826809:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b79 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945dd expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.826818:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d200, rc 0) 00000100:00100000:1.0:1746144891.826821:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175085568 00000100:00100000:1.0:1746144891.826824:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175085568 00010000:00010000:1.0:1746144891.826840:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945cf expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.826857:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31579:x1830965175085440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 173us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.826863:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5342 00000100:00100000:1.0:1746144891.826864:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10757 00000100:00100000:1.0:1746144891.826868:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175085568:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144891.826877:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144891.826896:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945cf expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.826907:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945cf expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.826925:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514b6b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945cf expref: 6 pid: 10401 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.826934:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.826935:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.826940:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b72 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945d6 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.826945:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945d6 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.826974:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945d6 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.826983:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945d6 expref: 84 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.826991:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172404736:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144891.827047:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144891.828370:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172404736:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144891.828389:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144891.828426:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175085568:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1556us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.828435:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10757 00000100:00100000:0.0:1746144891.828437:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.828633:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175085696 00000100:00100000:1.0:1746144891.828637:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175085696 00010000:00010000:1.0:1746144891.828652:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945d6 expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.828740:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10758 00000100:00100000:1.0:1746144891.828751:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175085696:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144891.828760:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144891.828798:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b72 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945d6 expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.828808:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b72 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945d6 expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.828825:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b72 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945d6 expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.828888:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.828890:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.828896:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945dd expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.828903:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945dd expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.829010:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945dd expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144891.829019:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172404864:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144891.829077:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144891.830531:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172404864:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144891.830549:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144891.830586:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175085696:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1834us (2146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.830594:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10758 00000100:00100000:0.0:1746144891.830945:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.831084:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175085952 00000100:00100000:1.0:1746144891.831090:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175085952 00002000:00100000:1.0:1746144891.831123:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417d180 x1830965175085952/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.831132:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417d180 with x1830965175085952 ext(0->4095) 00002000:00010000:1.0:1746144891.831137:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417d180 00000100:00100000:1.0:1746144891.831152:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3962 00000100:00100000:1.0:1746144891.831159:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175085952:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144891.831310:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175085952:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 151us (365us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.831316:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3962 00002000:00100000:1.0:1746144891.831320:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417d180 x1830965175085952/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.831327:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417d180 with x1830965175085952 ext(0->4095) 00002000:00010000:1.0:1746144891.831330:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417d180 00000100:00100000:0.0:1746144891.833130:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.833278:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175086080 00000100:00100000:3.0:1746144891.833285:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175086080 00000100:00100000:3.0:1746144891.833327:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5343 00000100:00100000:3.0:1746144891.833333:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175086080:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.833349:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.833366:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b80 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af945e4 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.833392:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945dd expref: 83 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.833404:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.833406:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.833409:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b80 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945e4 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.833438:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945dd expref: 83 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.833450:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945dd expref: 83 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.833460:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172404992:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.833968:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.835472:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172404992:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.835500:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b80 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945e4 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.835516:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:3.0:1746144891.835548:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175086080:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2214us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.835556:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5343 00000100:00100000:0.0:1746144891.835968:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.836072:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175086208 00000100:00100000:1.0:1746144891.836077:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175086208 00010000:00010000:1.0:1746144891.836102:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945dd expref: 84 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.836120:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10759 00000100:00100000:1.0:1746144891.836125:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175086208:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144891.836135:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144891.836156:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945dd expref: 84 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.836166:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945dd expref: 84 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.836187:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514b79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945dd expref: 84 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.836203:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.836205:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.836211:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b80 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945e4 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.836218:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945e4 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.836244:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945e4 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144891.836253:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172405120:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144891.836582:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144891.837576:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172405120:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144891.837593:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144891.837621:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1985:x1830965175086208:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1496us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.837629:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10759 00000100:00100000:0.0:1746144891.838800:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.838867:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175086464 00000100:00100000:2.0:1746144891.838874:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175086464 00000100:00100000:0.0:1746144891.838876:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00002000:00100000:2.0:1746144891.838919:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417f480 x1830965175086464/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.838934:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417f480 with x1830965175086464 ext(0->4095) 00002000:00010000:2.0:1746144891.838938:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417f480 00000100:00100000:3.0:1746144891.838990:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175086592 00000100:00100000:3.0:1746144891.838994:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175086592 00000100:00100000:2.0:1746144891.839013:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3963 00000100:00100000:3.0:1746144891.839016:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5344 00000100:00100000:2.0:1746144891.839020:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175086464:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144891.839021:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+83:31565:x1830965175086592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.839031:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.839053:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af945eb expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.839074:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b80 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945e4 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.839080:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.839082:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.839084:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945eb expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.839109:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945e4 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.839119:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945e4 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.839128:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172405248:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.839179:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.839592:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175086464:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 570us (795us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.839598:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3963 00002000:00100000:2.0:1746144891.839604:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417f480 x1830965175086464/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.839611:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417f480 with x1830965175086464 ext(0->4095) 00010000:00010000:2.0:1746144891.839616:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b80 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945e4 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.839625:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b80 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945e4 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.839631:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417f480 00000100:00100000:3.0:1746144891.840823:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172405248:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.840843:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945eb expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.840855:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:3.0:1746144891.840885:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31565:x1830965175086592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1863us (2008us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.840896:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5344 00000100:00100000:0.0:1746144891.841953:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144891.841999:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.842049:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175086848 00000100:00100000:1.0:1746144891.842055:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175086848 00000100:00100000:3.0:1746144891.842076:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175086720 00000100:00100000:3.0:1746144891.842079:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175086720 00010000:00010000:1.0:1746144891.842084:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945e4 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.842112:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10760 00000100:00100000:1.0:1746144891.842118:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175086848:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144891.842133:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144891.842135:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5345 00000100:00100000:3.0:1746144891.842139:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31579:x1830965175086720:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.842150:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144891.842153:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945e4 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.842160:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514b8e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af945f2 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.842162:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945e4 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.842180:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.842180:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514b80 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945e4 expref: 6 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:3.0:1746144891.842185:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945eb expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.842191:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.842193:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514b8e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f2 expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.842225:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945eb expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.842235:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514b8e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f2 expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.842238:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.842239:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.842244:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945eb expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.842252:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945eb expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.842368:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00010000:00010000:1.0:1746144891.842376:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945eb expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.842387:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945eb expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.842398:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172405504:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.842399:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31579:x1830965175086720:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 260us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.842404:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5345 00000100:00100000:1.0:1746144891.842449:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144891.843732:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172405504:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144891.843748:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144891.843805:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175086848:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1686us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.843812:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10760 00000100:00100000:0.0:1746144891.844021:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.844114:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175087104 00000100:00100000:2.0:1746144891.844119:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175087104 00002000:00100000:2.0:1746144891.844159:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258b800 x1830965175087104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.844168:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258b800 with x1830965175087104 ext(0->4095) 00010000:00010000:2.0:1746144891.844174:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945eb expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.844185:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945eb expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.844191:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258b800 00000100:00100000:2.0:1746144891.844214:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1964 00000100:00100000:2.0:1746144891.844222:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175087104:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144891.844385:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175087104:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 163us (364us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.844391:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1964 00002000:00100000:2.0:1746144891.844396:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258b800 x1830965175087104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.844403:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258b800 with x1830965175087104 ext(0->4095) 00010000:00010000:2.0:1746144891.844408:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945eb expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:2.0:1746144891.844417:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945eb expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00002000:00010000:2.0:1746144891.844422:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258b800 00000100:00100000:0.0:1746144891.845498:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.845575:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175087232 00000100:00100000:1.0:1746144891.845579:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175087232 00010000:00010000:1.0:1746144891.845600:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945eb expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.845620:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10761 00000100:00100000:1.0:1746144891.845632:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1982:x1830965175087232:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144891.845641:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144891.845655:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945eb expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.845665:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945eb expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.845686:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b87 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945eb expref: 85 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.845792:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.845794:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.845801:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514b8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f2 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.845810:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514b8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f2 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.845839:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514b8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f2 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144891.845849:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172405632:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144891.845911:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.848012:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.848104:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175087488 00000100:00100000:2.0:1746144891.848111:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175087488 00000100:00100000:1.0:1746144891.848223:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172405632:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144891.848243:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746144891.848251:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093f45180 x1830965175087488/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.848260:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f45180 with x1830965175087488 ext(0->4095) 00002000:00010000:2.0:1746144891.848265:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f45180 00000100:00100000:2.0:1746144891.848360:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3964 00000100:00100000:2.0:1746144891.848368:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175087488:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144891.848535:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1982:x1830965175087232:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2903us (3039us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.848544:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10761 00000100:00100000:2.0:1746144891.848601:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175087488:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 233us (596us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.848607:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3964 00002000:00100000:2.0:1746144891.848612:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093f45180 x1830965175087488/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.848619:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f45180 with x1830965175087488 ext(0->4095) 00002000:00010000:2.0:1746144891.848621:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f45180 00000100:00100000:0.0:1746144891.850350:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.850399:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175087616 00000100:00100000:3.0:1746144891.850405:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175087616 00000100:00100000:3.0:1746144891.850442:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5346 00000100:00100000:3.0:1746144891.850448:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175087616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.850461:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.850476:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b95 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af945f9 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.850501:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514b8e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f2 expref: 83 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.850508:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.850510:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.850513:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b95 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f9 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.850541:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514b8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f2 expref: 83 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.850549:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514b8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f2 expref: 83 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:3.0:1746144891.850558:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172405760:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.850630:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.851458:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172405760:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.851475:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b95 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f9 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.851490:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:3.0:1746144891.851515:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175087616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1067us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.851522:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5346 00000100:00100000:0.0:1746144891.852461:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.852529:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175087744 00000100:00100000:1.0:1746144891.852534:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175087744 00010000:00010000:1.0:1746144891.852561:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514b8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f2 expref: 84 pid: 20722 timeout: 585 lvb_type: 0 00000100:00100000:1.0:1746144891.852580:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10762 00000100:00100000:1.0:1746144891.852585:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175087744:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144891.852596:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144891.852615:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514b8e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f2 expref: 84 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.852624:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514b8e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f2 expref: 84 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.852646:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514b8e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f2 expref: 84 pid: 20722 timeout: 585 lvb_type: 0 00010000:00010000:1.0:1746144891.852672:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.852674:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.852681:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b95 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f9 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.852689:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f9 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.852715:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f9 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144891.852724:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172405888:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144891.852806:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a0480 going to sleep for 11 seconds 00000100:00100000:1.0:1746144891.854407:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172405888:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144891.854426:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144891.854456:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1985:x1830965175087744:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1870us (1996us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.854465:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10762 00000100:00100000:0.0:1746144891.854914:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.855062:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175088000 00000100:00100000:2.0:1746144891.855068:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175088000 00002000:00100000:2.0:1746144891.855107:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093f45c00 x1830965175088000/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.855117:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f45c00 with x1830965175088000 ext(0->4095) 00002000:00010000:2.0:1746144891.855121:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f45c00 00000100:00100000:2.0:1746144891.855149:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3965 00000100:00100000:2.0:1746144891.855155:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175088000:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144891.855330:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175088000:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 175us (416us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.855336:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3965 00002000:00100000:2.0:1746144891.855342:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093f45c00 x1830965175088000/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.855358:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f45c00 with x1830965175088000 ext(0->4095) 00002000:00010000:2.0:1746144891.855361:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f45c00 00000100:00100000:0.0:1746144891.856799:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.856979:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175088128 00000100:00100000:3.0:1746144891.856984:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175088128 00000100:00100000:3.0:1746144891.857014:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5347 00000100:00100000:3.0:1746144891.857020:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+83:31579:x1830965175088128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.857031:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.857047:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94600 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.857070:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b95 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f9 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.857079:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.857081:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.857084:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94600 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.857112:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f9 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.857124:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f9 expref: 5 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.857139:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172406016:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.857206:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.859635:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172406016:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144891.859656:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:3.0:1746144891.859665:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94600 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144891.859721:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175088384 00000100:00100000:1.0:1746144891.859726:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175088384 00000100:00100000:1.0:1746144891.859796:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5348 00000100:00100000:1.0:1746144891.859803:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31565:x1830965175088384:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144891.859816:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144891.859828:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94607 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.859853:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.859858:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94600 expref: 86 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.859863:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144891.859867:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94607 expref: 86 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.859894:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94600 expref: 86 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.859906:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94607 expref: 86 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.859913:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500e00, rc 0) 00000100:00100000:1.0:1746144891.859954:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31565:x1830965175088384:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 151us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.859969:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5348 00000100:00100000:0.0:1746144891.860256:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:3.0:1746144891.860319:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:3.0:1746144891.860342:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31579:x1830965175088128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3321us (3545us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.860348:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5347 00000100:00100000:1.0:1746144891.860964:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175088256 00000100:00100000:1.0:1746144891.860969:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175088256 00010000:00010000:1.0:1746144891.860990:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f9 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:0.0:1746144891.861072:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10763 00000100:00100000:0.0:1746144891.861080:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175088256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144891.861092:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144891.861114:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b95 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f9 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:0.0:1746144891.861125:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b95 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f9 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:0.0:1746144891.861146:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514b95 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af945f9 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:0.0:1746144891.861170:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144891.861171:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144891.861178:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94600 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144891.861185:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94600 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144891.861208:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94600 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144891.861223:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94600 expref: 84 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:0.0:1746144891.861289:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f44000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172406272:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144891.861640:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.866124:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.866196:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175088640 00000100:00100000:3.0:1746144891.866207:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175088640 00000100:00100000:2.0:1746144891.866216:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f44000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172406272:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.866237:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746144891.866263:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5d500 x1830965175088640/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.866273:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5d500 with x1830965175088640 ext(0->4095) 00000100:00100000:2.0:1746144891.866278:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175088256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5198us (6020us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144891.866282:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94600 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144891.866288:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10763 00010000:00010000:3.0:1746144891.866297:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94600 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144891.866304:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5d500 00000100:00100000:3.0:1746144891.866325:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1965 00000100:00100000:3.0:1746144891.866331:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175088640:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144891.866681:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175088640:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 349us (566us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.866688:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1965 00002000:00100000:3.0:1746144891.866694:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5d500 x1830965175088640/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.866701:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5d500 with x1830965175088640 ext(0->4095) 00010000:00010000:3.0:1746144891.866706:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94600 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.866714:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94600 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144891.866720:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5d500 00000100:00100000:0.0:1746144891.868524:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.868599:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175088768 00000100:00100000:3.0:1746144891.868606:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175088768 00000100:00100000:3.0:1746144891.868653:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5349 00000100:00100000:3.0:1746144891.868660:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175088768:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.868722:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.868741:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9460e expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.868795:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.868803:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94607 expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.868809:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144891.868813:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9460e expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.868871:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94607 expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.869029:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9460e expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.869041:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d200, rc 0) 00000100:00100000:3.0:1746144891.869086:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175088768:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 426us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.869092:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5349 00000100:00100000:2.0:1746144891.869105:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.869125:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175088896 00000100:00100000:3.0:1746144891.869129:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175088896 00010000:00010000:3.0:1746144891.869141:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94600 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.869796:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10764 00000100:00100000:3.0:1746144891.869804:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175088896:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.869814:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.869838:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94600 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.869851:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94600 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.869869:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514b9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94600 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.869892:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.869894:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.869900:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94607 expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.869907:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94607 expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.869928:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94607 expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.869937:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94607 expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.869949:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172406528:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.870075:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65540 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.871146:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172406528:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.871157:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.871188:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175088896:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1385us (2083us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.871194:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10764 00000100:00100000:0.0:1746144891.871978:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.872043:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175089152 00000100:00100000:3.0:1746144891.872049:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175089152 00002000:00100000:3.0:1746144891.872085:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5dc00 x1830965175089152/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.872099:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5dc00 with x1830965175089152 ext(0->4095) 00010000:00010000:3.0:1746144891.872106:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94607 expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.872118:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94607 expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144891.872125:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5dc00 00000100:00100000:3.0:1746144891.872154:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1966 00000100:00100000:3.0:1746144891.872159:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175089152:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144891.872305:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175089152:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 146us (328us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.872312:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1966 00002000:00100000:3.0:1746144891.872317:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5dc00 x1830965175089152/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.872323:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5dc00 with x1830965175089152 ext(0->4095) 00010000:00010000:3.0:1746144891.872328:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94607 expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.872335:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94607 expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144891.872341:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5dc00 00000100:00100000:0.0:1746144891.873891:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.873932:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175089280 00000100:00100000:3.0:1746144891.873937:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175089280 00000100:00100000:0.0:1746144891.873971:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.874010:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175089408 00000100:00100000:3.0:1746144891.874012:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175089408 00010000:00010000:3.0:1746144891.874025:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94607 expref: 85 pid: 10401 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144891.874086:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5350 00000100:00100000:2.0:1746144891.874097:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31565:x1830965175089280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.874106:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.874118:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bb1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94615 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.874137:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.874141:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9460e expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.874145:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144891.874147:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bb1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94615 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.874177:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9460e expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.874184:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bb1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94615 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.874192:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7d400, rc 0) 00000100:00100000:2.0:1746144891.874227:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31565:x1830965175089280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 136us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.874231:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5350 00000100:00100000:3.0:1746144891.874264:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10765 00000100:00100000:3.0:1746144891.874268:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1983:x1830965175089408:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.874275:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.874290:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94607 expref: 85 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.874298:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94607 expref: 85 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.874311:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514ba3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94607 expref: 85 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.874320:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.874321:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.874326:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9460e expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.874331:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9460e expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.874344:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9460e expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.874354:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9460e expref: 5 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.874361:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172406784:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.874403:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.876588:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.876676:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175089664 00000100:00100000:2.0:1746144891.876683:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175089664 00000100:00100000:3.0:1746144891.876714:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172406784:192.168.202.16@tcp:105: 00002000:00100000:2.0:1746144891.876730:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5fb80 x1830965175089664/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1746144891.876731:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746144891.876740:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5fb80 with x1830965175089664 ext(0->4095) 00010000:00010000:2.0:1746144891.876747:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9460e expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144891.876759:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9460e expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.876790:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1983:x1830965175089408:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2519us (2816us total) trans 0 rc 0/0 00002000:00010000:2.0:1746144891.876790:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5fb80 00000100:00100000:3.0:1746144891.876799:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10765 00000100:00100000:2.0:1746144891.876810:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1967 00000100:00100000:2.0:1746144891.876817:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175089664:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144891.876984:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175089664:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 168us (404us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.876990:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1967 00002000:00100000:2.0:1746144891.876995:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5fb80 x1830965175089664/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.877039:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5fb80 with x1830965175089664 ext(0->4095) 00010000:00010000:2.0:1746144891.877044:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9460e expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144891.877054:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9460e expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144891.877059:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5fb80 00000100:00100000:0.0:1746144891.878365:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.878432:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175089792 00000100:00100000:3.0:1746144891.878437:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175089792 00010000:00010000:3.0:1746144891.878456:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9460e expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.878486:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10766 00000100:00100000:3.0:1746144891.878492:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175089792:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.878502:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.878518:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9460e expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.878528:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9460e expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.878549:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514baa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9460e expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.878563:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.878565:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.878572:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94615 expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.878579:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94615 expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.878609:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94615 expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.878620:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172406912:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.878702:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.880339:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172406912:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.880356:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.880392:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175089792:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1900us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.880401:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10766 00000100:00100000:0.0:1746144891.880602:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.881021:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175090048 00000100:00100000:3.0:1746144891.881027:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175090048 00002000:00100000:3.0:1746144891.881063:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5c000 x1830965175090048/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.881072:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5c000 with x1830965175090048 ext(0->4095) 00002000:00010000:3.0:1746144891.881076:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5c000 00000100:00100000:3.0:1746144891.881093:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3966 00000100:00100000:3.0:1746144891.881099:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175090048:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144891.881249:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175090048:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 149us (647us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.881255:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3966 00002000:00100000:3.0:1746144891.881260:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5c000 x1830965175090048/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.881268:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5c000 with x1830965175090048 ext(0->4095) 00002000:00010000:3.0:1746144891.881270:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5c000 00000100:00100000:0.0:1746144891.882591:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.882681:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175090176 00000100:00100000:3.0:1746144891.882686:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175090176 00000100:00100000:3.0:1746144891.882815:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5351 00000100:00100000:3.0:1746144891.882823:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175090176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.882866:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.882906:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514bb8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9461c expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.882977:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bb1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94615 expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.882985:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.882987:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.882990:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514bb8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9461c expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.883081:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bb1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94615 expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.883126:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94615 expref: 83 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.883151:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172407040:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.883284:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.884871:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.884924:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175090304 00000100:00100000:2.0:1746144891.884932:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175090304 00010000:00010000:2.0:1746144891.884973:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bb1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94615 expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144891.885002:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10767 00000100:00100000:2.0:1746144891.885009:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175090304:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.885021:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.885043:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bb1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94615 expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144891.885054:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bb1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94615 expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144891.885077:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.885079:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.885087:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514bb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9461c expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.885096:0:20722:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bb1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94615 expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144891.885101:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514bb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9461c expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.885116:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172407040:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.885130:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514bb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9461c expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.885137:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514bb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9461c expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.885139:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172407168:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.885146:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:3.0:1746144891.885186:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175090176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2364us (2597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.885194:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5351 00000100:00100000:2.0:1746144891.885198:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.886098:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172407168:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.886110:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144891.886136:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1984:x1830965175090304:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1127us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.886142:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10767 00000100:00100000:0.0:1746144891.886688:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.886758:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175090560 00000100:00100000:2.0:1746144891.886779:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175090560 00002000:00100000:2.0:1746144891.886808:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5ea00 x1830965175090560/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.886814:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ea00 with x1830965175090560 ext(0->4095) 00002000:00010000:2.0:1746144891.886818:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5ea00 00000100:00100000:2.0:1746144891.886840:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3967 00000100:00100000:2.0:1746144891.886844:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175090560:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144891.887022:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175090560:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 177us (334us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.887032:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3967 00002000:00100000:2.0:1746144891.887037:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5ea00 x1830965175090560/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.887043:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ea00 with x1830965175090560 ext(0->4095) 00002000:00010000:2.0:1746144891.887045:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5ea00 00000100:00100000:0.0:1746144891.889272:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.889327:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175090688 00000100:00100000:3.0:1746144891.889333:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175090688 00000100:00100000:3.0:1746144891.889373:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5352 00000100:00100000:3.0:1746144891.889377:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+83:31579:x1830965175090688:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.889388:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.889401:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94623 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.889428:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514bb8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9461c expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.889435:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.889437:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.889440:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94623 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.889469:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514bb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9461c expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.889480:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514bb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9461c expref: 5 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.889579:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172407296:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.889660:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.891340:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172407296:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.891366:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94623 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.891392:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d200, rc 0) 00000100:00100000:3.0:1746144891.891432:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31579:x1830965175090688:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2051us (2164us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.891441:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5352 00000100:00100000:1.0:1746144891.891699:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.891743:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.891834:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175090816 00000100:00100000:3.0:1746144891.891840:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175090816 00010000:00010000:3.0:1746144891.891861:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514bb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9461c expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.891889:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10768 00000100:00100000:3.0:1746144891.891895:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175090816:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.891907:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.891926:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514bb8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9461c expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.891936:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514bb8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9461c expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.891970:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514bb8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9461c expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.891990:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.891992:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.891999:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94623 expref: 83 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.892007:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94623 expref: 83 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.892143:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94623 expref: 83 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.892153:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172407424:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.892379:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.892394:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175090944 00000100:00100000:3.0:1746144891.892397:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175090944 00000100:00100000:3.0:1746144891.892415:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5353 00000100:00100000:3.0:1746144891.892419:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31565:x1830965175090944:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.892429:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.892439:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9462a expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.892614:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94623 expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.892622:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.892623:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.892626:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9462a expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.892642:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94623 expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.892652:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94623 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.892665:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172407552:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.892698:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.893949:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172407424:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.893975:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.894014:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175090816:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2118us (2314us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.894022:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10768 00000100:00100000:2.0:1746144891.894184:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172407552:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.894201:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9462a expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.894213:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:2.0:1746144891.894236:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31565:x1830965175090944:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1816us (2492us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.894242:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5353 00000100:00100000:1.0:1746144891.895157:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.895274:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175091200 00000100:00100000:2.0:1746144891.895279:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175091200 00002000:00100000:2.0:1746144891.895320:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932abb80 x1830965175091200/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.895330:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932abb80 with x1830965175091200 ext(0->4095) 00010000:00010000:2.0:1746144891.895335:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94623 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144891.895346:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94623 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144891.895357:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932abb80 00000100:00100000:2.0:1746144891.895384:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1968 00000100:00100000:2.0:1746144891.895391:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175091200:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144891.895643:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175091200:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 252us (487us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.895650:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1968 00002000:00100000:2.0:1746144891.895655:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932abb80 x1830965175091200/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.895662:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932abb80 with x1830965175091200 ext(0->4095) 00010000:00010000:2.0:1746144891.895666:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94623 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144891.895674:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94623 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144891.895679:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932abb80 00000100:00100000:0.0:1746144891.897555:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.897741:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175091328 00000100:00100000:2.0:1746144891.897749:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175091328 00000100:00100000:2.0:1746144891.897813:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5354 00000100:00100000:2.0:1746144891.897820:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175091328:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.897835:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.897854:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94631 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.898114:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.898121:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9462a expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.898127:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144891.898130:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94631 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.898165:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9462a expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.898175:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94631 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.898182:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7d200, rc 0) 00000100:00100000:0.0:1746144891.898379:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.898553:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175091328:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 408us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.898573:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5354 00000100:00100000:3.0:1746144891.898690:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175091456 00000100:00100000:3.0:1746144891.898695:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175091456 00010000:00010000:3.0:1746144891.898717:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94623 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.898736:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10769 00000100:00100000:3.0:1746144891.898740:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1983:x1830965175091456:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.898749:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.898801:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94623 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.898811:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94623 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.899032:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514bbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94623 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.899058:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.899059:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.899066:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9462a expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.899073:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9462a expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.899148:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9462a expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.899159:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9462a expref: 84 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.899170:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172407808:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.899481:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.900591:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172407808:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.900607:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.900646:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1983:x1830965175091456:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1904us (2265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.900655:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10769 00000100:00100000:2.0:1746144891.901424:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.901751:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175091712 00000100:00100000:3.0:1746144891.901757:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175091712 00002000:00100000:3.0:1746144891.901820:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e830380 x1830965175091712/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.901830:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e830380 with x1830965175091712 ext(0->4095) 00010000:00010000:3.0:1746144891.901839:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9462a expref: 84 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.901851:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9462a expref: 84 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144891.901858:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e830380 00000100:00100000:3.0:1746144891.902639:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1969 00000100:00100000:3.0:1746144891.902649:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175091712:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144891.902915:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175091712:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 267us (1491us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144891.902921:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1969 00002000:00100000:3.0:1746144891.902941:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e830380 x1830965175091712/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144891.902949:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e830380 with x1830965175091712 ext(0->4095) 00010000:00010000:3.0:1746144891.902985:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9462a expref: 84 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.903005:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9462a expref: 84 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144891.903011:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e830380 00000100:00100000:0.0:1746144891.905317:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.905394:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175091840 00000100:00100000:0.0:1746144891.905399:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.905401:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175091840 00000100:00100000:2.0:1746144891.905503:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5355 00000100:00100000:2.0:1746144891.905512:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31565:x1830965175091840:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.905549:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.905568:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bd4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94638 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.905618:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.905624:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94631 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.905630:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00000100:00100000:3.0:1746144891.905700:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175091968 00000100:00100000:3.0:1746144891.905713:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175091968 00010000:00010000:3.0:1746144891.905730:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9462a expref: 86 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.905846:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10770 00000100:00100000:3.0:1746144891.905864:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175091968:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.905892:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.906071:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bd4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94638 expref: 86 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.906315:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9462a expref: 86 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.906331:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9462a expref: 86 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.906352:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514bc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9462a expref: 86 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144891.906444:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94631 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.906458:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bd4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94638 expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.906467:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.906469:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.906474:0:20722:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94631 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.906482:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94631 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.906498:0:20722:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94631 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.906510:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94631 expref: 5 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144891.906526:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172408064:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.906700:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.906728:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175091968:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 876us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.906736:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10770 00000100:00100000:2.0:1746144891.907369:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.909063:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172408064:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144891.909088:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7d400, rc 0) 00000100:00100000:2.0:1746144891.909130:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31565:x1830965175091840:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3619us (3818us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.909138:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5355 00000100:00100000:1.0:1746144891.911186:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.911267:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175092224 00000100:00100000:2.0:1746144891.911274:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175092224 00002000:00100000:2.0:1746144891.911320:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932aa680 x1830965175092224/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.911330:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932aa680 with x1830965175092224 ext(0->4095) 00010000:00010000:2.0:1746144891.911338:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94631 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144891.911351:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94631 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144891.911358:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932aa680 00000100:00100000:2.0:1746144891.911630:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1970 00000100:00100000:2.0:1746144891.911640:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175092224:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144891.912019:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175092224:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 380us (837us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.912030:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1970 00002000:00100000:2.0:1746144891.912036:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932aa680 x1830965175092224/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.912043:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932aa680 with x1830965175092224 ext(0->4095) 00010000:00010000:2.0:1746144891.912049:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94631 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144891.912058:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94631 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144891.912064:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932aa680 00000100:00100000:0.0:1746144891.914681:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.914797:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175092352 00000100:00100000:3.0:1746144891.914882:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175092352 00010000:00010000:3.0:1746144891.914916:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94631 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.914965:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10771 00000100:00100000:3.0:1746144891.914974:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175092352:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.914986:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.915007:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94631 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.915018:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94631 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.915041:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514bcd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94631 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.915065:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.915068:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.915075:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94638 expref: 83 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.915083:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94638 expref: 83 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.915116:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94638 expref: 83 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.915126:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172408192:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.915203:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.917852:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172408192:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.917873:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.917927:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175092352:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2953us (3252us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.917937:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10771 00000100:00100000:0.0:1746144891.918602:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.919002:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175092608 00000100:00100000:2.0:1746144891.919010:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175092608 00002000:00100000:2.0:1746144891.919054:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5df80 x1830965175092608/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.919063:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5df80 with x1830965175092608 ext(0->4095) 00002000:00010000:2.0:1746144891.919068:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5df80 00000100:00100000:2.0:1746144891.919094:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3968 00000100:00100000:2.0:1746144891.919102:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175092608:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144891.919274:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175092608:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 172us (673us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.919280:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3968 00002000:00100000:2.0:1746144891.919286:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5df80 x1830965175092608/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.919300:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5df80 with x1830965175092608 ext(0->4095) 00002000:00010000:2.0:1746144891.919303:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5df80 00000100:00100000:0.0:1746144891.921612:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.922155:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175092736 00000100:00100000:2.0:1746144891.922163:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175092736 00000100:00100000:2.0:1746144891.922209:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5356 00000100:00100000:2.0:1746144891.922217:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175092736:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.922231:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.922247:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514bdb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9463f expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.922273:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bd4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94638 expref: 83 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.922280:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.922282:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.922285:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514bdb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9463f expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.922313:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94638 expref: 83 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.922324:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bd4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94638 expref: 83 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144891.922335:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172408320:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144891.923377:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.924318:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172408320:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.924348:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514bdb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9463f expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.924366:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7c000, rc 0) 00000100:00100000:2.0:1746144891.924417:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175092736:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2200us (2811us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.924425:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5356 00000100:00100000:0.0:1746144891.924995:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.925244:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175092864 00000100:00100000:3.0:1746144891.925252:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175092864 00010000:00010000:3.0:1746144891.925278:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bd4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94638 expref: 84 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.925529:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10772 00000100:00100000:3.0:1746144891.925536:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175092864:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.925553:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.925577:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bd4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94638 expref: 84 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.925589:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bd4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94638 expref: 84 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.925613:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514bd4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94638 expref: 84 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.925640:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.925642:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.925650:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514bdb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9463f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.925657:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514bdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9463f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.925689:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514bdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9463f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.925700:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172408448:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.925790:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.928094:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.928150:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175093120 00000100:00100000:2.0:1746144891.928158:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175093120 00002000:00100000:2.0:1746144891.928209:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5e300 x1830965175093120/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.928219:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5e300 with x1830965175093120 ext(0->4095) 00002000:00010000:2.0:1746144891.928224:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5e300 00000100:00100000:2.0:1746144891.928246:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3969 00000100:00100000:2.0:1746144891.928254:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175093120:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144891.928297:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172408448:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.928357:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.928395:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1985:x1830965175092864:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2858us (3400us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.928407:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10772 00000100:00100000:2.0:1746144891.928424:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175093120:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 170us (336us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.928430:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3969 00002000:00100000:2.0:1746144891.928435:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5e300 x1830965175093120/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.928442:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5e300 with x1830965175093120 ext(0->4095) 00002000:00010000:2.0:1746144891.928446:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5e300 00000100:00100000:2.0:1746144891.928998:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.929119:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175093248 00000100:00100000:3.0:1746144891.929123:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175093248 00000100:00100000:3.0:1746144891.929155:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5357 00000100:00100000:3.0:1746144891.929161:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+83:31565:x1830965175093248:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.929171:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.929186:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94646 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.929298:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514bdb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9463f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.929305:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.929307:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.929311:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94646 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.929337:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514bdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9463f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.929349:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514bdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9463f expref: 5 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.929359:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172408576:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.929422:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.930350:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.930391:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175093376 00000100:00100000:2.0:1746144891.930395:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175093376 00000100:00100000:2.0:1746144891.930431:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5358 00000100:00100000:2.0:1746144891.930437:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31579:x1830965175093376:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.930447:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.930456:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514be9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9464d expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.930470:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.930475:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94646 expref: 86 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.930480:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.930483:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514be9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9464d expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.930494:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172408576:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.930501:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94646 expref: 86 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.930507:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94646 expref: 86 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.930510:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514be9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9464d expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.930516:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00010000:00010000:2.0:1746144891.930516:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7d200, rc 0) 00000100:00100000:3.0:1746144891.930550:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31565:x1830965175093248:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1389us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.930550:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31579:x1830965175093376:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 113us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.930556:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5358 00000100:00100000:3.0:1746144891.930558:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5357 00000100:00100000:0.0:1746144891.931105:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.931169:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175093504 00000100:00100000:3.0:1746144891.931172:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175093504 00010000:00010000:3.0:1746144891.931187:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514bdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9463f expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.931211:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10773 00000100:00100000:3.0:1746144891.931216:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175093504:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.931224:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.931243:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514bdb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9463f expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.931281:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514bdb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9463f expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.931299:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514bdb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9463f expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.931312:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.931314:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.931320:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94646 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.931327:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94646 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.931347:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94646 expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.931355:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94646 expref: 84 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.931363:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172408832:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.931498:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.932925:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.932953:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172408832:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.932982:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.933015:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175093504:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1798us (1909us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.933023:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10773 00000100:00100000:1.0:1746144891.933054:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175093760 00000100:00100000:1.0:1746144891.933059:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175093760 00002000:00100000:1.0:1746144891.933095:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093854000 x1830965175093760/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.933104:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854000 with x1830965175093760 ext(0->4095) 00010000:00010000:1.0:1746144891.933111:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94646 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144891.933121:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94646 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144891.933136:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093854000 00000100:00100000:1.0:1746144891.933160:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1971 00000100:00100000:1.0:1746144891.933167:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175093760:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144891.933321:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175093760:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 154us (400us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.933326:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1971 00002000:00100000:1.0:1746144891.933331:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093854000 x1830965175093760/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.933338:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854000 with x1830965175093760 ext(0->4095) 00010000:00010000:1.0:1746144891.933342:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94646 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144891.933349:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94646 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144891.933359:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093854000 00000100:00100000:0.0:1746144891.935116:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.935187:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175093888 00000100:00100000:3.0:1746144891.935193:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175093888 00010000:00010000:3.0:1746144891.935216:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94646 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.935236:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10774 00000100:00100000:3.0:1746144891.935242:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093857b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175093888:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.935252:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.935270:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94646 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.935280:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94646 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.935300:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514be2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94646 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.935312:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.935314:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.935322:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514be9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9464d expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.935329:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514be9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9464d expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.935356:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514be9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9464d expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.935367:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172408960:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.935430:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.936501:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172408960:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.936515:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.936603:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093857b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175093888:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1359us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.936611:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10774 00000100:00100000:0.0:1746144891.937026:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.937079:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175094144 00000100:00100000:2.0:1746144891.937085:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175094144 00002000:00100000:2.0:1746144891.937119:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093855f80 x1830965175094144/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.937128:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093855f80 with x1830965175094144 ext(0->4095) 00002000:00010000:2.0:1746144891.937133:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093855f80 00000100:00100000:2.0:1746144891.937201:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3970 00000100:00100000:2.0:1746144891.937208:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175094144:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144891.937362:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175094144:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 154us (336us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.937368:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3970 00002000:00100000:2.0:1746144891.937373:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093855f80 x1830965175094144/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.937380:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093855f80 with x1830965175094144 ext(0->4095) 00002000:00010000:2.0:1746144891.937382:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093855f80 00000100:00100000:0.0:1746144891.939242:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.939385:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175094272 00000100:00100000:3.0:1746144891.939392:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175094272 00000100:00100000:3.0:1746144891.939938:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5359 00000100:00100000:3.0:1746144891.939947:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175094272:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.940062:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.940080:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514bf0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94654 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.940109:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514be9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9464d expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.940115:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.940117:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144891.940120:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514bf0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94654 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.940149:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514be9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9464d expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.940161:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514be9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9464d expref: 83 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.940171:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172409088:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.940262:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.941573:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172409088:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.941600:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514bf0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94654 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.941619:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:3.0:1746144891.941663:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175094272:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1716us (2426us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.941671:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5359 00000100:00100000:0.0:1746144891.942022:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.942316:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175094400 00000100:00100000:3.0:1746144891.942322:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175094400 00010000:00010000:3.0:1746144891.942426:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514be9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9464d expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.942638:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10775 00000100:00100000:3.0:1746144891.942645:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175094400:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.942657:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.942676:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514be9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9464d expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.942687:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514be9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9464d expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.942709:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514be9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9464d expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.942738:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.942741:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.942748:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514bf0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94654 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.942760:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94654 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.942803:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94654 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.942817:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172409216:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.942862:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.946816:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172409216:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.946840:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.946890:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1984:x1830965175094400:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4243us (4866us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.946901:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10775 00000100:00100000:0.0:1746144891.947434:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.947555:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175094656 00000100:00100000:1.0:1746144891.947562:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175094656 00002000:00100000:1.0:1746144891.947601:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093855500 x1830965175094656/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.947611:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093855500 with x1830965175094656 ext(0->4095) 00002000:00010000:1.0:1746144891.947615:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093855500 00000100:00100000:1.0:1746144891.947645:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3971 00000100:00100000:1.0:1746144891.947652:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175094656:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:0.0:1746144891.948120:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.948191:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175094656:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 539us (759us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.948197:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3971 00002000:00100000:1.0:1746144891.948202:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093855500 x1830965175094656/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.948208:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093855500 with x1830965175094656 ext(0->4095) 00002000:00010000:1.0:1746144891.948211:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093855500 00000100:00100000:3.0:1746144891.948265:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175094784 00000100:00100000:3.0:1746144891.948269:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175094784 00000100:00100000:3.0:1746144891.948754:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5360 00000100:00100000:3.0:1746144891.948779:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+83:31565:x1830965175094784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.948790:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144891.948807:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9465b expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.948833:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514bf0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94654 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.948840:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.948842:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.948845:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 84 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.948892:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514bf0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94654 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.948903:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514bf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94654 expref: 5 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.948914:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172409344:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.948985:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.953184:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144891.953277:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.953501:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175095040 00000100:00100000:2.0:1746144891.953510:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175095040 00000100:00100000:2.0:1746144891.953566:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5361 00000100:00100000:2.0:1746144891.953573:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31579:x1830965175095040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.953592:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.953608:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514bfe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94662 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.953635:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.953640:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 86 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.953651:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.953655:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514bfe lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94662 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.953691:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 86 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.953704:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514bfe lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94662 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.953713:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7dc00, rc 0) 00000100:00100000:2.0:1746144891.953749:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31579:x1830965175095040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 177us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.953755:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5361 00000100:00100000:3.0:1746144891.953843:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175094912 00000100:00100000:3.0:1746144891.953847:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175094912 00010000:00010000:3.0:1746144891.953864:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514bf0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94654 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.953880:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10776 00000100:00100000:3.0:1746144891.953885:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175094912:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.953892:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.953910:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514bf0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94654 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.953921:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514bf0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94654 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.953936:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.953937:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.953944:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.953952:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.953982:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.953993:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.954005:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172409600:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.954053:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65540 going to sleep for 11 seconds 00010000:00010000:3.0:1746144891.954083:0:20722:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514bf0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94654 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.954097:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172409344:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144891.954110:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.954117:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.954124:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:3.0:1746144891.954139:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31565:x1830965175094784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5379us (6020us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.954147:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5360 00000100:00100000:0.0:1746144891.960107:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.960553:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172409600:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.960573:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.960622:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175094912:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6736us (7343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.960633:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10776 00000100:00100000:1.0:1746144891.961254:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175095296 00000100:00100000:1.0:1746144891.961263:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175095296 00002000:00100000:1.0:1746144891.961303:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093857480 x1830965175095296/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.961313:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093857480 with x1830965175095296 ext(0->4095) 00010000:00010000:1.0:1746144891.961321:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144891.961339:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144891.961346:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093857480 00000100:00100000:1.0:1746144891.962136:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1972 00000100:00100000:1.0:1746144891.962145:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175095296:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144891.962328:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175095296:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 184us (2231us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.962335:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1972 00002000:00100000:1.0:1746144891.962341:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093857480 x1830965175095296/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.962348:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093857480 with x1830965175095296 ext(0->4095) 00010000:00010000:1.0:1746144891.962353:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144891.962362:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144891.962367:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093857480 00000100:00100000:0.0:1746144891.964537:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.964624:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175095424 00000100:00100000:3.0:1746144891.964631:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175095424 00010000:00010000:3.0:1746144891.964661:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.964749:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10777 00000100:00100000:3.0:1746144891.964756:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1983:x1830965175095424:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.964898:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.964918:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.964931:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.964953:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514bf7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9465b expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.965461:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.965464:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.965472:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514bfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94662 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.965481:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514bfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94662 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.965514:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514bfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94662 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.965525:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172409728:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.965606:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.966924:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172409728:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.966939:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.966975:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1983:x1830965175095424:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2219us (2443us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.966984:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10777 00000100:00100000:0.0:1746144891.967126:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.967332:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175095680 00000100:00100000:1.0:1746144891.967338:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175095680 00002000:00100000:1.0:1746144891.967369:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093854380 x1830965175095680/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.967378:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854380 with x1830965175095680 ext(0->4095) 00002000:00010000:1.0:1746144891.967383:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093854380 00000100:00100000:1.0:1746144891.967396:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3972 00000100:00100000:1.0:1746144891.967400:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175095680:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144891.967538:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175095680:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 137us (412us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.967543:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3972 00002000:00100000:1.0:1746144891.967548:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093854380 x1830965175095680/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.967555:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854380 with x1830965175095680 ext(0->4095) 00002000:00010000:1.0:1746144891.967557:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093854380 00000100:00100000:0.0:1746144891.968847:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.968973:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175095808 00000100:00100000:1.0:1746144891.968979:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175095808 00000100:00100000:1.0:1746144891.969022:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5362 00000100:00100000:1.0:1746144891.969029:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009969a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175095808:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144891.969041:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144891.969058:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94669 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.969083:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514bfe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94662 expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.969091:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144891.969092:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144891.969095:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c05 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94669 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.969127:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514bfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94662 expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.969139:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514bfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94662 expref: 83 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144891.969149:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172409856:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144891.969213:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144891.970877:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172409856:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144891.970901:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c05 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94669 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144891.970905:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:1.0:1746144891.970916:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500e00, rc 0) 00000100:00100000:1.0:1746144891.970953:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009969a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175095808:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1924us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.970971:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5362 00000100:00100000:3.0:1746144891.971185:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175095936 00000100:00100000:3.0:1746144891.971191:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175095936 00010000:00010000:3.0:1746144891.971215:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514bfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94662 expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.971275:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10778 00000100:00100000:3.0:1746144891.971282:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175095936:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.971293:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.971315:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514bfe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94662 expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.971326:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514bfe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94662 expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.971349:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514bfe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94662 expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.971361:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.971363:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.971370:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c05 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94669 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.971378:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94669 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.971405:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94669 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.971415:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172409984:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.971699:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.972377:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172409984:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.972386:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.972403:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1985:x1830965175095936:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1122us (1498us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.972410:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10778 00000100:00100000:0.0:1746144891.975022:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.975082:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175096192 00000100:00100000:2.0:1746144891.975091:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175096192 00002000:00100000:2.0:1746144891.975137:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093854e00 x1830965175096192/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.975148:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854e00 with x1830965175096192 ext(0->4095) 00002000:00010000:2.0:1746144891.975153:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093854e00 00000100:00100000:2.0:1746144891.975187:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3973 00000100:00100000:2.0:1746144891.975195:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175096192:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144891.975388:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175096192:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 194us (374us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144891.975398:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3973 00002000:00100000:2.0:1746144891.975403:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093854e00 x1830965175096192/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.975410:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854e00 with x1830965175096192 ext(0->4095) 00002000:00010000:2.0:1746144891.975413:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093854e00 00000100:00100000:0.0:1746144891.977698:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144891.977825:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.977883:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175096320 00000100:00100000:1.0:1746144891.977891:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175096320 00000100:00100000:1.0:1746144891.977926:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175096448 00000100:00100000:1.0:1746144891.977928:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175096448 00000100:00100000:2.0:1746144891.977940:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5363 00000100:00100000:1.0:1746144891.978036:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5364 00000100:00100000:1.0:1746144891.978046:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31565:x1830965175096448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144891.978062:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144891.978074:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31579:x1830965175096320:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144891.978080:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94677 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.978082:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.978090:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94670 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.978110:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c05 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94669 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.978248:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.978249:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.978254:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94670 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.978281:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144891.978287:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94670 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.978294:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144891.978297:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94677 expref: 86 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.978322:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94669 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.978327:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94670 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.978334:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94669 expref: 5 pid: 10401 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144891.978346:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172410112:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144891.978347:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94677 expref: 86 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144891.978356:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500c00, rc 0) 00000100:00100000:1.0:1746144891.978403:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31565:x1830965175096448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 361us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144891.978409:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5364 00000100:00100000:2.0:1746144891.978427:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144891.979949:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.980019:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172410112:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.980040:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94670 expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.980052:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7c000, rc 0) 00000100:00100000:2.0:1746144891.980076:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31579:x1830965175096320:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2129us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.980082:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5363 00000100:00100000:3.0:1746144891.980243:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175096576 00000100:00100000:3.0:1746144891.980248:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175096576 00010000:00010000:3.0:1746144891.980269:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94669 expref: 6 pid: 10401 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.980743:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10779 00000100:00100000:3.0:1746144891.980750:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175096576:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.980760:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.980799:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94669 expref: 6 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.980809:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94669 expref: 6 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.980828:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94669 expref: 6 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.980874:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.980876:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.980883:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94670 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.980891:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94670 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.980916:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94670 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.980926:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94670 expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.980940:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172410368:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.981753:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.983653:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172410368:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.983672:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.983714:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175096576:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2964us (3766us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.983723:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10779 00000100:00100000:0.0:1746144891.984737:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.985161:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175096832 00000100:00100000:1.0:1746144891.985169:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175096832 00002000:00100000:1.0:1746144891.985213:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093856300 x1830965175096832/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.985223:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093856300 with x1830965175096832 ext(0->4095) 00010000:00010000:1.0:1746144891.985231:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94670 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144891.985249:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94670 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144891.985256:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093856300 00000100:00100000:1.0:1746144891.985287:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1973 00000100:00100000:1.0:1746144891.985294:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175096832:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144891.985472:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175096832:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 177us (736us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.985478:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1973 00002000:00100000:1.0:1746144891.985483:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093856300 x1830965175096832/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.985489:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093856300 with x1830965175096832 ext(0->4095) 00010000:00010000:1.0:1746144891.985494:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94670 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144891.985913:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94670 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144891.985919:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093856300 00000100:00100000:0.0:1746144891.988725:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.989084:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175096960 00000100:00100000:2.0:1746144891.989092:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175096960 00000100:00100000:2.0:1746144891.989140:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5365 00000100:00100000:2.0:1746144891.989147:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175096960:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144891.989164:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746144891.989167:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1746144891.989181:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9467e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.989208:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144891.989214:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94677 expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.989219:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175097088 00010000:00010000:2.0:1746144891.989220:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00000100:00100000:3.0:1746144891.989223:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175097088 00010000:00010000:2.0:1746144891.989224:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.989244:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94670 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144891.989265:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94677 expref: 85 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144891.989275:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10780 00000100:00100000:3.0:1746144891.989280:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1982:x1830965175097088:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144891.989284:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.989291:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144891.989294:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7dc00, rc 0) 00010000:00010000:3.0:1746144891.989311:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94670 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.989322:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94670 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.989342:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7c000/0x4076af6727514c13 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94670 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.989371:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.989373:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.989379:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94677 expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.989386:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94677 expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.989408:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94677 expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.989414:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175096960:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 266us (696us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144891.989418:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94677 expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144891.989420:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5365 00000100:00100000:3.0:1746144891.989429:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172410624:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.989495:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144891.992004:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172410624:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.992025:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.992073:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1982:x1830965175097088:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2791us (2904us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.992083:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10780 00000100:00100000:0.0:1746144891.992191:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144891.992340:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175097344 00000100:00100000:1.0:1746144891.992346:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175097344 00002000:00100000:1.0:1746144891.992380:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181f480 x1830965175097344/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.992389:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181f480 with x1830965175097344 ext(0->4095) 00010000:00010000:1.0:1746144891.992397:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94677 expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144891.992408:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94677 expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144891.992414:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181f480 00000100:00100000:1.0:1746144891.992426:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1974 00000100:00100000:1.0:1746144891.992431:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175097344:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144891.992593:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175097344:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 162us (403us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144891.992599:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1974 00002000:00100000:1.0:1746144891.992604:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181f480 x1830965175097344/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144891.992611:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181f480 with x1830965175097344 ext(0->4095) 00010000:00010000:1.0:1746144891.992615:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94677 expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144891.992623:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94677 expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144891.992629:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181f480 00000100:00100000:0.0:1746144891.995396:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144891.995519:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144891.995583:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175097472 00000100:00100000:3.0:1746144891.995592:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175097472 00000100:00100000:2.0:1746144891.995600:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175097600 00000100:00100000:2.0:1746144891.995604:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175097600 00010000:00010000:3.0:1746144891.995625:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94677 expref: 85 pid: 10401 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144891.995663:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10781 00000100:00100000:3.0:1746144891.995670:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175097472:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144891.995685:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144891.995705:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94677 expref: 85 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.995717:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94677 expref: 85 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.995739:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514c0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94677 expref: 85 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.995754:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144891.995757:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746144891.995795:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5366 00010000:00010000:3.0:1746144891.995800:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144891.995802:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31565:x1830965175097600:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144891.995809:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.995815:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144891.995827:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c21 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94685 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.995850:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.995856:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.995858:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144891.995861:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c21 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94685 expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144891.995871:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.995879:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.995894:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 5 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144891.995902:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 5 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144891.995905:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172410880:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144891.995912:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172410752:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144891.995987:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.995988:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746144891.998155:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172410880:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144891.998187:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c21 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94685 expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144891.998200:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7d400, rc 0) 00000100:00100000:2.0:1746144891.998245:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31565:x1830965175097600:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2443us (2855us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144891.998252:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5366 00000100:00100000:3.0:1746144891.998940:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172410752:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144891.998952:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144891.998991:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175097472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3322us (3472us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144891.998999:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10781 00000100:00100000:0.0:1746144891.999509:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144891.999610:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175097856 00000100:00100000:2.0:1746144891.999616:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175097856 00002000:00100000:2.0:1746144891.999651:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181e680 x1830965175097856/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/0 e 0 to 0 dl 1746144902 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144891.999660:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181e680 with x1830965175097856 ext(0->4095) 00010000:00010000:2.0:1746144891.999667:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144891.999804:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144891.999818:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181e680 00000100:00100000:2.0:1746144891.999842:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1975 00000100:00100000:2.0:1746144891.999850:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175097856:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144892.000029:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175097856:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 180us (521us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.000036:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1975 00002000:00100000:2.0:1746144892.000041:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181e680 x1830965175097856/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:532/0 lens 488/4536 e 0 to 0 dl 1746144902 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.000049:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181e680 with x1830965175097856 ext(0->4095) 00010000:00010000:2.0:1746144892.000053:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.000062:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.000067:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181e680 00000100:00100000:0.0:1746144892.002057:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.002129:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.002516:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175098112 00000100:00100000:2.0:1746144892.002525:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175098112 00000100:00100000:3.0:1746144892.002622:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175097984 00000100:00100000:3.0:1746144892.002626:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175097984 00010000:00010000:3.0:1746144892.002646:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 7 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.002852:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5367 00000100:00100000:2.0:1746144892.002861:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:31579:x1830965175098112:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.002874:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.002889:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514c28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9468c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.002916:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.002921:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c21 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94685 expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.002927:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.002930:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514c28 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9468c expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.002978:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c21 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94685 expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.002991:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514c28 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9468c expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.003000:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7d200, rc 0) 00000100:00100000:3.0:1746144892.003072:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10782 00000100:00100000:3.0:1746144892.003077:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1984:x1830965175097984:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.003086:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.003104:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 8 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.003113:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 8 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.003130:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c1a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9467e expref: 8 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.003145:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.003147:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.003153:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94685 expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.003160:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94685 expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.003180:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94685 expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.003192:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94685 expref: 83 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.003203:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172411136:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.003507:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:31579:x1830965175098112:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 646us (1375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.003513:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5367 00000100:00100000:3.0:1746144892.003622:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.006791:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172411136:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.006812:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144892.006986:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.007095:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175098240 00000100:00100000:1.0:1746144892.007101:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175098240 00010000:00010000:1.0:1746144892.007131:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94685 expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.007175:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10783 00000100:00100000:1.0:1746144892.007182:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1982:x1830965175098240:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.007194:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.007214:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c21 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94685 expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.007225:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94685 expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.007246:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94685 expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.007269:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.007272:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.007278:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514c28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9468c expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.007286:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514c28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9468c expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.007317:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514c28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9468c expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.007328:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172411264:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.007418:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175097984:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4338us (5365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.007426:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10782 00000100:00100000:1.0:1746144892.008111:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a53a00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.010301:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172411264:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.010323:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.010372:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1982:x1830965175098240:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3188us (3384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.010382:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10783 00000100:00100000:0.0:1746144892.010952:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.011446:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175098496 00000100:00100000:1.0:1746144892.011452:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175098496 00002000:00100000:1.0:1746144892.011491:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181d880 x1830965175098496/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.011500:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181d880 with x1830965175098496 ext(0->4095) 00002000:00010000:1.0:1746144892.011504:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009181d880 00000100:00100000:1.0:1746144892.012370:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3974 00000100:00100000:1.0:1746144892.012380:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175098496:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144892.012572:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175098496:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 193us (1620us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.012578:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3974 00002000:00100000:1.0:1746144892.012584:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181d880 x1830965175098496/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.012592:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181d880 with x1830965175098496 ext(0->4095) 00002000:00010000:1.0:1746144892.012595:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009181d880 00000100:00100000:0.0:1746144892.015868:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.015937:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175098624 00000100:00100000:2.0:1746144892.015946:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175098624 00000100:00100000:2.0:1746144892.016007:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5368 00000100:00100000:2.0:1746144892.016015:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+83:31579:x1830965175098624:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.016034:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.016054:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94693 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.016086:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514c28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9468c expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.016094:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.016096:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.016099:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94693 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.016129:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514c28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9468c expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.016141:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514c28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9468c expref: 5 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.016153:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172411392:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.016435:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.017016:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.017249:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175098752 00000100:00100000:1.0:1746144892.017254:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175098752 00000100:00100000:1.0:1746144892.017289:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5369 00000100:00100000:1.0:1746144892.017296:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31565:x1830965175098752:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144892.017307:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144892.017315:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9469a expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.017329:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.017333:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94693 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.017338:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144892.017341:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9469a expref: 86 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.017364:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94693 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.017375:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9469a expref: 86 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.017384:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500e00, rc 0) 00000100:00100000:1.0:1746144892.017418:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31565:x1830965175098752:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 122us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.017424:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5369 00000100:00100000:3.0:1746144892.017947:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172411392:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.017978:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94693 expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.017986:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7d400, rc 0) 00000100:00100000:3.0:1746144892.018015:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31579:x1830965175098624:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2002us (2154us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.018021:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5368 00000100:00100000:0.0:1746144892.019202:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.019344:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175098880 00000100:00100000:1.0:1746144892.019351:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175098880 00010000:00010000:1.0:1746144892.019378:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514c28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9468c expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.019410:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10784 00000100:00100000:1.0:1746144892.019418:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175098880:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.019429:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.019450:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514c28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9468c expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.019461:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514c28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9468c expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.019481:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514c28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9468c expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.019510:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.019511:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.019519:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94693 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.019527:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94693 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.019553:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94693 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.019564:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94693 expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.019574:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172411648:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.019642:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.021713:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172411648:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.021730:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.021784:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175098880:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2366us (2584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.021792:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10784 00000100:00100000:0.0:1746144892.023039:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.023114:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175099136 00000100:00100000:3.0:1746144892.023122:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175099136 00002000:00100000:3.0:1746144892.023266:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181e300 x1830965175099136/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.023277:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181e300 with x1830965175099136 ext(0->4095) 00010000:00010000:3.0:1746144892.023285:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94693 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.023297:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94693 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.023303:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181e300 00000100:00100000:3.0:1746144892.023320:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1976 00000100:00100000:3.0:1746144892.023327:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175099136:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144892.024163:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175099136:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 835us (1125us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.024171:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1976 00002000:00100000:3.0:1746144892.024177:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181e300 x1830965175099136/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.024184:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181e300 with x1830965175099136 ext(0->4095) 00010000:00010000:3.0:1746144892.024189:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94693 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.024198:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94693 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.024203:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181e300 00000100:00100000:0.0:1746144892.025916:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.026300:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175099264 00000100:00100000:3.0:1746144892.026312:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175099264 00000100:00100000:3.0:1746144892.026362:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5370 00000100:00100000:3.0:1746144892.026370:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175099264:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.026384:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.026401:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af946a1 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.026429:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.026436:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9469a expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.026441:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144892.026444:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a1 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.026482:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9469a expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.026494:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a1 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.026504:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:3.0:1746144892.026539:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175099264:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 171us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.026545:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5370 00000100:00100000:0.0:1746144892.026546:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.026608:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175099392 00000100:00100000:1.0:1746144892.026612:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175099392 00010000:00010000:1.0:1746144892.026629:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94693 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.026653:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10785 00000100:00100000:1.0:1746144892.026658:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175099392:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.026666:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.026686:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94693 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.026696:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94693 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.026714:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d400/0x4076af6727514c2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94693 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.026737:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.026738:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.026745:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9469a expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.026752:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9469a expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.026797:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9469a expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.026808:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9469a expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.026824:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172411904:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.026889:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.029667:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172411904:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.029688:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.029801:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175099392:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3141us (3253us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.029811:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10785 00000100:00100000:0.0:1746144892.029850:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.030079:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175099648 00000100:00100000:3.0:1746144892.030085:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175099648 00002000:00100000:3.0:1746144892.030121:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093441180 x1830965175099648/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.030135:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093441180 with x1830965175099648 ext(0->4095) 00010000:00010000:3.0:1746144892.030143:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9469a expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.030156:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9469a expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.030162:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093441180 00000100:00100000:3.0:1746144892.030183:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1977 00000100:00100000:3.0:1746144892.030190:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175099648:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144892.030351:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175099648:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 162us (501us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.030358:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1977 00002000:00100000:3.0:1746144892.030362:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093441180 x1830965175099648/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.030369:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093441180 with x1830965175099648 ext(0->4095) 00010000:00010000:3.0:1746144892.030373:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9469a expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.030381:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9469a expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.030386:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093441180 00000100:00100000:0.0:1746144892.031381:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.031489:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175099904 00000100:00100000:1.0:1746144892.031494:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175099904 00000100:00100000:0.0:1746144892.031536:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.031552:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5371 00000100:00100000:1.0:1746144892.031559:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31565:x1830965175099904:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144892.031568:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144892.031582:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514c44 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af946a8 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.031603:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144892.031609:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.031619:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144892.031623:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514c44 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a8 expref: 85 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.031656:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.031667:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514c44 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a8 expref: 85 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.031678:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500400, rc 0) 00000100:00100000:1.0:1746144892.031717:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31565:x1830965175099904:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 158us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.031723:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5371 00000100:00100000:1.0:1746144892.031739:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175099776 00000100:00100000:1.0:1746144892.031741:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175099776 00010000:00010000:1.0:1746144892.031752:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9469a expref: 85 pid: 10401 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.032022:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10786 00000100:00100000:1.0:1746144892.032028:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093441500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175099776:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.032036:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.032053:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9469a expref: 85 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.032062:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9469a expref: 85 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.032079:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514c36 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9469a expref: 85 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.032090:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.032091:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.032097:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.032104:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.032121:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.032130:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a1 expref: 5 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.032140:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172412160:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.032577:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.034078:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172412160:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.034094:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.034208:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093441500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175099776:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2178us (2670us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.034217:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10786 00000100:00100000:0.0:1746144892.034736:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.034803:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175100160 00000100:00100000:3.0:1746144892.034809:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175100160 00002000:00100000:3.0:1746144892.034841:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093442a00 x1830965175100160/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.034850:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093442a00 with x1830965175100160 ext(0->4095) 00010000:00010000:3.0:1746144892.034857:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a1 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.034867:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a1 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.034873:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093442a00 00000100:00100000:3.0:1746144892.034897:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1978 00000100:00100000:3.0:1746144892.034904:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175100160:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144892.035073:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175100160:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 168us (337us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.035078:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1978 00002000:00100000:3.0:1746144892.035083:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093442a00 x1830965175100160/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.035090:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093442a00 with x1830965175100160 ext(0->4095) 00010000:00010000:3.0:1746144892.035095:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a1 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.035103:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a1 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.035108:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093442a00 00000100:00100000:0.0:1746144892.036946:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.037228:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175100288 00000100:00100000:1.0:1746144892.037235:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175100288 00010000:00010000:1.0:1746144892.037260:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a1 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.037291:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10787 00000100:00100000:1.0:1746144892.037298:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093442300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175100288:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.037308:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.037326:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a1 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.037336:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a1 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.037359:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514c3d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a1 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.037389:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.037391:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.037399:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514c44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a8 expref: 83 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.037406:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514c44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a8 expref: 83 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.037439:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514c44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a8 expref: 83 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.037450:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172412288:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.037527:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.038892:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172412288:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.038907:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.038934:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093442300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175100288:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1636us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.038942:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10787 00000100:00100000:0.0:1746144892.039289:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.039490:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175100544 00000100:00100000:1.0:1746144892.039495:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175100544 00002000:00100000:1.0:1746144892.039524:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093443480 x1830965175100544/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.039533:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093443480 with x1830965175100544 ext(0->4095) 00002000:00010000:1.0:1746144892.039537:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093443480 00000100:00100000:1.0:1746144892.039691:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3975 00000100:00100000:1.0:1746144892.039698:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175100544:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144892.039992:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175100544:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 294us (703us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.039998:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3975 00002000:00100000:1.0:1746144892.040003:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093443480 x1830965175100544/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.040011:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093443480 with x1830965175100544 ext(0->4095) 00002000:00010000:1.0:1746144892.040013:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093443480 00000100:00100000:0.0:1746144892.041863:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.042091:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175100672 00000100:00100000:2.0:1746144892.042098:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175100672 00000100:00100000:2.0:1746144892.042678:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5372 00000100:00100000:2.0:1746144892.042687:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175100672:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.042701:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.042718:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514c4b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af946af expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.042745:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514c44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a8 expref: 83 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.042757:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.042759:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.042782:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514c4b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946af expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.042812:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514c44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a8 expref: 83 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.042824:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514c44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a8 expref: 83 pid: 10401 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.042834:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172412416:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.042948:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.045116:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172412416:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.045150:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514c4b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946af expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.045166:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0caa00, rc 0) 00000100:00100000:0.0:1746144892.045264:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.045336:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175100672:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2650us (3477us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.045344:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5372 00000100:00100000:1.0:1746144892.045437:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175100800 00000100:00100000:1.0:1746144892.045442:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175100800 00010000:00010000:1.0:1746144892.045467:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514c44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a8 expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.045508:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10788 00000100:00100000:1.0:1746144892.045514:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093441880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175100800:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.045528:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.045549:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514c44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a8 expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.045560:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514c44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a8 expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.045581:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514c44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946a8 expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.045596:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.045598:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.045604:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514c4b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946af expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.045611:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514c4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946af expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.045638:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514c4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946af expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.045649:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172412544:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.045804:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.048133:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172412544:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.048152:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.048188:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093441880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1985:x1830965175100800:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2675us (2925us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.048197:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10788 00000100:00100000:0.0:1746144892.049125:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.049325:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175101056 00000100:00100000:1.0:1746144892.049331:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175101056 00002000:00100000:1.0:1746144892.049371:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093441c00 x1830965175101056/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.049380:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093441c00 with x1830965175101056 ext(0->4095) 00002000:00010000:1.0:1746144892.049384:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093441c00 00000100:00100000:1.0:1746144892.049412:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3976 00000100:00100000:1.0:1746144892.049419:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175101056:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144892.049581:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175101056:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 163us (458us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.049587:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3976 00002000:00100000:1.0:1746144892.049593:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093441c00 x1830965175101056/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.049599:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093441c00 with x1830965175101056 ext(0->4095) 00002000:00010000:1.0:1746144892.049602:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093441c00 00000100:00100000:0.0:1746144892.053419:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.053479:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175101184 00000100:00100000:2.0:1746144892.053488:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175101184 00000100:00100000:2.0:1746144892.053554:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5373 00000100:00100000:2.0:1746144892.053563:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+83:31565:x1830965175101184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.053584:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.053604:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af946b6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.053632:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514c4b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946af expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.053640:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.053642:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.053644:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946b6 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.053674:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514c4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946af expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.053686:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514c4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946af expref: 5 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.053699:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172412672:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.053819:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.054703:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.055031:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175101312 00000100:00100000:1.0:1746144892.055035:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175101312 00000100:00100000:1.0:1746144892.055070:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5374 00000100:00100000:1.0:1746144892.055076:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31579:x1830965175101312:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144892.055085:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144892.055095:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514c59 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af946bd expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.055113:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.055382:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946b6 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.055390:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144892.055393:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514c59 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946bd expref: 86 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.055643:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946b6 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.055655:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514c59 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946bd expref: 86 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.055664:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501200, rc 0) 00000100:00100000:1.0:1746144892.055696:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31579:x1830965175101312:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 621us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.055701:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5374 00000100:00100000:3.0:1746144892.056610:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172412672:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.056631:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946b6 expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.056639:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cc800, rc 0) 00000100:00100000:3.0:1746144892.056664:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31565:x1830965175101184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3103us (3255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.056670:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5373 00000100:00100000:0.0:1746144892.057065:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.057495:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175101440 00000100:00100000:1.0:1746144892.057500:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175101440 00010000:00010000:1.0:1746144892.057523:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514c4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946af expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.057915:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10789 00000100:00100000:1.0:1746144892.057923:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175101440:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.057934:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.057968:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514c4b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946af expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.057979:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514c4b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946af expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.058001:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514c4b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946af expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.058024:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.058026:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.058032:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946b6 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.058041:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946b6 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.058068:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946b6 expref: 84 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.058079:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946b6 expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.058445:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172412928:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.058514:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.059740:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172412928:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.059755:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144892.059892:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.059897:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175101440:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1974us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.059906:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10789 00000100:00100000:1.0:1746144892.059935:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175101696 00000100:00100000:3.0:1746144892.060068:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965172413056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746144892.060152:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175101696 00000100:00100000:3.0:1746144892.060184:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:1.0:1746144892.060186:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac85180 x1830965175101696/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.060196:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac85180 with x1830965175101696 ext(0->4095) 00010000:00010000:1.0:1746144892.060203:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946b6 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.060218:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946b6 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.060224:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac85180 00000100:00100000:1.0:1746144892.060244:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1979 00000100:00100000:1.0:1746144892.060251:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175101696:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144892.060424:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175101696:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 173us (534us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.060430:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1979 00000100:00100000:2.0:1746144892.060434:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172413056 00002000:00100000:1.0:1746144892.060435:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac85180 x1830965175101696/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1746144892.060437:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172413056 00002000:00100000:1.0:1746144892.060442:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac85180 with x1830965175101696 ext(0->4095) 00010000:00010000:1.0:1746144892.060446:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946b6 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.060454:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946b6 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.060459:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac85180 00000100:00100000:2.0:1746144892.060466:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1746144892.060476:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1830965172413056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746144892.060488:0:8434:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 361037824 pending 66453504 free 3855613952 avail 3853516800 00000100:00100000:2.0:1746144892.060520:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1830965172413056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.060528:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:3.0:1746144892.060664:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746144892.060690:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965172413056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746144892.062850:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.062928:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175101824 00000100:00100000:1.0:1746144892.062935:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175101824 00010000:00010000:1.0:1746144892.062978:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946b6 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.063014:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10790 00000100:00100000:1.0:1746144892.063021:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175101824:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.063033:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.063053:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946b6 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.063064:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946b6 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.063088:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514c52 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946b6 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.063107:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.063110:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.063121:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514c59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946bd expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.063133:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514c59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946bd expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.063165:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514c59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946bd expref: 84 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.063176:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172413184:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.063256:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.066030:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.066131:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172413184:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.066151:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.066232:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175102080 00000100:00100000:2.0:1746144892.066238:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175102080 00002000:00100000:2.0:1746144892.066281:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac84000 x1830965175102080/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.066290:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac84000 with x1830965175102080 ext(0->4095) 00002000:00010000:2.0:1746144892.066295:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac84000 00000100:00100000:2.0:1746144892.066326:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3977 00000100:00100000:2.0:1746144892.066332:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175102080:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144892.066426:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175101824:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3400us (3577us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.066435:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10790 00000100:00100000:2.0:1746144892.067161:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175102080:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 828us (1138us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.067167:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3977 00002000:00100000:2.0:1746144892.067172:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac84000 x1830965175102080/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.067179:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac84000 with x1830965175102080 ext(0->4095) 00002000:00010000:2.0:1746144892.067182:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac84000 00000100:00100000:2.0:1746144892.071827:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.072397:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175102208 00000100:00100000:3.0:1746144892.072406:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175102208 00000100:00100000:3.0:1746144892.072465:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5375 00000100:00100000:3.0:1746144892.072475:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175102208:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.072492:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.072509:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af946c4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.072538:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514c59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946bd expref: 83 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.072545:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.072547:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.072551:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946c4 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.072583:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514c59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946bd expref: 83 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.072594:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514c59 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946bd expref: 83 pid: 10401 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.072606:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172413312:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.072684:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.074332:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172413312:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.074354:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946c4 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.074368:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:3.0:1746144892.074412:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175102208:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1938us (2595us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.074420:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5375 00000100:00100000:0.0:1746144892.076117:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.076783:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175102336 00000100:00100000:1.0:1746144892.076790:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175102336 00010000:00010000:1.0:1746144892.076824:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514c59 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946bd expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.076862:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10791 00000100:00100000:1.0:1746144892.076874:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175102336:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.076888:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.076914:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514c59 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946bd expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.076930:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514c59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946bd expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.076952:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514c59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946bd expref: 84 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.076991:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.076993:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.077000:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946c4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.077008:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946c4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.077040:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946c4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.077052:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172413440:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.077119:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.078142:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.078321:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175102464 00000100:00100000:3.0:1746144892.078326:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175102464 00000100:00100000:3.0:1746144892.078368:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5376 00000100:00100000:3.0:1746144892.078375:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31565:x1830965175102464:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.078389:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.078403:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af946cb expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.078424:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946c4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.078431:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.078433:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.078436:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946cb expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.078458:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946c4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.078469:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946c4 expref: 5 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.078478:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172413568:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.078544:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.080833:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172413568:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.080860:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946cb expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.080874:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:3.0:1746144892.080909:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31565:x1830965175102464:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2534us (2769us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.080917:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5376 00000100:00100000:1.0:1746144892.081319:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172413440:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.081331:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.081362:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175102336:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4489us (5250us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.081370:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10791 00000100:00100000:0.0:1746144892.081394:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.081570:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175102720 00000100:00100000:3.0:1746144892.081575:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175102720 00002000:00100000:3.0:1746144892.081607:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac84a80 x1830965175102720/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.081623:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac84a80 with x1830965175102720 ext(0->4095) 00010000:00010000:3.0:1746144892.081629:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946c4 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.081641:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946c4 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.081648:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac84a80 00000100:00100000:3.0:1746144892.081819:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1980 00000100:00100000:3.0:1746144892.081826:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175102720:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144892.082007:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175102720:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 180us (613us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.082013:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1980 00002000:00100000:3.0:1746144892.082018:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac84a80 x1830965175102720/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.082024:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac84a80 with x1830965175102720 ext(0->4095) 00010000:00010000:3.0:1746144892.082029:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946c4 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.082037:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946c4 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.082042:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac84a80 00000100:00100000:0.0:1746144892.084942:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.085061:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175102848 00000100:00100000:1.0:1746144892.085070:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175102848 00010000:00010000:1.0:1746144892.085104:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946c4 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.085140:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10792 00000100:00100000:1.0:1746144892.085148:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175102848:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.085160:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.085180:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946c4 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.085192:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946c4 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.085215:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514c60 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946c4 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.085239:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.085242:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.085249:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946cb expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.085258:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946cb expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.085287:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946cb expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.085298:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172413696:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.085377:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.089064:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.089158:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172413696:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.089178:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.089382:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175103104 00000100:00100000:2.0:1746144892.089388:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175103104 00002000:00100000:2.0:1746144892.089431:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801391d3800 x1830965175103104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.089440:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d3800 with x1830965175103104 ext(0->4095) 00002000:00010000:2.0:1746144892.089443:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801391d3800 00000100:00100000:1.0:1746144892.089727:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175102848:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4578us (4792us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.089737:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10792 00000100:00100000:2.0:1746144892.089929:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3978 00000100:00100000:2.0:1746144892.089937:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175103104:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.090090:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175103104:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 154us (1035us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.090096:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3978 00002000:00100000:2.0:1746144892.090100:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801391d3800 x1830965175103104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.090107:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d3800 with x1830965175103104 ext(0->4095) 00002000:00010000:2.0:1746144892.090109:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801391d3800 00000100:00100000:0.0:1746144892.097747:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.097890:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175103232 00000100:00100000:3.0:1746144892.097901:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175103232 00000100:00100000:3.0:1746144892.097964:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5377 00000100:00100000:3.0:1746144892.097972:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175103232:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.097992:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.098012:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af946d2 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.098044:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946cb expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.098052:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.098054:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.098058:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d2 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.098088:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946cb expref: 83 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.098099:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946cb expref: 83 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.098110:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172413824:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.098192:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.099398:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172413824:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.099416:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d2 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.099433:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:3.0:1746144892.100187:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175103232:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2214us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.100195:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5377 00000100:00100000:0.0:1746144892.104265:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.104395:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175103360 00000100:00100000:3.0:1746144892.104404:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175103360 00002000:00100000:3.0:1746144892.104447:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8801391d3b80 x1830965175103360/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 496/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.104456:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d3b80 with x1830965175103360 ext(0->7) 00010000:00010000:3.0:1746144892.104464:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946cb expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.104477:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946cb expref: 84 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.104483:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801391d3b80 00000100:00100000:3.0:1746144892.105430:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1981 00000100:00100000:3.0:1746144892.105439:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175103360:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144892.105785:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1985:x1830965175103360:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 347us (1528us total) trans 4294968005 rc 0/0 00000100:00100000:3.0:1746144892.105792:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1981 00002000:00100000:3.0:1746144892.105797:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8801391d3b80 x1830965175103360/t4294968005(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 496/448 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.105811:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d3b80 with x1830965175103360 ext(0->7) 00010000:00010000:3.0:1746144892.105816:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946cb expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.105826:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946cb expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.105832:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801391d3b80 00000100:00100000:0.0:1746144892.107925:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.108244:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175103488 00000100:00100000:1.0:1746144892.108253:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175103488 00010000:00010000:1.0:1746144892.108285:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946cb expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.108353:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10793 00000100:00100000:1.0:1746144892.108360:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1982:x1830965175103488:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.108372:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.108392:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946cb expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.108404:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946cb expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.108428:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514c67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946cb expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.108562:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.108564:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.108572:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d2 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.108585:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d2 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.108619:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d2 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.108631:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172413952:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.109468:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.110003:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.110094:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175103616 00000100:00100000:3.0:1746144892.110098:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175103616 00000100:00100000:3.0:1746144892.110133:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5378 00000100:00100000:3.0:1746144892.110139:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31565:x1830965175103616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.110151:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.110163:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af946d9 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.110181:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d2 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.110187:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.110188:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.110191:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d9 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.110208:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d2 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.110222:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d2 expref: 5 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.110230:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172414080:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.110277:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.112580:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.112738:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172413952:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.112758:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.112816:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1982:x1830965175103488:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4456us (4898us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.112827:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10793 00000100:00100000:3.0:1746144892.112899:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172414080:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.112919:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d9 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.112935:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:3.0:1746144892.112962:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31565:x1830965175103616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2815us (2952us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.112968:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5378 00000100:00100000:2.0:1746144892.113032:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175103872 00000100:00100000:2.0:1746144892.113038:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175103872 00002000:00100000:2.0:1746144892.113077:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801391d1880 x1830965175103872/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.113086:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d1880 with x1830965175103872 ext(0->4095) 00010000:00010000:2.0:1746144892.113092:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d2 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.113104:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d2 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.113110:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801391d1880 00000100:00100000:2.0:1746144892.113125:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1982 00000100:00100000:2.0:1746144892.113131:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175103872:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144892.113294:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175103872:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 163us (720us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.113303:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1982 00002000:00100000:2.0:1746144892.113308:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801391d1880 x1830965175103872/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.113315:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d1880 with x1830965175103872 ext(0->4095) 00010000:00010000:2.0:1746144892.113319:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d2 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.113328:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d2 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.113333:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801391d1880 00000100:00100000:0.0:1746144892.115523:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.116161:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.116238:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175104128 00000100:00100000:1.0:1746144892.116247:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175104128 00010000:00010000:1.0:1746144892.116280:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d2 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.116321:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10794 00000100:00100000:1.0:1746144892.116328:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175104128:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.116341:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.116360:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d2 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.116372:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d2 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.116395:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c6e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d2 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.116412:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.116414:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.116422:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d9 expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.116430:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d9 expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.116464:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d9 expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.116476:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172414208:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.116547:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.116850:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175104000 00000100:00100000:3.0:1746144892.116855:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175104000 00000100:00100000:3.0:1746144892.116887:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5379 00000100:00100000:3.0:1746144892.116893:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31579:x1830965175104000:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.116905:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.116915:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514c7c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af946e0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.116932:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d9 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.116941:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.116943:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.116946:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514c7c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e0 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.116970:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d9 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.116981:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d9 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.116990:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172414336:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.117028:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.118826:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172414336:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.118853:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514c7c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e0 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.118867:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:3.0:1746144892.118900:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31579:x1830965175104000:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2006us (3383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.118907:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5379 00000100:00100000:1.0:1746144892.118987:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172414208:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.118998:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.119016:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175104128:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2690us (2856us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.119024:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10794 00000100:00100000:0.0:1746144892.119195:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.119309:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175104384 00000100:00100000:3.0:1746144892.119315:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175104384 00002000:00100000:3.0:1746144892.119343:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093257480 x1830965175104384/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.119357:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257480 with x1830965175104384 ext(0->4095) 00010000:00010000:3.0:1746144892.119363:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d9 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.119374:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d9 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.119380:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093257480 00000100:00100000:3.0:1746144892.119404:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1983 00000100:00100000:3.0:1746144892.119411:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1984:x1830965175104384:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144892.119560:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1984:x1830965175104384:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 149us (365us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.119566:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1983 00002000:00100000:3.0:1746144892.119571:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093257480 x1830965175104384/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.119577:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257480 with x1830965175104384 ext(0->4095) 00010000:00010000:3.0:1746144892.119582:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d9 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.119590:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d9 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.119596:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093257480 00000100:00100000:0.0:1746144892.122615:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.122704:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175104512 00000100:00100000:1.0:1746144892.122713:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175104512 00010000:00010000:1.0:1746144892.122748:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d9 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.122812:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10795 00000100:00100000:1.0:1746144892.122820:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1983:x1830965175104512:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.122833:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.122854:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d9 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.122865:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d9 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.122889:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946d9 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.122914:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.122916:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.122923:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514c7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e0 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.122931:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514c7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e0 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.122975:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514c7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e0 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.122988:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172414464:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.123073:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.127137:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.127419:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175104768 00000100:00100000:2.0:1746144892.127429:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175104768 00002000:00100000:2.0:1746144892.127480:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093257800 x1830965175104768/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.127490:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257800 with x1830965175104768 ext(0->4095) 00002000:00010000:2.0:1746144892.127495:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093257800 00000100:00100000:2.0:1746144892.127529:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3979 00000100:00100000:1.0:1746144892.127702:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172414464:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.127719:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.127731:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1984:x1830965175104768:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144892.127795:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1983:x1830965175104512:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4975us (5189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.127804:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10795 00000100:00100000:2.0:1746144892.128257:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175104768:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 528us (1129us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.128264:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3979 00002000:00100000:2.0:1746144892.128269:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093257800 x1830965175104768/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.128285:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257800 with x1830965175104768 ext(0->4095) 00002000:00010000:2.0:1746144892.128287:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093257800 00000100:00100000:0.0:1746144892.130722:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.130864:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175104896 00000100:00100000:3.0:1746144892.130872:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175104896 00000100:00100000:3.0:1746144892.130922:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5380 00000100:00100000:3.0:1746144892.130930:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175104896:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.130945:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.130974:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af946e7 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.131004:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514c7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e0 expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.131012:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.131014:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.131017:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e7 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.131047:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514c7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e0 expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.131058:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514c7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e0 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.131069:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172414592:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.131936:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.132623:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172414592:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.132647:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e7 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.132668:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:3.0:1746144892.132885:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175104896:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1954us (2170us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.132894:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5380 00000100:00100000:0.0:1746144892.134863:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.135506:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175105024 00000100:00100000:1.0:1746144892.135514:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175105024 00010000:00010000:1.0:1746144892.135552:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514c7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e0 expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.135587:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10796 00000100:00100000:1.0:1746144892.135594:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175105024:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.135606:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.135627:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514c7c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e0 expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.135638:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514c7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e0 expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.135659:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514c7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e0 expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.135674:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.135676:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.135683:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e7 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.135691:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e7 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.135720:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e7 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.135730:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172414720:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.135830:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.137715:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.138943:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175105152 00000100:00100000:3.0:1746144892.138952:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175105152 00000100:00100000:3.0:1746144892.139016:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5381 00000100:00100000:3.0:1746144892.139024:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31565:x1830965175105152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.139041:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.139058:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af946ee expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.139084:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e7 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.139092:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.139094:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.139097:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946ee expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.139126:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e7 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.139138:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e7 expref: 5 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.139155:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172414848:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.139241:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.139860:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.139911:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172414720:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144892.139928:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144892.139973:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1984:x1830965175105024:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4378us (5114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144892.139983:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10796 00000100:00100000:3.0:1746144892.140251:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175105408 00000100:00100000:3.0:1746144892.140255:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175105408 00002000:00100000:3.0:1746144892.140283:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093256300 x1830965175105408/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.140292:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256300 with x1830965175105408 ext(0->4095) 00010000:00010000:3.0:1746144892.140299:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e7 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.140310:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e7 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.140315:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093256300 00000100:00100000:3.0:1746144892.140329:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1984 00000100:00100000:3.0:1746144892.140335:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175105408:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144892.140502:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175105408:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 162us (639us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.140509:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1984 00002000:00100000:3.0:1746144892.140514:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093256300 x1830965175105408/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.140521:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256300 with x1830965175105408 ext(0->4095) 00010000:00010000:3.0:1746144892.140525:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e7 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.140534:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e7 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.140539:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093256300 00000100:00100000:3.0:1746144892.146030:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172414848:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.146188:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946ee expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.146208:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:3.0:1746144892.147577:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31565:x1830965175105152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 8546us (9859us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.147587:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5381 00000100:00100000:2.0:1746144892.147706:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.147854:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.147929:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175105664 00000100:00100000:1.0:1746144892.147937:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175105664 00010000:00010000:1.0:1746144892.147976:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e7 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.147999:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10797 00000100:00100000:1.0:1746144892.148006:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175105664:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.148018:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.148038:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e7 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.148049:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e7 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.148072:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514c83 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946e7 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.148088:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.148091:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.148098:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946ee expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.148110:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946ee expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.148140:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946ee expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.148151:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172414976:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.148223:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.148485:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175105536 00000100:00100000:3.0:1746144892.148489:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175105536 00000100:00100000:3.0:1746144892.148987:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5382 00000100:00100000:3.0:1746144892.148994:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31579:x1830965175105536:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.149007:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.149019:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c91 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af946f5 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.149042:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946ee expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.149049:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.149051:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.149054:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c91 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946f5 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.149074:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946ee expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.149083:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946ee expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.149092:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172415104:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.150191:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.151263:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.151557:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172415104:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.151584:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c91 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946f5 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.151602:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7dc00, rc 0) 00000100:00100000:2.0:1746144892.151647:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31579:x1830965175105536:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2652us (3941us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.151656:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5382 00000100:00100000:3.0:1746144892.151721:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175105920 00000100:00100000:3.0:1746144892.151727:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175105920 00002000:00100000:3.0:1746144892.151782:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093257b80 x1830965175105920/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.151791:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257b80 with x1830965175105920 ext(0->4095) 00010000:00010000:3.0:1746144892.151798:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946ee expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.151809:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946ee expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.151816:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093257b80 00000100:00100000:3.0:1746144892.151831:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1985 00000100:00100000:3.0:1746144892.151837:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175105920:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144892.151992:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175105920:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 155us (733us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.152001:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1985 00002000:00100000:3.0:1746144892.152006:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093257b80 x1830965175105920/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.152014:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257b80 with x1830965175105920 ext(0->4095) 00010000:00010000:3.0:1746144892.152019:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946ee expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.152027:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946ee expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.152034:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093257b80 00000100:00100000:1.0:1746144892.152097:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172414976:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.152109:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.152128:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175105664:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4123us (4275us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.152136:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10797 00000100:00100000:0.0:1746144892.155444:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.155569:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175106048 00000100:00100000:1.0:1746144892.155579:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175106048 00010000:00010000:1.0:1746144892.155616:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946ee expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.155830:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10798 00000100:00100000:1.0:1746144892.155838:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1982:x1830965175106048:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.155850:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.155870:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946ee expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.155881:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946ee expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.155902:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514c8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946ee expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.155933:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.155935:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.155942:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946f5 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.155949:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946f5 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.155989:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946f5 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.156000:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172415232:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.156067:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.158876:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.159036:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172415232:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.159056:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.159097:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1982:x1830965175106048:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3258us (3662us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.159108:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10798 00000100:00100000:2.0:1746144892.159895:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175106304 00000100:00100000:2.0:1746144892.159902:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175106304 00002000:00100000:2.0:1746144892.159946:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093255c00 x1830965175106304/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.159966:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093255c00 with x1830965175106304 ext(0->4095) 00002000:00010000:2.0:1746144892.159970:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093255c00 00000100:00100000:2.0:1746144892.160312:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3980 00000100:00100000:2.0:1746144892.160320:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175106304:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.160493:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175106304:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 174us (1626us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.160499:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3980 00002000:00100000:2.0:1746144892.160503:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093255c00 x1830965175106304/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.160511:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093255c00 with x1830965175106304 ext(0->4095) 00002000:00010000:2.0:1746144892.160514:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093255c00 00000100:00100000:0.0:1746144892.163005:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.163133:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175106432 00000100:00100000:2.0:1746144892.163141:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175106432 00000100:00100000:2.0:1746144892.163190:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5383 00000100:00100000:2.0:1746144892.163198:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175106432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.163212:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.163230:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514c98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af946fc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.163257:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946f5 expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.163265:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.163267:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.163271:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514c98 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946fc expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.163301:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946f5 expref: 85 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.163313:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946f5 expref: 85 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.163324:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172415360:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.163931:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.165465:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172415360:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.165493:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514c98 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946fc expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.165508:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cdc00, rc 0) 00000100:00100000:2.0:1746144892.165542:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175106432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2344us (2543us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.165549:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5383 00000100:00100000:0.0:1746144892.166897:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.166984:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175106560 00000100:00100000:1.0:1746144892.166991:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175106560 00010000:00010000:1.0:1746144892.167018:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946f5 expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.167056:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10799 00000100:00100000:1.0:1746144892.167064:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1985:x1830965175106560:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.167077:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.167098:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946f5 expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.167108:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946f5 expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.167131:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514c91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946f5 expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.167158:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.167160:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.167167:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514c98 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946fc expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.167175:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514c98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946fc expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.167202:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514c98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946fc expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.167212:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172415488:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.167271:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.168996:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172415488:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.169014:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.169043:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175106560:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1979us (2149us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.169052:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10799 00000100:00100000:0.0:1746144892.169471:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.169599:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175106816 00000100:00100000:3.0:1746144892.169605:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175106816 00002000:00100000:3.0:1746144892.169638:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093255f80 x1830965175106816/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.169647:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093255f80 with x1830965175106816 ext(0->4095) 00002000:00010000:3.0:1746144892.169652:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093255f80 00000100:00100000:3.0:1746144892.169677:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3981 00000100:00100000:3.0:1746144892.169683:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175106816:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144892.169869:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175106816:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 186us (399us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.169875:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3981 00002000:00100000:3.0:1746144892.169880:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093255f80 x1830965175106816/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.169893:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093255f80 with x1830965175106816 ext(0->4095) 00002000:00010000:3.0:1746144892.169896:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093255f80 00000100:00100000:0.0:1746144892.171135:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.171278:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175106944 00000100:00100000:2.0:1746144892.171283:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175106944 00000100:00100000:2.0:1746144892.171314:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5384 00000100:00100000:2.0:1746144892.171320:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31565:x1830965175106944:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.171330:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.171345:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94703 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.171370:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514c98 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946fc expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.171377:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.171379:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.171382:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94703 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.171409:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514c98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946fc expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.171419:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514c98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946fc expref: 5 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.171429:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172415616:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.172846:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.174963:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.175122:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175107072 00000100:00100000:2.0:1746144892.175130:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175107072 00000100:00100000:2.0:1746144892.175180:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5385 00000100:00100000:2.0:1746144892.175189:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31579:x1830965175107072:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.175205:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.175222:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ca6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9470a expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.175249:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.175255:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94703 expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.175260:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.175263:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ca6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9470a expref: 88 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.175300:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94703 expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.175312:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ca6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9470a expref: 88 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.175320:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:3.0:1746144892.175590:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172415616:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.175607:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94703 expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.175615:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cc000, rc 0) 00000100:00100000:2.0:1746144892.176775:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31579:x1830965175107072:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1574us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.176783:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5385 00000100:00100000:3.0:1746144892.176851:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31565:x1830965175106944:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5530us (5719us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.176857:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5384 00000100:00100000:0.0:1746144892.177188:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.177253:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175107200 00000100:00100000:1.0:1746144892.177258:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175107200 00010000:00010000:1.0:1746144892.177282:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514c98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946fc expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.177311:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10800 00000100:00100000:1.0:1746144892.177317:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175107200:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.177328:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.177350:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514c98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946fc expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.177361:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514c98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946fc expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.177381:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514c98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af946fc expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.177406:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.177408:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.177416:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94703 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.177423:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94703 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.177451:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94703 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.177463:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94703 expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.177475:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172415872:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.177546:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.180638:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172415872:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.180659:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.180711:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175107200:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3392us (3521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.180722:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10800 00000100:00100000:0.0:1746144892.181825:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.182447:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175107456 00000100:00100000:2.0:1746144892.182456:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175107456 00002000:00100000:2.0:1746144892.182506:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258ea00 x1830965175107456/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.182516:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258ea00 with x1830965175107456 ext(0->4095) 00010000:00010000:2.0:1746144892.182524:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94703 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.182537:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94703 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.182543:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258ea00 00000100:00100000:2.0:1746144892.182570:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1986 00000100:00100000:2.0:1746144892.182577:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175107456:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144892.182744:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175107456:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 167us (922us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.182751:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1986 00002000:00100000:2.0:1746144892.182757:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258ea00 x1830965175107456/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.182784:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258ea00 with x1830965175107456 ext(0->4095) 00010000:00010000:2.0:1746144892.182789:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94703 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.182803:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94703 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.182809:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258ea00 00000100:00100000:0.0:1746144892.185288:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.185399:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175107584 00000100:00100000:1.0:1746144892.185409:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175107584 00010000:00010000:1.0:1746144892.185444:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94703 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.185490:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10801 00000100:00100000:1.0:1746144892.185497:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1982:x1830965175107584:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.185510:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.185527:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94703 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.185543:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94703 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.185562:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514c9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94703 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.186038:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.186041:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.186048:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ca6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9470a expref: 86 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.186055:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ca6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9470a expref: 86 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.186086:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ca6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9470a expref: 86 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.186096:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172416000:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.186171:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.187799:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.188017:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175107840 00000100:00100000:2.0:1746144892.188026:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175107840 00002000:00100000:2.0:1746144892.188075:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258fb80 x1830965175107840/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.188085:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258fb80 with x1830965175107840 ext(0->4095) 00002000:00010000:2.0:1746144892.188090:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258fb80 00000100:00100000:2.0:1746144892.188119:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3982 00000100:00100000:2.0:1746144892.188126:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175107840:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144892.188303:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175107840:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 176us (538us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.188310:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3982 00002000:00100000:2.0:1746144892.188315:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258fb80 x1830965175107840/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.188323:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258fb80 with x1830965175107840 ext(0->4095) 00002000:00010000:2.0:1746144892.188326:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258fb80 00000100:00100000:1.0:1746144892.188415:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172416000:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.188432:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.188468:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1982:x1830965175107584:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2971us (3188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.188475:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10801 00000100:00100000:0.0:1746144892.190671:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.190808:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175107968 00000100:00100000:3.0:1746144892.190814:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175107968 00000100:00100000:3.0:1746144892.190919:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5386 00000100:00100000:3.0:1746144892.190927:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175107968:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.190943:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.190973:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514cad lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94711 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.191005:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ca6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9470a expref: 85 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.191014:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.191016:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.191019:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514cad lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94711 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.191054:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ca6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9470a expref: 85 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.191064:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ca6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9470a expref: 85 pid: 10401 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.191077:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172416128:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.191222:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.193524:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172416128:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.193554:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514cad lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94711 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.193569:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7dc00, rc 0) 00000100:00100000:3.0:1746144892.193608:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175107968:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2682us (2944us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.193617:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5386 00000100:00100000:0.0:1746144892.194011:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.194216:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175108096 00000100:00100000:1.0:1746144892.194223:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175108096 00010000:00010000:1.0:1746144892.194249:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ca6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9470a expref: 86 pid: 10401 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.194281:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10802 00000100:00100000:1.0:1746144892.194287:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175108096:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.194300:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.194319:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ca6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9470a expref: 86 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.194330:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ca6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9470a expref: 86 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.194351:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ca6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9470a expref: 86 pid: 10401 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.194373:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.194375:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.194381:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514cad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94711 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.194388:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514cad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94711 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.194414:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514cad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94711 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.194424:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172416256:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.194482:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.196973:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.197098:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172416256:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.197116:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.197173:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175108096:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2885us (3161us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.197184:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10802 00000100:00100000:2.0:1746144892.197253:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175108352 00000100:00100000:2.0:1746144892.197260:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175108352 00002000:00100000:2.0:1746144892.197302:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258ed80 x1830965175108352/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.197317:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258ed80 with x1830965175108352 ext(0->4095) 00002000:00010000:2.0:1746144892.197322:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258ed80 00000100:00100000:2.0:1746144892.197337:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3983 00000100:00100000:2.0:1746144892.197343:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175108352:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144892.197494:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175108352:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 151us (528us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.197500:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3983 00002000:00100000:2.0:1746144892.197505:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258ed80 x1830965175108352/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.197512:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258ed80 with x1830965175108352 ext(0->4095) 00002000:00010000:2.0:1746144892.197514:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258ed80 00000100:00100000:0.0:1746144892.199681:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.199719:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.199784:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175108480 00000100:00100000:3.0:1746144892.199791:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175108480 00000100:00100000:3.0:1746144892.199819:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175108608 00000100:00100000:3.0:1746144892.199821:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175108608 00000100:00100000:3.0:1746144892.199839:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5387 00000100:00100000:3.0:1746144892.199845:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31565:x1830965175108480:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.199859:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.199876:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94718 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.199906:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514cad lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94711 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.199912:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.199914:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.199917:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94718 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.199943:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514cad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94711 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.199961:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514cad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94711 expref: 5 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.199971:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172416384:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144892.200059:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5388 00000100:00100000:0.0:1746144892.200066:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31579:x1830965175108608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144892.200077:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144892.200083:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514cbb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9471f expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.200093:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144892.200097:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94718 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.200102:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144892.200105:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514cbb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9471f expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.200126:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94718 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.200137:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514cbb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9471f expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.200146:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:3.0:1746144892.200441:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.200477:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31579:x1830965175108608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 411us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144892.200483:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5388 00000100:00100000:3.0:1746144892.202078:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172416384:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.202098:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94718 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.202110:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7d200, rc 0) 00000100:00100000:3.0:1746144892.202138:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31565:x1830965175108480:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2292us (2462us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.202144:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5387 00000100:00100000:0.0:1746144892.202853:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.202985:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175108736 00000100:00100000:1.0:1746144892.202992:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175108736 00010000:00010000:1.0:1746144892.203016:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514cad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94711 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.203048:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10803 00000100:00100000:1.0:1746144892.203053:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175108736:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.203065:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.203085:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514cad lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94711 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.203095:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514cad lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94711 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.203116:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7dc00/0x4076af6727514cad lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94711 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.203141:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.203143:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.203150:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94718 expref: 86 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.203162:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94718 expref: 86 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.203192:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94718 expref: 86 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.203202:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94718 expref: 86 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.203212:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172416640:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.203275:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.204612:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172416640:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.204627:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.204650:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175108736:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1597us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.204658:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10803 00000100:00100000:0.0:1746144892.205425:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.205546:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175108992 00000100:00100000:2.0:1746144892.205552:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175108992 00002000:00100000:2.0:1746144892.205593:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258ce00 x1830965175108992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.205603:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258ce00 with x1830965175108992 ext(0->4095) 00010000:00010000:2.0:1746144892.205610:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94718 expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.205621:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94718 expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.205627:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258ce00 00000100:00100000:2.0:1746144892.205654:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1987 00000100:00100000:2.0:1746144892.205661:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175108992:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144892.205874:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175108992:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 213us (450us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.205880:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1987 00002000:00100000:2.0:1746144892.205885:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258ce00 x1830965175108992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.205891:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258ce00 with x1830965175108992 ext(0->4095) 00010000:00010000:2.0:1746144892.205896:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94718 expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.205905:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94718 expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.205911:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258ce00 00000100:00100000:0.0:1746144892.207546:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.207608:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175109120 00000100:00100000:1.0:1746144892.207614:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175109120 00010000:00010000:1.0:1746144892.207639:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94718 expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.207865:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10804 00000100:00100000:3.0:1746144892.207874:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175109120:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.207883:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.207900:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94718 expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.207910:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94718 expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.207930:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ba7d200/0x4076af6727514cb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94718 expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.207964:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.207966:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.207973:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514cbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9471f expref: 86 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.207981:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514cbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9471f expref: 86 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.208012:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514cbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9471f expref: 86 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.208022:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172416768:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.208080:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.209901:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172416768:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.209918:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.210322:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1985:x1830965175109120:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2447us (2778us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.210332:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10804 00000100:00100000:0.0:1746144892.211393:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.211465:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175109376 00000100:00100000:2.0:1746144892.211472:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175109376 00002000:00100000:2.0:1746144892.211511:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258e680 x1830965175109376/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.211521:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258e680 with x1830965175109376 ext(0->4095) 00002000:00010000:2.0:1746144892.211525:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258e680 00000100:00100000:2.0:1746144892.211541:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3984 00000100:00100000:2.0:1746144892.211548:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175109376:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.212139:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175109376:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 590us (748us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.212146:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3984 00002000:00100000:2.0:1746144892.212152:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258e680 x1830965175109376/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.212159:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258e680 with x1830965175109376 ext(0->4095) 00002000:00010000:2.0:1746144892.212162:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258e680 00000100:00100000:0.0:1746144892.214378:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.214661:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175109504 00000100:00100000:3.0:1746144892.214670:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175109504 00000100:00100000:3.0:1746144892.214719:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5389 00000100:00100000:3.0:1746144892.214727:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175109504:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.214743:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.214797:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cc2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94726 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.214825:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514cbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9471f expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.214833:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.214835:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.214838:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cc2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94726 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.214870:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514cbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9471f expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.214882:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514cbb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9471f expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.214974:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172416896:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.215108:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.216591:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172416896:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.216615:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cc2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94726 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.216628:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cdc00, rc 0) 00000100:00100000:3.0:1746144892.216658:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175109504:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1931us (2290us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.216666:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5389 00000100:00100000:0.0:1746144892.217421:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.217635:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175109632 00000100:00100000:3.0:1746144892.217641:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175109632 00010000:00010000:3.0:1746144892.217665:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514cbb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9471f expref: 86 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.217701:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10805 00000100:00100000:3.0:1746144892.217709:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175109632:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.217720:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.217742:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514cbb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9471f expref: 86 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.217753:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514cbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9471f expref: 86 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.217813:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727514cbb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9471f expref: 86 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.217840:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.217842:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.217849:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cc2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94726 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.217856:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94726 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.217946:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94726 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.217965:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172417024:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.218564:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.219571:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172417024:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.219586:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.219629:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175109632:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1920us (2209us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.219637:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10805 00000100:00100000:0.0:1746144892.220942:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.221376:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.221537:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175109888 00000100:00100000:2.0:1746144892.221544:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175109888 00002000:00100000:2.0:1746144892.221593:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258c700 x1830965175109888/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.221602:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258c700 with x1830965175109888 ext(0->4095) 00002000:00010000:2.0:1746144892.221607:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258c700 00000100:00100000:2.0:1746144892.221626:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3985 00000100:00100000:2.0:1746144892.221635:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175109888:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144892.221743:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175110016 00000100:00100000:3.0:1746144892.221747:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175110016 00000100:00100000:3.0:1746144892.221783:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5390 00000100:00100000:3.0:1746144892.221788:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31565:x1830965175110016:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.221797:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.221813:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9472d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.221822:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175109888:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 189us (884us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.221828:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3985 00002000:00100000:2.0:1746144892.221833:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258c700 x1830965175109888/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1746144892.221836:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cc2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94726 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746144892.221840:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258c700 with x1830965175109888 ext(0->4095) 00010000:00010000:3.0:1746144892.221843:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.221844:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94726 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.221846:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.221849:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9472d expref: 86 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.221852:0:31840:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94726 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144892.221858:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258c700 00010000:00010000:3.0:1746144892.221876:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94726 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.221887:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94726 expref: 5 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.221897:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172417152:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.222550:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.224633:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.225476:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175110144 00000100:00100000:1.0:1746144892.225484:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175110144 00000100:00100000:1.0:1746144892.225540:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5391 00000100:00100000:1.0:1746144892.225546:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31579:x1830965175110144:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144892.225564:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144892.225582:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514cd0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94734 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.225606:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.225611:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9472d expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.225616:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144892.225619:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514cd0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94734 expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.225651:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9472d expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.225661:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514cd0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94734 expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.225670:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501200, rc 0) 00000100:00100000:1.0:1746144892.225720:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31579:x1830965175110144:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 173us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.225726:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5391 00000100:00100000:3.0:1746144892.225923:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172417152:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.226310:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9472d expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.226318:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cc200, rc 0) 00000100:00100000:3.0:1746144892.226800:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31565:x1830965175110016:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5010us (5423us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.226806:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5390 00000100:00100000:0.0:1746144892.227003:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.227353:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175110272 00000100:00100000:3.0:1746144892.227358:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175110272 00010000:00010000:3.0:1746144892.227379:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94726 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.227399:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10806 00000100:00100000:3.0:1746144892.227406:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175110272:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.227418:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.227438:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94726 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.227448:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94726 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.227467:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cc2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94726 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.227491:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.227492:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.227498:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9472d expref: 86 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.227506:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9472d expref: 86 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.227528:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9472d expref: 86 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.227712:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9472d expref: 86 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.227724:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172417408:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.228189:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.230424:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172417408:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.230445:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.230488:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175110272:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3081us (3483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.230497:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10806 00000100:00100000:0.0:1746144892.230678:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.230739:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175110528 00000100:00100000:2.0:1746144892.230745:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175110528 00002000:00100000:2.0:1746144892.230798:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5f800 x1830965175110528/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.230807:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5f800 with x1830965175110528 ext(0->4095) 00010000:00010000:2.0:1746144892.230815:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9472d expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.230827:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9472d expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.230833:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5f800 00000100:00100000:2.0:1746144892.230846:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1988 00000100:00100000:2.0:1746144892.230852:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1984:x1830965175110528:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.231019:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1984:x1830965175110528:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 167us (342us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.231025:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1988 00002000:00100000:2.0:1746144892.231030:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5f800 x1830965175110528/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.231036:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5f800 with x1830965175110528 ext(0->4095) 00010000:00010000:2.0:1746144892.231040:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9472d expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.231054:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9472d expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.231061:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5f800 00000100:00100000:0.0:1746144892.234660:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.234883:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175110656 00000100:00100000:3.0:1746144892.234892:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175110656 00010000:00010000:3.0:1746144892.234923:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9472d expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.234967:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10807 00000100:00100000:3.0:1746144892.234973:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1984:x1830965175110656:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.234985:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.235008:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9472d expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.235019:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9472d expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.235044:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9472d expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.235668:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.235671:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.235679:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514cd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94734 expref: 86 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.235687:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514cd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94734 expref: 86 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.235721:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514cd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94734 expref: 86 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.235733:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172417536:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.235851:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.239214:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172417536:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.239239:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.239743:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175110656:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4766us (5089us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.239755:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10807 00000100:00100000:0.0:1746144892.240226:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.240783:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175110912 00000100:00100000:2.0:1746144892.240792:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175110912 00002000:00100000:2.0:1746144892.240839:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ce00 x1830965175110912/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.240848:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ce00 with x1830965175110912 ext(0->4095) 00002000:00010000:2.0:1746144892.240854:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ce00 00000100:00100000:2.0:1746144892.240871:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3986 00000100:00100000:2.0:1746144892.240878:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175110912:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.241077:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175110912:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 199us (854us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.241084:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3986 00002000:00100000:2.0:1746144892.241089:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ce00 x1830965175110912/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.241097:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ce00 with x1830965175110912 ext(0->4095) 00002000:00010000:2.0:1746144892.241100:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ce00 00000100:00100000:0.0:1746144892.243244:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.243344:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175111040 00000100:00100000:3.0:1746144892.243351:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175111040 00000100:00100000:3.0:1746144892.243390:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5392 00000100:00100000:3.0:1746144892.243396:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175111040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.243411:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.243428:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cd7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9473b expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.243457:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514cd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94734 expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.243465:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.243466:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.243470:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cd7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9473b expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.243508:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514cd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94734 expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.243519:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514cd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94734 expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.243531:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172417664:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.243624:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.245474:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172417664:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.245503:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cd7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9473b expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.245518:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cd800, rc 0) 00000100:00100000:3.0:1746144892.245557:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175111040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2161us (2323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.245565:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5392 00000100:00100000:0.0:1746144892.245660:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.245786:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175111168 00000100:00100000:3.0:1746144892.245791:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175111168 00010000:00010000:3.0:1746144892.245811:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514cd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94734 expref: 86 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.245829:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10808 00000100:00100000:3.0:1746144892.245835:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175111168:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.245845:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.245866:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514cd0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94734 expref: 86 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.245876:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514cd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94734 expref: 86 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.245897:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514cd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94734 expref: 86 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.245911:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.245913:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.245920:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cd7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9473b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.245928:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9473b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.245965:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9473b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.245975:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172417792:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.246034:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.248177:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172417792:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.248193:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.248230:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175111168:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2393us (2569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.248239:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10808 00000100:00100000:0.0:1746144892.248488:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.248650:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175111424 00000100:00100000:1.0:1746144892.248656:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175111424 00002000:00100000:1.0:1746144892.248693:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5c000 x1830965175111424/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.248709:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5c000 with x1830965175111424 ext(0->4095) 00002000:00010000:1.0:1746144892.248713:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5c000 00000100:00100000:1.0:1746144892.248729:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3987 00000100:00100000:1.0:1746144892.248735:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175111424:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144892.248916:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175111424:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 180us (428us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.248921:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3987 00002000:00100000:1.0:1746144892.248926:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5c000 x1830965175111424/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.248932:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5c000 with x1830965175111424 ext(0->4095) 00002000:00010000:1.0:1746144892.248935:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5c000 00000100:00100000:0.0:1746144892.250210:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.250312:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175111552 00000100:00100000:3.0:1746144892.250317:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175111552 00000100:00100000:3.0:1746144892.250351:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5393 00000100:00100000:3.0:1746144892.250357:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31565:x1830965175111552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.250368:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.250383:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94742 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.250410:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cd7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9473b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.250418:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.250420:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.250424:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94742 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.250538:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9473b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.250551:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9473b expref: 5 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.250562:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172417920:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.250642:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.250805:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.250903:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175111680 00000100:00100000:2.0:1746144892.250907:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175111680 00000100:00100000:2.0:1746144892.250927:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5394 00000100:00100000:2.0:1746144892.250937:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31579:x1830965175111680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.250947:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.250962:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ce5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94749 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.250979:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.250983:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94742 expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.250988:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.250991:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ce5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94749 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.251013:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94742 expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.251023:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ce5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94749 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.251032:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:2.0:1746144892.251064:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31579:x1830965175111680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 132us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.251070:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5394 00000100:00100000:3.0:1746144892.251637:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172417920:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.251651:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94742 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.251664:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cc800, rc 0) 00000100:00100000:3.0:1746144892.251689:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31565:x1830965175111552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1333us (1483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.251694:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5393 00000100:00100000:0.0:1746144892.252576:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.252614:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175111808 00000100:00100000:3.0:1746144892.252618:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175111808 00010000:00010000:3.0:1746144892.252635:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9473b expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.252664:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10809 00000100:00100000:3.0:1746144892.252670:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175111808:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.252682:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.252702:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cd7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9473b expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.252712:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cd7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9473b expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.252730:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cd7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9473b expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.252752:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.252754:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.252760:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94742 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.252792:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94742 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.252815:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94742 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.252825:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94742 expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.252834:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172418176:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.252895:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.255355:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172418176:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.255375:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.255419:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175111808:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2749us (2842us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.255429:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10809 00000100:00100000:0.0:1746144892.256001:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.256072:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175112064 00000100:00100000:3.0:1746144892.256078:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175112064 00002000:00100000:3.0:1746144892.256112:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880099e86a00 x1830965175112064/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.256121:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e86a00 with x1830965175112064 ext(0->4095) 00010000:00010000:3.0:1746144892.256193:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94742 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.256206:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94742 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.256214:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099e86a00 00000100:00100000:3.0:1746144892.256240:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1989 00000100:00100000:3.0:1746144892.256248:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175112064:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144892.256410:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175112064:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 163us (410us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.256415:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1989 00002000:00100000:3.0:1746144892.256418:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880099e86a00 x1830965175112064/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.256424:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e86a00 with x1830965175112064 ext(0->4095) 00010000:00010000:3.0:1746144892.256427:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94742 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.256433:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94742 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.256437:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099e86a00 00000100:00100000:0.0:1746144892.257635:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.258060:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175112192 00000100:00100000:3.0:1746144892.258066:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175112192 00010000:00010000:3.0:1746144892.258089:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94742 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.258114:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10810 00000100:00100000:3.0:1746144892.258120:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1984:x1830965175112192:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.258131:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.258148:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94742 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.258157:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94742 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.258178:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514cde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94742 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.258199:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.258201:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.258209:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ce5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94749 expref: 86 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.258217:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ce5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94749 expref: 86 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.258254:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ce5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94749 expref: 86 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.258268:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172418304:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.258376:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.259723:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.259804:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172418304:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.259818:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.259848:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175112192:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1728us (2215us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.259857:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10810 00000100:00100000:2.0:1746144892.259873:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175112448 00000100:00100000:2.0:1746144892.259878:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175112448 00002000:00100000:2.0:1746144892.259912:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880099e86300 x1830965175112448/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.259922:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e86300 with x1830965175112448 ext(0->4095) 00002000:00010000:2.0:1746144892.259926:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e86300 00000100:00100000:2.0:1746144892.259966:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3988 00000100:00100000:2.0:1746144892.259973:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175112448:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.260115:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175112448:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 142us (395us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.260121:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3988 00002000:00100000:2.0:1746144892.260126:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880099e86300 x1830965175112448/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.260134:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e86300 with x1830965175112448 ext(0->4095) 00002000:00010000:2.0:1746144892.260137:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e86300 00000100:00100000:0.0:1746144892.261684:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.261731:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175112576 00000100:00100000:3.0:1746144892.261737:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175112576 00000100:00100000:3.0:1746144892.261790:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5395 00000100:00100000:3.0:1746144892.261797:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175112576:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.261808:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.261824:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94750 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.261846:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ce5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94749 expref: 85 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.261854:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.261856:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.261859:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cec lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94750 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.261884:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ce5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94749 expref: 85 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.261894:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ce5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94749 expref: 85 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.261901:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172418432:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.262015:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.263300:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172418432:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.263335:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cec lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94750 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.263353:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cdc00, rc 0) 00000100:00100000:3.0:1746144892.263598:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175112576:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1800us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.263605:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5395 00000100:00100000:0.0:1746144892.263965:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.264269:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175112704 00000100:00100000:3.0:1746144892.264275:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175112704 00010000:00010000:3.0:1746144892.264297:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ce5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94749 expref: 86 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.264331:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10811 00000100:00100000:3.0:1746144892.264337:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1985:x1830965175112704:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.264350:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.264371:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ce5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94749 expref: 86 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.264381:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ce5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94749 expref: 86 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.264402:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514ce5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94749 expref: 86 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.264416:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.264418:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.264426:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94750 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.264437:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94750 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.264466:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94750 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.264475:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172418560:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.264545:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a65c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.265936:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172418560:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.265950:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.265995:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1985:x1830965175112704:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1657us (2030us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.266004:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10811 00000100:00100000:0.0:1746144892.266404:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.266627:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175112960 00000100:00100000:1.0:1746144892.266633:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175112960 00002000:00100000:1.0:1746144892.266667:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880099e87b80 x1830965175112960/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.266678:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e87b80 with x1830965175112960 ext(0->4095) 00002000:00010000:1.0:1746144892.266682:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e87b80 00000100:00100000:1.0:1746144892.266752:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3989 00000100:00100000:1.0:1746144892.266759:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175112960:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144892.266943:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175112960:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 184us (540us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.266949:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3989 00002000:00100000:1.0:1746144892.266962:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880099e87b80 x1830965175112960/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.266975:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e87b80 with x1830965175112960 ext(0->4095) 00002000:00010000:1.0:1746144892.266978:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e87b80 00000100:00100000:0.0:1746144892.269034:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.269185:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175113088 00000100:00100000:3.0:1746144892.269194:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175113088 00000100:00100000:3.0:1746144892.269527:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5396 00000100:00100000:3.0:1746144892.269535:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31579:x1830965175113088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.269552:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.269570:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94757 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.269600:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94750 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.269606:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.269609:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.269613:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94757 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.269646:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94750 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.269659:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94750 expref: 5 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.269670:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172418688:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.269789:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4380900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.271109:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.272410:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172418688:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.272441:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94757 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.272459:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cd800, rc 0) 00000100:00100000:3.0:1746144892.272505:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31579:x1830965175113088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2965us (3473us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.272514:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5396 00000100:00100000:3.0:1746144892.272594:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175113216 00000100:00100000:3.0:1746144892.272600:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175113216 00000100:00100000:3.0:1746144892.272649:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5397 00000100:00100000:3.0:1746144892.272655:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31565:x1830965175113216:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.272667:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.272680:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9475e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.272739:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.272744:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94757 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.272750:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.272753:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9475e expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.272806:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94757 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.272815:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9475e expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.272823:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cc200, rc 0) 00000100:00100000:3.0:1746144892.272847:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31565:x1830965175113216:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 193us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.272852:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5397 00000100:00100000:0.0:1746144892.273726:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.274013:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175113344 00000100:00100000:3.0:1746144892.274018:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175113344 00010000:00010000:3.0:1746144892.274039:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94750 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.274065:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10812 00000100:00100000:3.0:1746144892.274071:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175113344:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.274080:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.274341:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94750 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.274352:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94750 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.274370:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514cec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94750 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.274439:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.274441:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.274447:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94757 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.274455:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94757 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.274477:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94757 expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.274487:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94757 expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.274496:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172418944:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.275171:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4380900 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.277663:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172418944:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.277692:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.277738:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175113344:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3666us (4013us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.277750:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10812 00000100:00100000:0.0:1746144892.278233:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.278282:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175113600 00000100:00100000:2.0:1746144892.278289:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175113600 00002000:00100000:2.0:1746144892.278334:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa1c00 x1830965175113600/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.278343:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1c00 with x1830965175113600 ext(0->4095) 00010000:00010000:2.0:1746144892.278352:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94757 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.278365:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94757 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.278371:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa1c00 00000100:00100000:2.0:1746144892.278399:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1990 00000100:00100000:2.0:1746144892.278406:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175113600:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144892.278574:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175113600:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 168us (342us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.278580:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1990 00002000:00100000:2.0:1746144892.278585:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa1c00 x1830965175113600/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.278591:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1c00 with x1830965175113600 ext(0->4095) 00010000:00010000:2.0:1746144892.278596:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94757 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.278605:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94757 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.278610:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa1c00 00000100:00100000:0.0:1746144892.280990:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.281088:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175113728 00000100:00100000:2.0:1746144892.281095:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175113728 00000100:00100000:2.0:1746144892.281151:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5398 00000100:00100000:2.0:1746144892.281159:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175113728:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.281175:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.281192:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94765 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.281217:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.281223:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9475e expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.281228:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144892.281232:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94765 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.281270:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9475e expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.281280:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94765 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.281289:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:2.0:1746144892.281413:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175113728:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 255us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.281419:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5398 00000100:00100000:0.0:1746144892.282128:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.282399:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175113856 00000100:00100000:3.0:1746144892.282405:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175113856 00010000:00010000:3.0:1746144892.282431:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94757 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.282465:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10813 00000100:00100000:3.0:1746144892.282471:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1982:x1830965175113856:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.282482:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.282504:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94757 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.282515:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94757 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.282534:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514cf3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94757 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.282561:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.282563:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.282570:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9475e expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.282577:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9475e expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.282603:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9475e expref: 86 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.282914:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9475e expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.282926:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172419200:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.283104:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4380900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.285428:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.285501:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172419200:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.285521:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.285560:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1982:x1830965175113856:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3088us (3434us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.285570:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10813 00000100:00100000:1.0:1746144892.285961:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175114112 00000100:00100000:1.0:1746144892.285968:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175114112 00002000:00100000:1.0:1746144892.286007:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa1880 x1830965175114112/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.286017:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1880 with x1830965175114112 ext(0->4095) 00010000:00010000:1.0:1746144892.286026:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9475e expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.286039:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9475e expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.286045:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa1880 00000100:00100000:1.0:1746144892.286073:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1991 00000100:00100000:1.0:1746144892.286080:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175114112:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144892.286244:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175114112:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 164us (824us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.286250:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1991 00002000:00100000:1.0:1746144892.286255:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa1880 x1830965175114112/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.286262:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1880 with x1830965175114112 ext(0->4095) 00010000:00010000:1.0:1746144892.286266:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9475e expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.286275:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9475e expref: 86 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.286280:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa1880 00000100:00100000:0.0:1746144892.289489:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.289573:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.289842:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175114240 00000100:00100000:1.0:1746144892.289851:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175114240 00000100:00100000:1.0:1746144892.289906:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5399 00000100:00100000:1.0:1746144892.289914:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31565:x1830965175114240:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144892.289930:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144892.289948:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514d08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9476c expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.289983:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144892.289989:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94765 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.289995:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144892.289998:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514d08 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9476c expref: 87 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.290022:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175114368 00000100:00100000:3.0:1746144892.290027:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175114368 00010000:00010000:1.0:1746144892.290035:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94765 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.290044:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9475e expref: 88 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.290047:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514d08 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9476c expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.290056:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500200, rc 0) 00000100:00100000:3.0:1746144892.290064:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10814 00000100:00100000:3.0:1746144892.290069:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175114368:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.290077:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.290098:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9475e expref: 88 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.290105:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31565:x1830965175114240:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 191us (627us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144892.290109:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9475e expref: 88 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.290111:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5399 00010000:00010000:3.0:1746144892.290128:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514cfa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9475e expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.290142:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.290144:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.290150:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94765 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.290156:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94765 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.290178:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94765 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.290188:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94765 expref: 5 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.290199:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172419456:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.290572:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4380900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.292269:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.292332:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175114624 00000100:00100000:2.0:1746144892.292338:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175114624 00000100:00100000:3.0:1746144892.292373:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172419456:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.292388:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.292419:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1985:x1830965175114368:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2349us (2845us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.292427:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10814 00002000:00100000:2.0:1746144892.292672:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa3480 x1830965175114624/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.292681:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa3480 with x1830965175114624 ext(0->4095) 00010000:00010000:2.0:1746144892.292689:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94765 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.292700:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94765 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.292706:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa3480 00000100:00100000:2.0:1746144892.294121:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1992 00000100:00100000:2.0:1746144892.294136:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175114624:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144892.294328:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175114624:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 198us (2065us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.294334:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1992 00002000:00100000:2.0:1746144892.294340:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa3480 x1830965175114624/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.294349:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa3480 with x1830965175114624 ext(0->4095) 00010000:00010000:2.0:1746144892.294355:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94765 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.294365:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94765 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.294371:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa3480 00000100:00100000:0.0:1746144892.298395:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.298468:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175114752 00000100:00100000:3.0:1746144892.298479:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175114752 00010000:00010000:3.0:1746144892.298517:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94765 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.298559:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10815 00000100:00100000:3.0:1746144892.298565:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175114752:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.298582:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.298604:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94765 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.298615:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94765 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.298637:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d01 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94765 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.298662:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.298664:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.298671:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514d08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9476c expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.298678:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514d08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9476c expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.298709:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514d08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9476c expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.298721:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172419584:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.298819:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4380900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.302344:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.302405:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172419584:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.302425:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.302469:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175114752:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3903us (4086us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.302480:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10815 00000100:00100000:2.0:1746144892.302566:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175115008 00000100:00100000:2.0:1746144892.302573:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175115008 00002000:00100000:2.0:1746144892.302619:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa0e00 x1830965175115008/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.302628:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0e00 with x1830965175115008 ext(0->4095) 00002000:00010000:2.0:1746144892.302634:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa0e00 00000100:00100000:2.0:1746144892.302663:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3990 00000100:00100000:2.0:1746144892.302670:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1985:x1830965175115008:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144892.303143:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1985:x1830965175115008:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 472us (809us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.303150:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3990 00002000:00100000:2.0:1746144892.303156:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa0e00 x1830965175115008/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.303164:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0e00 with x1830965175115008 ext(0->4095) 00002000:00010000:2.0:1746144892.303167:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa0e00 00000100:00100000:0.0:1746144892.306190:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.306283:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175115136 00000100:00100000:2.0:1746144892.306292:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175115136 00000100:00100000:2.0:1746144892.307507:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5400 00000100:00100000:2.0:1746144892.307520:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175115136:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.307540:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.307559:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94773 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.307586:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514d08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9476c expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.307593:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.307594:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.307598:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94773 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.307626:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514d08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9476c expref: 85 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.307636:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514d08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9476c expref: 85 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.307646:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172419712:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.307729:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.309812:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172419712:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.309844:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94773 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.309858:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:2.0:1746144892.309891:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175115136:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2376us (3709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.309899:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5400 00000100:00100000:0.0:1746144892.310368:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.310418:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175115264 00000100:00100000:3.0:1746144892.310425:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175115264 00010000:00010000:3.0:1746144892.310455:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514d08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9476c expref: 86 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.310477:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10816 00000100:00100000:3.0:1746144892.310484:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175115264:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.310497:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.310517:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514d08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9476c expref: 86 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.310527:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514d08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9476c expref: 86 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.310547:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514d08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9476c expref: 86 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.311160:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.311163:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.311170:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94773 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.311178:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94773 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.311208:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94773 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.311218:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172419840:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.314125:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4380900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.314666:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.314874:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175115392 00000100:00100000:3.0:1746144892.314881:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175115392 00000100:00100000:3.0:1746144892.314926:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5401 00000100:00100000:3.0:1746144892.314933:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31565:x1830965175115392:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.314950:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.314978:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9477a expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.315008:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94773 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.315015:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.315017:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.315021:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9477a expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.315049:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94773 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.315060:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94773 expref: 5 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.315076:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172419968:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.315130:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167600 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.317187:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172419840:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.317208:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.317257:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1984:x1830965175115264:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6771us (6888us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.317267:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10816 00000100:00100000:0.0:1746144892.318979:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.319338:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172419968:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.319365:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9477a expref: 86 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.319382:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cd800, rc 0) 00000100:00100000:2.0:1746144892.320320:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175115648 00000100:00100000:2.0:1746144892.320329:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175115648 00002000:00100000:2.0:1746144892.320375:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa3100 x1830965175115648/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.320384:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa3100 with x1830965175115648 ext(0->4095) 00010000:00010000:2.0:1746144892.320391:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94773 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.320403:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94773 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.320410:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa3100 00000100:00100000:2.0:1746144892.321688:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1993 00000100:00100000:2.0:1746144892.321701:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175115648:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144892.321919:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31565:x1830965175115392:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6983us (7255us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.321927:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5401 00000100:00100000:2.0:1746144892.322699:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175115648:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1001us (3723us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.322709:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1993 00002000:00100000:2.0:1746144892.322717:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa3100 x1830965175115648/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.322726:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa3100 with x1830965175115648 ext(0->4095) 00010000:00010000:2.0:1746144892.322734:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94773 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.322746:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94773 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.322752:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa3100 00000100:00100000:0.0:1746144892.339573:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.340465:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175115776 00000100:00100000:3.0:1746144892.340475:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175115776 00010000:00010000:3.0:1746144892.340514:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94773 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.340544:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10817 00000100:00100000:3.0:1746144892.340552:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175115776:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.340564:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.340588:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94773 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.340600:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94773 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.340629:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d0f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94773 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.340649:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.340651:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.340659:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9477a expref: 85 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.340665:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9477a expref: 85 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.340697:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9477a expref: 85 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.340709:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172420096:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.340920:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167600 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.344834:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172420096:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.344859:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.344905:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175115776:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4353us (5342us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.344915:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10817 00000100:00100000:0.0:1746144892.346136:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.346229:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175116032 00000100:00100000:2.0:1746144892.346237:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175116032 00002000:00100000:2.0:1746144892.346281:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801391d2a00 x1830965175116032/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.346291:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d2a00 with x1830965175116032 ext(0->4095) 00002000:00010000:2.0:1746144892.346296:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801391d2a00 00000100:00100000:2.0:1746144892.346323:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3991 00000100:00100000:2.0:1746144892.346329:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175116032:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.346490:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175116032:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 161us (357us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.346496:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3991 00002000:00100000:2.0:1746144892.346502:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801391d2a00 x1830965175116032/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.346517:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d2a00 with x1830965175116032 ext(0->4095) 00002000:00010000:2.0:1746144892.346520:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801391d2a00 00000100:00100000:0.0:1746144892.352546:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.356221:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175116160 00000100:00100000:3.0:1746144892.356240:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175116160 00000100:00100000:3.0:1746144892.356309:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5402 00000100:00100000:3.0:1746144892.356318:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175116160:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.356338:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.356361:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94781 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.356392:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9477a expref: 85 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.356400:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.356402:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.356406:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94781 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.356441:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9477a expref: 85 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.356453:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9477a expref: 85 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.356465:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172420224:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.356585:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167600 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.360705:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172420224:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.360740:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94781 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.360792:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094198000, rc 0) 00000100:00100000:3.0:1746144892.360838:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175116160:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4520us (8303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.360847:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5402 00000100:00100000:0.0:1746144892.366591:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.366672:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175116288 00000100:00100000:2.0:1746144892.366686:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175116288 00002000:00100000:2.0:1746144892.366736:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880093441500 x1830965175116288/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 496/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.366746:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093441500 with x1830965175116288 ext(0->7) 00010000:00010000:2.0:1746144892.366755:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9477a expref: 86 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.366807:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9477a expref: 86 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.366815:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093441500 00000100:00100000:2.0:1746144892.366835:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1994 00000100:00100000:2.0:1746144892.366849:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1984:x1830965175116288:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144892.368537:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175116288:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 1687us (1950us total) trans 4294968006 rc 0/0 00000100:00100000:2.0:1746144892.368547:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1994 00002000:00100000:2.0:1746144892.368557:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880093441500 x1830965175116288/t4294968006(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 496/448 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.368566:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093441500 with x1830965175116288 ext(0->7) 00010000:00010000:2.0:1746144892.368573:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9477a expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.368590:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9477a expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.368596:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093441500 00000100:00100000:0.0:1746144892.374250:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.374314:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.374384:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175116416 00000100:00100000:3.0:1746144892.374395:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175116416 00000100:00100000:3.0:1746144892.374441:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5403 00000100:00100000:3.0:1746144892.374449:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31565:x1830965175116416:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.374468:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.374487:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94788 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.374503:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175116544 00000100:00100000:2.0:1746144892.374506:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175116544 00010000:00010000:3.0:1746144892.374514:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.374520:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94781 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.374526:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144892.374528:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9477a expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.374529:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94788 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.374561:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10818 00010000:00010000:3.0:1746144892.374564:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94781 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.374565:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965175116544:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.374575:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.374576:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94788 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.374589:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cdc00, rc 0) 00010000:00010000:2.0:1746144892.374594:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9477a expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.374604:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9477a expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.374619:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9477a expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.374631:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31565:x1830965175116416:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 183us (395us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144892.374633:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.374635:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.374640:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94781 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.374652:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94781 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.374717:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5403 00010000:00010000:2.0:1746144892.375856:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94781 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.375869:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94781 expref: 5 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.375882:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172420480:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.375959:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.377698:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172420480:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.377723:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.378862:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175116544:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4292us (4543us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.378874:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10818 00000100:00100000:0.0:1746144892.379139:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.379247:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175116800 00000100:00100000:3.0:1746144892.379254:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175116800 00002000:00100000:3.0:1746144892.379296:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093441880 x1830965175116800/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.379306:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093441880 with x1830965175116800 ext(0->4095) 00010000:00010000:3.0:1746144892.379314:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94781 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.379327:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94781 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.379333:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093441880 00000100:00100000:3.0:1746144892.379351:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1995 00000100:00100000:3.0:1746144892.379358:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175116800:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144892.380172:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175116800:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 813us (1032us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.380179:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1995 00002000:00100000:3.0:1746144892.380184:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093441880 x1830965175116800/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.380196:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093441880 with x1830965175116800 ext(0->4095) 00010000:00010000:3.0:1746144892.380201:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94781 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.380209:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94781 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.380215:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093441880 00000100:00100000:0.0:1746144892.381890:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.381990:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175116928 00000100:00100000:2.0:1746144892.381996:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175116928 00000100:00100000:0.0:1746144892.382008:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1746144892.382029:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94781 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.382092:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175117056 00000100:00100000:3.0:1746144892.382095:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175117056 00000100:00100000:3.0:1746144892.382122:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5404 00000100:00100000:3.0:1746144892.382128:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:31579:x1830965175117056:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.382138:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.382152:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9478f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.382256:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.382262:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94788 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.382267:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.382270:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9478f expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.382302:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94788 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.382316:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9478f expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.382326:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cc800, rc 0) 00000100:00100000:3.0:1746144892.382394:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:31579:x1830965175117056:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 266us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.382399:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5404 00000100:00100000:2.0:1746144892.382511:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10819 00000100:00100000:2.0:1746144892.382519:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1984:x1830965175116928:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.382528:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144892.382549:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94781 expref: 7 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.382560:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94781 expref: 7 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.382577:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94781 expref: 7 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.382604:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.382606:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.382612:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94788 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.382619:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94788 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.382641:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94788 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.382651:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94788 expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.382662:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172420736:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.382728:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.384544:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172420736:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.384566:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.384611:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175116928:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2093us (2725us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.384622:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10819 00000100:00100000:0.0:1746144892.385159:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.385299:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175117312 00000100:00100000:3.0:1746144892.385306:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175117312 00002000:00100000:3.0:1746144892.385344:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093854700 x1830965175117312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.385354:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854700 with x1830965175117312 ext(0->4095) 00010000:00010000:3.0:1746144892.385361:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94788 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.385372:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94788 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.385377:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093854700 00000100:00100000:3.0:1746144892.385393:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1996 00000100:00100000:3.0:1746144892.385400:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175117312:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144892.385569:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175117312:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 170us (410us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.385575:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1996 00002000:00100000:3.0:1746144892.385581:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093854700 x1830965175117312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.385588:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854700 with x1830965175117312 ext(0->4095) 00010000:00010000:3.0:1746144892.385593:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94788 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.385601:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94788 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.385606:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093854700 00000100:00100000:0.0:1746144892.387238:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.387345:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175117440 00000100:00100000:3.0:1746144892.387349:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175117440 00000100:00100000:0.0:1746144892.387355:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.387411:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175117568 00000100:00100000:2.0:1746144892.387415:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175117568 00010000:00010000:2.0:1746144892.387570:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94788 expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.387601:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10820 00000100:00100000:2.0:1746144892.387609:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175117568:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.387725:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144892.387745:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94788 expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.387755:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94788 expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.387802:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514d24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94788 expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.387815:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.387816:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.387823:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9478f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.387831:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9478f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.387859:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9478f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.387870:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172420864:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.387921:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5405 00000100:00100000:3.0:1746144892.387928:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31565:x1830965175117440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.387939:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.387949:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94796 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.387976:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9478f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.387982:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.387983:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.387986:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d32 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94796 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.388003:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9478f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.388017:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9478f expref: 5 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.388025:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172420992:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.388029:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f600 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.388059:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.390246:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.390352:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172420992:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.390378:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d32 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94796 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.390394:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cd800, rc 0) 00000100:00100000:3.0:1746144892.390432:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31565:x1830965175117440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2503us (3196us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.390439:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5405 00000100:00100000:1.0:1746144892.390514:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175117824 00000100:00100000:1.0:1746144892.390520:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175117824 00002000:00100000:1.0:1746144892.390553:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093856d80 x1830965175117824/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.390562:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093856d80 with x1830965175117824 ext(0->4095) 00010000:00010000:1.0:1746144892.390568:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9478f expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.390578:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9478f expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.390584:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093856d80 00000100:00100000:1.0:1746144892.390599:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1997 00000100:00100000:1.0:1746144892.390604:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175117824:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144892.390798:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175117824:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 192us (558us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.390804:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1997 00002000:00100000:1.0:1746144892.390809:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093856d80 x1830965175117824/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.390816:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093856d80 with x1830965175117824 ext(0->4095) 00010000:00010000:1.0:1746144892.390821:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9478f expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.390834:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9478f expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.390839:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093856d80 00000100:00100000:2.0:1746144892.390921:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172420864:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.390945:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.391007:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175117568:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3398us (3650us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.391017:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10820 00000100:00100000:0.0:1746144892.393699:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.394010:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175117952 00000100:00100000:2.0:1746144892.394018:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175117952 00010000:00010000:2.0:1746144892.394061:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9478f expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.394087:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10821 00000100:00100000:2.0:1746144892.394094:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175117952:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.394107:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144892.394129:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9478f expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.394139:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9478f expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.394162:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af6727514d2b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9478f expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.394177:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.394180:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.394186:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94796 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.394194:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94796 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.394227:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94796 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.394239:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172421120:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.394490:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.396069:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172421120:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.396090:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.396123:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175117952:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2029us (2430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.396137:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10821 00000100:00100000:0.0:1746144892.396589:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.396894:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175118208 00000100:00100000:3.0:1746144892.396900:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175118208 00002000:00100000:3.0:1746144892.396940:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358ec000 x1830965175118208/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.396958:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358ec000 with x1830965175118208 ext(0->4095) 00002000:00010000:3.0:1746144892.396966:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801358ec000 00000100:00100000:3.0:1746144892.397142:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3992 00000100:00100000:3.0:1746144892.397150:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175118208:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144892.397339:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175118208:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 189us (751us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.397350:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3992 00002000:00100000:3.0:1746144892.397355:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358ec000 x1830965175118208/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.397362:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358ec000 with x1830965175118208 ext(0->4095) 00002000:00010000:3.0:1746144892.397365:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801358ec000 00000100:00100000:0.0:1746144892.399134:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.399217:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175118336 00000100:00100000:3.0:1746144892.399223:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175118336 00000100:00100000:3.0:1746144892.399306:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5406 00000100:00100000:3.0:1746144892.399313:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175118336:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.399327:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.399342:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514d39 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9479d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.399369:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94796 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.399383:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.399385:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.399388:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514d39 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9479d expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.399418:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94796 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.399430:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94796 expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.399450:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172421248:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.399529:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41676c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.400489:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172421248:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.400560:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514d39 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9479d expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.400572:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cc200, rc 0) 00000100:00100000:3.0:1746144892.400632:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175118336:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1318us (1500us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.400639:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5406 00000100:00100000:0.0:1746144892.402226:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.402336:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175118464 00000100:00100000:2.0:1746144892.402343:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175118464 00010000:00010000:2.0:1746144892.402383:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94796 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.402405:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10822 00000100:00100000:2.0:1746144892.402412:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175118464:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.402426:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144892.402449:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94796 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.402466:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94796 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.402490:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514d32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94796 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.402522:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.402524:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.402531:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514d39 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9479d expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.402539:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514d39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9479d expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.402570:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514d39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9479d expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.402581:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172421376:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.402665:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.405461:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172421376:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.405488:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.405531:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175118464:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3118us (3310us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.405542:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10822 00000100:00100000:0.0:1746144892.410243:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.410293:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.410350:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175118720 00000100:00100000:3.0:1746144892.410359:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175118848 00000100:00100000:1.0:1746144892.410361:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175118720 00000100:00100000:3.0:1746144892.410362:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175118848 00000100:00100000:3.0:1746144892.410405:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5407 00002000:00100000:1.0:1746144892.410409:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417ea00 x1830965175118720/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:3.0:1746144892.410412:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31565:x1830965175118848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00002000:00100000:1.0:1746144892.410419:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417ea00 with x1830965175118720 ext(0->4095) 00002000:00010000:1.0:1746144892.410425:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417ea00 00010000:00010000:3.0:1746144892.410426:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.410446:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af947a4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.410481:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514d39 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9479d expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.410489:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.410491:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.410494:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947a4 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.410504:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3993 00000100:00100000:1.0:1746144892.410509:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175118720:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00010000:00010000:3.0:1746144892.410529:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514d39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9479d expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.410539:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514d39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9479d expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.410549:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172421504:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.410612:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41676c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.410657:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175118720:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 147us (362us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.410663:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3993 00002000:00100000:1.0:1746144892.410668:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417ea00 x1830965175118720/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.410675:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417ea00 with x1830965175118720 ext(0->4095) 00010000:00010000:1.0:1746144892.410679:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514d39 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9479d expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.410688:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514d39 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9479d expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.410697:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417ea00 00000100:00100000:2.0:1746144892.412324:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172421504:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.412353:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947a4 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.412367:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094198000, rc 0) 00000100:00100000:2.0:1746144892.412411:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31565:x1830965175118848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1998us (2177us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.412417:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5407 00000100:00100000:0.0:1746144892.412977:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.413013:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.413132:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175118976 00000100:00100000:3.0:1746144892.413138:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175118976 00010000:00010000:3.0:1746144892.413165:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514d39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9479d expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.413185:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10823 00000100:00100000:3.0:1746144892.413192:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175118976:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.413204:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.413225:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514d39 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9479d expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.413236:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514d39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9479d expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.413263:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727514d39 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9479d expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.413296:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.413298:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.413305:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947a4 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.413312:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947a4 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.413339:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947a4 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.413349:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172421632:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.413414:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.413591:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175119104 00000100:00100000:2.0:1746144892.413594:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175119104 00000100:00100000:2.0:1746144892.413618:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5408 00000100:00100000:2.0:1746144892.413623:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31579:x1830965175119104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.413632:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.413642:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af947ab expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.413657:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947a4 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.413663:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.413664:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.413666:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ab expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.413683:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947a4 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.413691:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947a4 expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.413700:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172421760:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.413726:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.416539:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.416688:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172421632:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.416708:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.416834:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175118976:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3641us (3819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.416845:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10823 00000100:00100000:3.0:1746144892.416906:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175119360 00000100:00100000:3.0:1746144892.416912:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175119360 00002000:00100000:3.0:1746144892.416943:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417ed80 x1830965175119360/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.416962:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417ed80 with x1830965175119360 ext(0->4095) 00010000:00010000:3.0:1746144892.416971:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947a4 expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.416988:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947a4 expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.416993:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417ed80 00000100:00100000:2.0:1746144892.417078:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172421760:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.417101:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ab expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.417114:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:2.0:1746144892.417134:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31579:x1830965175119104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3511us (4159us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.417141:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5408 00000100:00100000:3.0:1746144892.417718:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1998 00000100:00100000:3.0:1746144892.417726:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1984:x1830965175119360:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144892.417918:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1984:x1830965175119360:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 192us (1387us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.417924:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1998 00002000:00100000:3.0:1746144892.417930:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417ed80 x1830965175119360/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.417937:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417ed80 with x1830965175119360 ext(0->4095) 00010000:00010000:3.0:1746144892.417943:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947a4 expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.417962:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947a4 expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.417969:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417ed80 00000100:00100000:0.0:1746144892.421459:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.421522:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.421540:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175119616 00000100:00100000:2.0:1746144892.421550:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175119616 00000100:00100000:2.0:1746144892.421615:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5409 00000100:00100000:2.0:1746144892.421624:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31565:x1830965175119616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.421643:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.421661:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d4e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af947b2 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.421691:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.421697:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ab expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.421703:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144892.421706:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d4e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b2 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.421751:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ab expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.421790:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d4e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b2 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.421799:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:2.0:1746144892.421855:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099699c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31565:x1830965175119616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 232us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.421862:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5409 00000100:00100000:3.0:1746144892.422296:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175119488 00000100:00100000:3.0:1746144892.422301:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175119488 00010000:00010000:3.0:1746144892.422319:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947a4 expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.422336:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10824 00000100:00100000:3.0:1746144892.422341:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175119488:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.422349:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.422370:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947a4 expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.422380:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947a4 expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.422397:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514d40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947a4 expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.422412:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.422414:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.422419:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ab expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.422427:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ab expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.422449:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ab expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.422459:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ab expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.422471:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172422016:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.422524:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.425061:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.425158:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172422016:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.425179:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.425221:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1984:x1830965175119488:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2879us (3698us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.425231:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10824 00000100:00100000:1.0:1746144892.426319:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175119872 00000100:00100000:1.0:1746144892.426327:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175119872 00002000:00100000:1.0:1746144892.426365:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417df80 x1830965175119872/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.426376:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417df80 with x1830965175119872 ext(0->4095) 00010000:00010000:1.0:1746144892.426385:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ab expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.426399:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ab expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.426406:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417df80 00000100:00100000:1.0:1746144892.426426:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 1999 00000100:00100000:1.0:1746144892.426433:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1984:x1830965175119872:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144892.426597:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1984:x1830965175119872:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 164us (1544us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.426603:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 1999 00002000:00100000:1.0:1746144892.426609:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417df80 x1830965175119872/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.426617:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417df80 with x1830965175119872 ext(0->4095) 00010000:00010000:1.0:1746144892.426622:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ab expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.426636:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ab expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.426642:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417df80 00000100:00100000:0.0:1746144892.430033:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.430142:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.430382:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175120128 00000100:00100000:3.0:1746144892.430392:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175120128 00010000:00010000:3.0:1746144892.430431:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ab expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.430459:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10825 00000100:00100000:3.0:1746144892.430468:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1984:x1830965175120128:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.430481:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.430503:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ab expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.430515:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ab expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.430539:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ab expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.430555:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.430557:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.430563:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b2 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.430572:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b2 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.430608:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b2 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.430621:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172422144:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.430716:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.431717:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175120000 00000100:00100000:2.0:1746144892.431722:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175120000 00000100:00100000:2.0:1746144892.431789:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5410 00000100:00100000:2.0:1746144892.431796:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175120000:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.431810:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.431824:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514d55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af947b9 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.431844:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b2 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.431850:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.431852:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.431855:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514d55 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b9 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.431878:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b2 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.431889:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d4e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b2 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.431897:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172422272:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.431965:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f600 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.434293:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172422144:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.434313:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.435839:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175120128:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5360us (5686us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.435851:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10825 00000100:00100000:1.0:1746144892.436017:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.436112:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172422272:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.436144:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514d55 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b9 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.436159:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d200, rc 0) 00000100:00100000:2.0:1746144892.436211:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175120000:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4415us (6189us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.436218:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5410 00000100:00100000:3.0:1746144892.436543:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175120256 00000100:00100000:3.0:1746144892.436550:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175120256 00010000:00010000:3.0:1746144892.436572:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b2 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.436599:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10826 00000100:00100000:3.0:1746144892.436605:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175120256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.436615:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.436632:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d4e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b2 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.436642:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b2 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.436659:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b2 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.436672:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.436674:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.436679:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514d55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b9 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.436686:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514d55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b9 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.436711:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514d55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b9 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.436721:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172422400:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.436813:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.439806:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.439891:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175120512 00000100:00100000:1.0:1746144892.439901:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175120512 00002000:00100000:1.0:1746144892.439947:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417d880 x1830965175120512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.439969:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417d880 with x1830965175120512 ext(0->4095) 00002000:00010000:1.0:1746144892.439974:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417d880 00000100:00100000:3.0:1746144892.440306:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172422400:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.440328:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.440373:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175120256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3767us (4357us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.440383:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10826 00000100:00100000:1.0:1746144892.440568:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3994 00000100:00100000:1.0:1746144892.440577:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175120512:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144892.440744:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175120512:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 168us (984us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.440751:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3994 00002000:00100000:1.0:1746144892.440757:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417d880 x1830965175120512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.440785:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417d880 with x1830965175120512 ext(0->4095) 00002000:00010000:1.0:1746144892.440789:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417d880 00000100:00100000:0.0:1746144892.443692:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.444054:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175120640 00000100:00100000:2.0:1746144892.444065:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175120640 00000100:00100000:2.0:1746144892.444121:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5411 00000100:00100000:2.0:1746144892.444136:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31579:x1830965175120640:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.444152:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.444169:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af947c0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.444198:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514d55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b9 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.444205:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.444207:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.444210:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c0 expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.444239:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514d55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b9 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.444250:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514d55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b9 expref: 5 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.444261:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172422528:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.444349:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.446185:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.446319:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175120768 00000100:00100000:3.0:1746144892.446325:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175120768 00000100:00100000:3.0:1746144892.446360:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5412 00000100:00100000:3.0:1746144892.446366:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31565:x1830965175120768:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.446379:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.446392:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af947c7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.446420:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.446426:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c0 expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.446432:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.446435:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c7 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.446463:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c0 expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.446473:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c7 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.446482:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099536200, rc 0) 00000100:00100000:3.0:1746144892.447487:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31565:x1830965175120768:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1116us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.447494:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5412 00000100:00100000:3.0:1746144892.448695:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172422528:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.448729:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c0 expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.448745:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:3.0:1746144892.448812:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31579:x1830965175120640:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4683us (5128us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.448819:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5411 00000100:00100000:0.0:1746144892.450109:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.450875:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175120896 00000100:00100000:3.0:1746144892.450884:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175120896 00010000:00010000:3.0:1746144892.450920:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514d55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b9 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.450958:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10827 00000100:00100000:3.0:1746144892.450966:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175120896:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.450979:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.451000:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514d55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b9 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.451012:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514d55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b9 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.451036:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514d55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947b9 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.451066:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.451068:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.451075:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c0 expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.451083:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c0 expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.451119:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c0 expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.451134:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c0 expref: 88 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.451147:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172422784:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.451221:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.453895:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172422784:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.453916:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.453971:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175120896:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3004us (3865us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.453982:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10827 00000100:00100000:0.0:1746144892.454081:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.454181:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175121152 00000100:00100000:2.0:1746144892.454188:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175121152 00002000:00100000:2.0:1746144892.454229:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092588a80 x1830965175121152/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.454240:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092588a80 with x1830965175121152 ext(0->4095) 00010000:00010000:2.0:1746144892.454248:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c0 expref: 89 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.454260:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c0 expref: 89 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.454267:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092588a80 00000100:00100000:2.0:1746144892.454283:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2000 00000100:00100000:2.0:1746144892.454291:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175121152:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144892.454444:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175121152:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 153us (364us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.454450:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2000 00002000:00100000:2.0:1746144892.454454:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092588a80 x1830965175121152/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.454461:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092588a80 with x1830965175121152 ext(0->4095) 00010000:00010000:2.0:1746144892.454465:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c0 expref: 89 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.454474:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c0 expref: 89 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.454480:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092588a80 00000100:00100000:0.0:1746144892.459398:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.459627:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175121280 00000100:00100000:3.0:1746144892.459637:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175121280 00000100:00100000:3.0:1746144892.459682:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5413 00000100:00100000:3.0:1746144892.459689:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175121280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.459707:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.459727:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af947ce expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.459755:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.459789:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c7 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.459795:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144892.459799:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ce expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.459840:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c7 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.459852:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ce expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.459861:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b3ae000, rc 0) 00000100:00100000:3.0:1746144892.459916:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175121280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 228us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.459922:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5413 00000100:00100000:1.0:1746144892.460487:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.460739:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175121408 00000100:00100000:3.0:1746144892.460743:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175121408 00010000:00010000:3.0:1746144892.460786:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c0 expref: 89 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.460808:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10828 00000100:00100000:3.0:1746144892.460813:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175121408:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.460822:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.460841:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c0 expref: 89 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.460852:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c0 expref: 89 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.460872:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c0 expref: 89 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.461579:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.461582:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.461589:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c7 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.461597:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c7 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.461626:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c7 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.461638:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c7 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.461649:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172423040:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.462146:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.464105:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172423040:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.464127:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.464175:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175121408:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3359us (3686us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.464186:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10828 00000100:00100000:0.0:1746144892.465139:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.465229:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175121664 00000100:00100000:1.0:1746144892.465235:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175121664 00002000:00100000:1.0:1746144892.465272:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258a680 x1830965175121664/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.465283:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258a680 with x1830965175121664 ext(0->4095) 00010000:00010000:1.0:1746144892.465292:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c7 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.465305:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c7 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.465312:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258a680 00000100:00100000:1.0:1746144892.465372:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2001 00000100:00100000:1.0:1746144892.465379:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175121664:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144892.465542:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175121664:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 163us (405us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.465549:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2001 00002000:00100000:1.0:1746144892.465554:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258a680 x1830965175121664/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.465561:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258a680 with x1830965175121664 ext(0->4095) 00010000:00010000:1.0:1746144892.465566:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c7 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.465575:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c7 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.465580:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258a680 00000100:00100000:0.0:1746144892.469100:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.469257:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175121792 00000100:00100000:3.0:1746144892.469267:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175121792 00010000:00010000:3.0:1746144892.469304:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c7 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.469346:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10829 00000100:00100000:3.0:1746144892.469353:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175121792:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.469365:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.469388:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c7 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.469401:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c7 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.469425:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947c7 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.469454:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.469456:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.469463:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ce expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.469470:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ce expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.469501:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ce expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.469512:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172423168:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.469591:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167840 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.470334:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.470547:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175121920 00000100:00100000:0.0:1746144892.470551:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175121920 00000100:00100000:0.0:1746144892.470584:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5414 00000100:00100000:0.0:1746144892.470589:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31565:x1830965175121920:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144892.470602:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144892.470615:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514d71 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af947d5 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.470633:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ce expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.470640:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144892.470641:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144892.470644:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514d71 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947d5 expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.470660:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ce expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.470668:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ce expref: 5 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:0.0:1746144892.470675:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b462680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172423296:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144892.470709:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.473090:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b462680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172423296:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.473114:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514d71 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947d5 expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.473128:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:2.0:1746144892.473415:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31565:x1830965175121920:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2823us (3081us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.473424:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5414 00000100:00100000:0.0:1746144892.473742:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.473863:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172423168:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.473876:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.473896:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175121792:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4544us (4807us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.473904:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10829 00000100:00100000:2.0:1746144892.473969:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175122176 00000100:00100000:2.0:1746144892.473975:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175122176 00002000:00100000:2.0:1746144892.474014:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b460380 x1830965175122176/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.474024:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460380 with x1830965175122176 ext(0->4095) 00010000:00010000:2.0:1746144892.474030:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ce expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.474041:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ce expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.474047:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b460380 00000100:00100000:2.0:1746144892.474073:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2002 00000100:00100000:2.0:1746144892.474081:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175122176:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144892.474313:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175122176:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 232us (570us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.474320:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2002 00002000:00100000:2.0:1746144892.474326:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b460380 x1830965175122176/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.474333:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460380 with x1830965175122176 ext(0->4095) 00010000:00010000:2.0:1746144892.474337:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ce expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.474346:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ce expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.474352:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b460380 00000100:00100000:0.0:1746144892.476398:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.476565:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175122304 00000100:00100000:3.0:1746144892.476573:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175122304 00010000:00010000:3.0:1746144892.476606:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ce expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.476631:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10830 00000100:00100000:3.0:1746144892.476638:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175122304:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.476650:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.476672:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ce expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.476683:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ce expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.476706:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514d6a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ce expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.477350:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.477353:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.477363:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514d71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947d5 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.477372:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514d71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947d5 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.477414:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514d71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947d5 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.477428:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172423424:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.477523:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.480041:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.480233:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175122560 00000100:00100000:2.0:1746144892.480242:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175122560 00002000:00100000:2.0:1746144892.480292:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b460e00 x1830965175122560/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.480303:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460e00 with x1830965175122560 ext(0->4095) 00002000:00010000:2.0:1746144892.480308:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b460e00 00000100:00100000:2.0:1746144892.480342:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3995 00000100:00100000:2.0:1746144892.480350:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175122560:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144892.480532:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175122560:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 182us (495us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.480539:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3995 00002000:00100000:2.0:1746144892.480544:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b460e00 x1830965175122560/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.480551:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460e00 with x1830965175122560 ext(0->4095) 00002000:00010000:2.0:1746144892.480553:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b460e00 00000100:00100000:3.0:1746144892.480644:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172423424:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.480664:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.480690:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175122304:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4053us (4301us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.480698:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10830 00000100:00100000:0.0:1746144892.483877:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.483990:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175122688 00000100:00100000:2.0:1746144892.483999:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175122688 00000100:00100000:2.0:1746144892.484056:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5415 00000100:00100000:2.0:1746144892.484064:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175122688:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.484083:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.484100:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af947dc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.484127:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514d71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947d5 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.484139:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.484141:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.484144:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d78 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947dc expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.484175:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514d71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947d5 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.484186:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514d71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947d5 expref: 87 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.484198:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172423552:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.484274:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.486159:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172423552:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.486182:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d78 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947dc expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.486195:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:2.0:1746144892.486224:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175122688:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2160us (2356us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.486233:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5415 00000100:00100000:0.0:1746144892.486674:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.486797:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175122816 00000100:00100000:3.0:1746144892.486803:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175122816 00010000:00010000:3.0:1746144892.486825:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514d71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947d5 expref: 88 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.486843:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10831 00000100:00100000:3.0:1746144892.486848:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175122816:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.486857:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.486877:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514d71 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947d5 expref: 88 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.486887:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514d71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947d5 expref: 88 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.486908:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514d71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947d5 expref: 88 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.486931:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.486933:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.486940:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947dc expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.486949:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947dc expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.486981:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947dc expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.486990:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172423680:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.487046:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.488996:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.489082:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175123072 00000100:00100000:1.0:1746144892.489089:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175123072 00002000:00100000:1.0:1746144892.489450:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b463b80 x1830965175123072/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.489461:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463b80 with x1830965175123072 ext(0->4095) 00002000:00010000:1.0:1746144892.489465:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b463b80 00000100:00100000:1.0:1746144892.489495:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3996 00000100:00100000:1.0:1746144892.489503:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175123072:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144892.489811:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172423680:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.489830:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.490533:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175123072:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1029us (1543us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.490540:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3996 00002000:00100000:1.0:1746144892.490547:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b463b80 x1830965175123072/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.490556:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463b80 with x1830965175123072 ext(0->4095) 00002000:00010000:1.0:1746144892.490558:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b463b80 00000100:00100000:3.0:1746144892.490687:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1984:x1830965175122816:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3838us (4013us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.490696:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10831 00000100:00100000:1.0:1746144892.490939:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.491453:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175123200 00000100:00100000:3.0:1746144892.491458:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175123200 00000100:00100000:3.0:1746144892.491657:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5416 00000100:00100000:3.0:1746144892.491665:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31565:x1830965175123200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.491678:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.491695:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af947e3 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.491724:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947dc expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.491732:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.491734:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.491737:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947e3 expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.491794:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947dc expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.491806:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947dc expref: 5 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.491817:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172423808:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.491891:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.493581:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.493666:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175123328 00000100:00100000:2.0:1746144892.493672:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175123328 00000100:00100000:0.0:1746144892.493695:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.493708:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5417 00000100:00100000:2.0:1746144892.493715:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31579:x1830965175123328:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.493735:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.493748:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d86 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af947ea expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.493789:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746144892.493793:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172423808:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.493794:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947e3 expref: 90 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.493799:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.493802:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d86 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ea expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.493811:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947e3 expref: 90 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.493820:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099536200, rc 0) 00010000:00010000:2.0:1746144892.493825:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947e3 expref: 90 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.493833:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d86 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ea expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.493839:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:2.0:1746144892.493864:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31579:x1830965175123328:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 150us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.493865:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31565:x1830965175123200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2200us (2925us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.493870:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5417 00000100:00100000:3.0:1746144892.494028:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5416 00000100:00100000:2.0:1746144892.494121:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175123456 00000100:00100000:2.0:1746144892.494125:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175123456 00010000:00010000:2.0:1746144892.494142:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947dc expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.494173:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10832 00000100:00100000:2.0:1746144892.494180:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175123456:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.494189:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144892.494208:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947dc expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.494218:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947dc expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.494236:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514d78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947dc expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.494262:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.494263:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.494269:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947e3 expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.494277:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947e3 expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.494295:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947e3 expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.494305:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947e3 expref: 88 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.494314:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172424064:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.494372:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.496111:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172424064:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.496135:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.496184:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175123456:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2003us (2488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.496193:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10832 00000100:00100000:0.0:1746144892.496461:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.496510:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175123712 00000100:00100000:1.0:1746144892.496516:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175123712 00002000:00100000:1.0:1746144892.496552:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b460000 x1830965175123712/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.496562:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460000 with x1830965175123712 ext(0->4095) 00010000:00010000:1.0:1746144892.496570:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947e3 expref: 89 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.496580:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947e3 expref: 89 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.496586:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b460000 00000100:00100000:1.0:1746144892.496615:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2003 00000100:00100000:1.0:1746144892.496622:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175123712:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144892.496819:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175123712:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 197us (358us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.496825:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2003 00002000:00100000:1.0:1746144892.496830:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b460000 x1830965175123712/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.496837:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460000 with x1830965175123712 ext(0->4095) 00010000:00010000:1.0:1746144892.496841:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947e3 expref: 89 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.496849:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947e3 expref: 89 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.496854:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b460000 00000100:00100000:0.0:1746144892.498267:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.498317:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175123840 00000100:00100000:2.0:1746144892.498322:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175123840 00010000:00010000:2.0:1746144892.498348:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947e3 expref: 89 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.498380:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10833 00000100:00100000:2.0:1746144892.498387:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1983:x1830965175123840:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.498398:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144892.498415:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947e3 expref: 89 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.498425:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947e3 expref: 89 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.498448:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099536200/0x4076af6727514d7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947e3 expref: 89 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.498462:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.498464:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.498471:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ea expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.498480:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ea expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.498519:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ea expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.498530:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172424192:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.498612:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.501429:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.501513:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172424192:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.501533:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.501581:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1983:x1830965175123840:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3194us (3317us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.501591:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10833 00000100:00100000:3.0:1746144892.501795:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175124096 00000100:00100000:3.0:1746144892.501802:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175124096 00002000:00100000:3.0:1746144892.501835:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b461c00 x1830965175124096/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.501844:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b461c00 with x1830965175124096 ext(0->4095) 00002000:00010000:3.0:1746144892.501848:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b461c00 00000100:00100000:3.0:1746144892.501862:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3997 00000100:00100000:3.0:1746144892.501867:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175124096:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144892.502020:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175124096:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 153us (599us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.502026:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3997 00002000:00100000:3.0:1746144892.502030:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b461c00 x1830965175124096/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.502036:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b461c00 with x1830965175124096 ext(0->4095) 00002000:00010000:3.0:1746144892.502039:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b461c00 00000100:00100000:0.0:1746144892.504458:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.504528:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175124224 00000100:00100000:3.0:1746144892.504534:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175124224 00000100:00100000:3.0:1746144892.504580:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5418 00000100:00100000:3.0:1746144892.504586:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175124224:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.504600:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.504617:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800ace10400/0x4076af6727514d8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af947f1 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.504643:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ea expref: 87 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.504655:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.504657:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.504661:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ace10400/0x4076af6727514d8d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f1 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.504689:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ea expref: 87 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.504700:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ea expref: 87 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.504710:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172424320:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.504806:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.506564:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.506722:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175124352 00000100:00100000:2.0:1746144892.506728:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175124352 00010000:00010000:2.0:1746144892.506787:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d86 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ea expref: 88 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.506803:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172424320:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.506809:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10834 00000100:00100000:2.0:1746144892.506816:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175124352:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.506825:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800ace10400/0x4076af6727514d8d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f1 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.506827:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.506838:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800ace10400, rc 0) 00010000:00010000:2.0:1746144892.506847:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ea expref: 88 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.506856:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ea expref: 88 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.506876:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514d86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ea expref: 88 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.506881:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175124224:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2295us (2429us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.506887:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5418 00010000:00010000:2.0:1746144892.506898:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.506900:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.506907:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800ace10400/0x4076af6727514d8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.506914:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800ace10400/0x4076af6727514d8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.506938:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800ace10400/0x4076af6727514d8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.506947:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172424448:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.507001:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.508896:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.509010:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175124608 00000100:00100000:1.0:1746144892.509016:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175124608 00002000:00100000:1.0:1746144892.509053:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b4f8380 x1830965175124608/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.509064:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4f8380 with x1830965175124608 ext(0->4095) 00002000:00010000:1.0:1746144892.509068:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4f8380 00000100:00100000:2.0:1746144892.509176:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172424448:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.509194:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.509236:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175124352:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2420us (2676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.509244:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10834 00000100:00100000:1.0:1746144892.509538:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3998 00000100:00100000:1.0:1746144892.509547:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175124608:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144892.509710:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175124608:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 164us (818us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.509716:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3998 00002000:00100000:1.0:1746144892.509721:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b4f8380 x1830965175124608/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.509728:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4f8380 with x1830965175124608 ext(0->4095) 00002000:00010000:1.0:1746144892.509731:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4f8380 00000100:00100000:0.0:1746144892.510727:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.510795:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175124736 00000100:00100000:3.0:1746144892.510801:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175124736 00000100:00100000:3.0:1746144892.510840:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5419 00000100:00100000:3.0:1746144892.510845:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31579:x1830965175124736:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.510859:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.510876:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af947f8 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.510901:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800ace10400/0x4076af6727514d8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.510920:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.510923:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.510926:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f8 expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.510967:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800ace10400/0x4076af6727514d8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.510978:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800ace10400/0x4076af6727514d8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f1 expref: 5 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.510989:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172424576:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.511055:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.511726:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.512148:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175124864 00000100:00100000:2.0:1746144892.512153:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175124864 00000100:00100000:2.0:1746144892.512190:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5420 00000100:00100000:2.0:1746144892.512195:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31565:x1830965175124864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.512203:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.512212:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af947ff expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.512231:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.512235:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f8 expref: 90 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.512240:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.512243:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ff expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.512261:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f8 expref: 90 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.512270:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ff expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.512279:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:2.0:1746144892.512311:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31565:x1830965175124864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 116us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.512316:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5420 00000100:00100000:3.0:1746144892.514491:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172424576:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.514523:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f8 expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.514536:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099537600, rc 0) 00000100:00100000:3.0:1746144892.514577:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31579:x1830965175124736:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3731us (3852us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.514586:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5419 00000100:00100000:0.0:1746144892.514971:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.515283:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175124992 00000100:00100000:3.0:1746144892.515288:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175124992 00010000:00010000:3.0:1746144892.515310:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800ace10400/0x4076af6727514d8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f1 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.515336:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10835 00000100:00100000:3.0:1746144892.515342:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175124992:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.515354:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.515377:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800ace10400/0x4076af6727514d8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f1 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.515387:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800ace10400/0x4076af6727514d8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f1 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.515407:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800ace10400/0x4076af6727514d8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f1 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.515429:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.515431:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.515437:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f8 expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.515445:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f8 expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.515470:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f8 expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.515480:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f8 expref: 88 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.515489:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172424832:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.516342:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.518658:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.518809:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172424832:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.518829:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.519385:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175124992:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4040us (4411us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.519396:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10835 00000100:00100000:2.0:1746144892.519657:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175125248 00000100:00100000:2.0:1746144892.519665:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175125248 00002000:00100000:2.0:1746144892.519711:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc4700 x1830965175125248/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.519721:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4700 with x1830965175125248 ext(0->4095) 00010000:00010000:2.0:1746144892.519729:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f8 expref: 89 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.519748:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f8 expref: 89 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.519755:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bbc4700 00000100:00100000:2.0:1746144892.519808:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2004 00000100:00100000:2.0:1746144892.519817:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175125248:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144892.519998:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175125248:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 182us (1348us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.520005:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2004 00002000:00100000:2.0:1746144892.520010:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc4700 x1830965175125248/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.520016:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4700 with x1830965175125248 ext(0->4095) 00010000:00010000:2.0:1746144892.520021:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f8 expref: 89 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.520030:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f8 expref: 89 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.520035:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bbc4700 00000100:00100000:0.0:1746144892.522330:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.522694:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175125376 00000100:00100000:3.0:1746144892.522701:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175125376 00000100:00100000:3.0:1746144892.522751:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5421 00000100:00100000:3.0:1746144892.522758:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175125376:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.522793:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.522811:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94806 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.522835:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.522841:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ff expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.522847:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144892.522850:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94806 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.522892:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ff expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.522903:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94806 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.522912:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db2f600, rc 0) 00000100:00100000:3.0:1746144892.522967:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175125376:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 208us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.522973:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5421 00000100:00100000:0.0:1746144892.524354:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.524426:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175125504 00000100:00100000:3.0:1746144892.524430:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175125504 00010000:00010000:3.0:1746144892.524455:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f8 expref: 89 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.525086:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10836 00000100:00100000:3.0:1746144892.525095:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175125504:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.525108:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.525130:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f8 expref: 89 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.525144:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f8 expref: 89 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.525166:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514d94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947f8 expref: 89 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.525197:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.525200:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.525206:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ff expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.525214:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ff expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.525253:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ff expref: 88 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.525266:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ff expref: 88 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.525278:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172425088:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.525378:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41676c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.527640:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172425088:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.527662:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.527710:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175125504:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2615us (3358us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.527721:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10836 00000100:00100000:0.0:1746144892.528374:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.528447:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175125760 00000100:00100000:1.0:1746144892.528453:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175125760 00002000:00100000:1.0:1746144892.528496:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b030e00 x1830965175125760/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.528506:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b030e00 with x1830965175125760 ext(0->4095) 00010000:00010000:1.0:1746144892.528515:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ff expref: 88 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.528527:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ff expref: 88 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.528533:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b030e00 00000100:00100000:1.0:1746144892.528666:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2005 00000100:00100000:1.0:1746144892.528672:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175125760:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144892.528980:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175125760:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 307us (606us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.528990:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2005 00002000:00100000:1.0:1746144892.528995:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b030e00 x1830965175125760/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.529003:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b030e00 with x1830965175125760 ext(0->4095) 00010000:00010000:1.0:1746144892.529007:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ff expref: 88 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.529017:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ff expref: 88 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.529022:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b030e00 00000100:00100000:0.0:1746144892.530723:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.530827:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.530910:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175125888 00000100:00100000:2.0:1746144892.530918:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175125888 00000100:00100000:2.0:1746144892.530973:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5422 00000100:00100000:2.0:1746144892.530981:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31565:x1830965175125888:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.530997:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.531021:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514da9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9480d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.531102:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175126016 00000100:00100000:3.0:1746144892.531106:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175126016 00010000:00010000:3.0:1746144892.531123:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ff expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.531155:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10837 00000100:00100000:3.0:1746144892.531160:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965175126016:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.531171:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.531191:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ff expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.531196:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.531201:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94806 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.531207:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144892.531210:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514da9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9480d expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.531293:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ff expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.531311:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514d9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af947ff expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.531322:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.531323:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94806 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.531324:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.531329:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94806 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.531336:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94806 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.531346:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514da9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9480d expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.531354:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00010000:00010000:3.0:1746144892.531358:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94806 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.531368:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94806 expref: 5 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.531383:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172425344:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.531400:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31565:x1830965175125888:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 420us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.531405:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5422 00000100:00100000:3.0:1746144892.531438:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.533334:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.533427:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172425344:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.533443:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.533479:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175126016:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2314us (2647us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.533487:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10837 00000100:00100000:1.0:1746144892.533557:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175126272 00000100:00100000:1.0:1746144892.533563:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175126272 00002000:00100000:1.0:1746144892.533596:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b032300 x1830965175126272/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.533605:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b032300 with x1830965175126272 ext(0->4095) 00010000:00010000:1.0:1746144892.533612:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94806 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.533623:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94806 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.533630:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b032300 00000100:00100000:1.0:1746144892.533659:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2006 00000100:00100000:1.0:1746144892.533665:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175126272:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144892.534041:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175126272:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 375us (715us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.534047:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2006 00002000:00100000:1.0:1746144892.534052:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b032300 x1830965175126272/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.534060:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b032300 with x1830965175126272 ext(0->4095) 00010000:00010000:1.0:1746144892.534064:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94806 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.534073:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94806 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.534079:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b032300 00000100:00100000:0.0:1746144892.535515:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.535563:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175126400 00000100:00100000:3.0:1746144892.535569:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175126400 00010000:00010000:3.0:1746144892.535592:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94806 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.535612:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10838 00000100:00100000:3.0:1746144892.535619:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b032d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175126400:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.535629:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.535644:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94806 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.535654:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94806 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.535674:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db2f600/0x4076af6727514da2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94806 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.535694:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.535697:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.535703:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514da9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9480d expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.535709:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514da9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9480d expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.535735:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514da9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9480d expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.535743:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172425472:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.535915:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41676c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.537156:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172425472:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.537172:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.537213:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b032d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175126400:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1594us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.537222:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10838 00000100:00100000:0.0:1746144892.537533:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.537626:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175126656 00000100:00100000:1.0:1746144892.537631:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175126656 00002000:00100000:1.0:1746144892.537662:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b031500 x1830965175126656/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.537671:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031500 with x1830965175126656 ext(0->4095) 00002000:00010000:1.0:1746144892.537675:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b031500 00000100:00100000:1.0:1746144892.537700:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 3999 00000100:00100000:1.0:1746144892.537706:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175126656:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144892.537891:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175126656:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 184us (358us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.537897:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 3999 00002000:00100000:1.0:1746144892.537903:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b031500 x1830965175126656/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.537910:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031500 with x1830965175126656 ext(0->4095) 00002000:00010000:1.0:1746144892.537913:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b031500 00000100:00100000:0.0:1746144892.542528:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.542592:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175126784 00000100:00100000:2.0:1746144892.542602:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175126784 00000100:00100000:2.0:1746144892.542657:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5423 00000100:00100000:2.0:1746144892.542665:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175126784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.542683:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.542701:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514db0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94814 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.542735:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514da9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9480d expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.542743:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.542745:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.542749:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514db0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94814 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.542813:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514da9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9480d expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.542826:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514da9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9480d expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.542837:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172425600:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.542925:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.544631:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172425600:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.544661:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514db0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94814 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.544678:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:2.0:1746144892.544714:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175126784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2048us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.544722:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5423 00000100:00100000:0.0:1746144892.545062:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.545257:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175126912 00000100:00100000:3.0:1746144892.545263:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175126912 00010000:00010000:3.0:1746144892.545288:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514da9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9480d expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.545320:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10839 00000100:00100000:3.0:1746144892.545326:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175126912:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.545338:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.545359:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514da9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9480d expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.545374:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514da9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9480d expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.545395:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514da9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9480d expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.545411:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.545413:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.545419:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514db0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94814 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.545427:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514db0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94814 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.545453:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514db0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94814 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.545464:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172425728:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.545519:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.549004:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.549033:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172425728:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144892.549043:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:3.0:1746144892.549054:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.549103:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175127296 00000100:00100000:2.0:1746144892.549110:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175127296 00000100:00100000:1.0:1746144892.549113:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175127168 00000100:00100000:1.0:1746144892.549118:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175127168 00000100:00100000:2.0:1746144892.549148:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5424 00002000:00100000:1.0:1746144892.549152:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b031f80 x1830965175127168/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1746144892.549155:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31565:x1830965175127296:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00002000:00100000:1.0:1746144892.549161:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031f80 with x1830965175127168 ext(0->4095) 00002000:00010000:1.0:1746144892.549165:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b031f80 00010000:00010000:2.0:1746144892.549168:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144892.549180:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4000 00010000:00010000:2.0:1746144892.549184:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9481b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.549185:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175127168:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00010000:00010000:2.0:1746144892.549206:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514db0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94814 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.549213:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.549215:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.549218:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9481b expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.549244:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514db0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94814 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.549254:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175126912:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3926us (4191us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144892.549256:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514db0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94814 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.549262:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10839 00000100:00100000:2.0:1746144892.549265:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172425856:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144892.549443:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175127168:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 257us (448us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.549448:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4000 00000100:00100000:2.0:1746144892.549599:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fe40 going to sleep for 11 seconds 00002000:00100000:1.0:1746144892.549755:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b031f80 x1830965175127168/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.549793:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031f80 with x1830965175127168 ext(0->4095) 00010000:00010000:1.0:1746144892.549799:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514db0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94814 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.549809:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514db0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94814 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.549815:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b031f80 00000100:00100000:0.0:1746144892.552507:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.552581:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175127424 00000100:00100000:1.0:1746144892.552589:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175127424 00000100:00100000:2.0:1746144892.552623:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172425856:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.552656:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9481b expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.552681:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d200, rc 0) 00000100:00100000:2.0:1746144892.552727:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31565:x1830965175127296:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3573us (3682us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.552735:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5424 00000100:00100000:2.0:1746144892.553577:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5425 00000100:00100000:2.0:1746144892.553591:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31579:x1830965175127424:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.553606:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.553621:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94822 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.553641:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.553646:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9481b expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.553651:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.553654:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94822 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.553682:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9481b expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.553692:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94822 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.553700:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:0.0:1746144892.554137:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.554248:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175127552 00000100:00100000:3.0:1746144892.554253:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175127552 00010000:00010000:3.0:1746144892.554274:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514db0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94814 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.554292:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10840 00000100:00100000:3.0:1746144892.554297:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175127552:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.554305:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.554327:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514db0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94814 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.554337:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514db0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94814 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.554353:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514db0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94814 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.554406:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31579:x1830965175127424:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 820us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.554415:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5425 00010000:00010000:3.0:1746144892.555032:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.555035:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.555042:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9481b expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.555051:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9481b expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.555078:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9481b expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.555088:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9481b expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.555103:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172426112:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.555701:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167900 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.557683:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172426112:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.557703:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.557741:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175127552:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3442us (3603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.557750:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10840 00000100:00100000:0.0:1746144892.558963:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.559099:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175127808 00000100:00100000:1.0:1746144892.559106:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175127808 00002000:00100000:1.0:1746144892.559149:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b031c00 x1830965175127808/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.559158:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031c00 with x1830965175127808 ext(0->4095) 00010000:00010000:1.0:1746144892.559168:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9481b expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.559181:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9481b expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.559189:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b031c00 00000100:00100000:1.0:1746144892.559210:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2007 00000100:00100000:1.0:1746144892.559217:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175127808:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144892.559395:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175127808:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 178us (444us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.559401:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2007 00002000:00100000:1.0:1746144892.559406:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b031c00 x1830965175127808/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.559413:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031c00 with x1830965175127808 ext(0->4095) 00010000:00010000:1.0:1746144892.559417:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9481b expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.559425:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9481b expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.559431:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b031c00 00000100:00100000:0.0:1746144892.562334:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.570870:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175127936 00000100:00100000:3.0:1746144892.570884:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175127936 00010000:00010000:3.0:1746144892.570936:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9481b expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.571000:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10841 00000100:00100000:3.0:1746144892.571009:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175127936:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.571022:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.571042:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9481b expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.571055:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9481b expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.571078:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d200/0x4076af6727514db7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9481b expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.571112:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.571115:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.571122:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94822 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.571130:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94822 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.571163:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94822 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.571175:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172426240:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.571272:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.576365:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.576448:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172426240:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.576468:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.576526:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175127936:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5518us (14200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.576537:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10841 00000100:00100000:2.0:1746144892.581542:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175128192 00000100:00100000:2.0:1746144892.581556:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175128192 00002000:00100000:2.0:1746144892.581622:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b032d80 x1830965175128192/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.581632:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b032d80 with x1830965175128192 ext(0->4095) 00002000:00010000:2.0:1746144892.581638:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b032d80 00000100:00100000:2.0:1746144892.581673:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4001 00000100:00100000:2.0:1746144892.581681:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175128192:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144892.581907:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175128192:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 226us (5553us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.581913:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4001 00002000:00100000:2.0:1746144892.581918:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b032d80 x1830965175128192/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.581925:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b032d80 with x1830965175128192 ext(0->4095) 00002000:00010000:2.0:1746144892.581927:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b032d80 00000100:00100000:0.0:1746144892.590872:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.591006:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175128320 00000100:00100000:2.0:1746144892.591021:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175128320 00000100:00100000:2.0:1746144892.591070:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5426 00000100:00100000:2.0:1746144892.591082:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175128320:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.591103:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.591121:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94829 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.591158:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94822 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.591165:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.591166:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.591169:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94829 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.591199:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94822 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.591210:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94822 expref: 87 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.591222:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172426368:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.591305:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.596622:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.601154:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172426368:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144892.601197:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94829 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.601221:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:0.0:1746144892.601295:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175128320:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 10213us (10432us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144892.601308:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5426 00000100:00100000:0.0:1746144892.601353:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175128448 00000100:00100000:0.0:1746144892.601359:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175128448 00002000:00100000:0.0:1746144892.601395:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800925a9c00 x1830965175128448/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 496/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144892.601404:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9c00 with x1830965175128448 ext(0->7) 00010000:00010000:0.0:1746144892.601410:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94822 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:0.0:1746144892.601421:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94822 expref: 88 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:0.0:1746144892.601426:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925a9c00 00000100:00100000:0.0:1746144892.601439:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2008 00000100:00100000:0.0:1746144892.601444:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175128448:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:0.0:1746144892.601739:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965175128448:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 294us (5129us total) trans 4294968007 rc 0/0 00000100:00100000:0.0:1746144892.601745:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2008 00002000:00100000:0.0:1746144892.601751:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800925a9c00 x1830965175128448/t4294968007(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 496/448 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144892.601782:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9c00 with x1830965175128448 ext(0->7) 00010000:00010000:0.0:1746144892.601787:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94822 expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:0.0:1746144892.601796:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94822 expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:0.0:1746144892.601801:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925a9c00 00010000:00010000:2.0:1746144892.603583:0:7101:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144892.604059:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.604135:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175128576 00000100:00100000:2.0:1746144892.604142:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175128576 00000100:00100000:2.0:1746144892.604184:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5427 00000100:00100000:2.0:1746144892.604190:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31565:x1830965175128576:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.604203:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.604217:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514dcc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94830 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.604240:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.604246:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94829 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.604252:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144892.604255:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514dcc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94830 expref: 91 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.604291:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94829 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.604299:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514dcc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94830 expref: 91 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.604307:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:2.0:1746144892.604347:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31565:x1830965175128576:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 157us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.604352:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5427 00000100:00100000:0.0:1746144892.606387:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.606641:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175128704 00000100:00100000:3.0:1746144892.606649:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175128704 00010000:00010000:3.0:1746144892.606683:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94822 expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.606708:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10842 00000100:00100000:3.0:1746144892.606715:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1982:x1830965175128704:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.606727:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746144892.606748:0:7097:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 1746144892 -> 1746144893 00002000:00010000:3.0:1746144892.606751:0:7097:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 1746144892 -> 1746144893 00010000:00010000:3.0:1746144892.606758:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94822 expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.606786:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94822 expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.606807:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94822 expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.606984:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.606987:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.606995:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94829 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.607006:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94829 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.607039:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94829 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.607050:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94829 expref: 5 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.607062:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172426624:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.607285:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167900 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.608648:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172426624:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.608665:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.608719:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1982:x1830965175128704:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2002us (2339us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.608728:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10842 00000100:00100000:0.0:1746144892.608792:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.608862:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175128960 00000100:00100000:2.0:1746144892.608868:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175128960 00002000:00100000:2.0:1746144892.608909:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925a9f80 x1830965175128960/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.608918:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9f80 with x1830965175128960 ext(0->4095) 00010000:00010000:2.0:1746144892.608926:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94829 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.608942:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94829 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.608964:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925a9f80 00000100:00100000:2.0:1746144892.608988:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2009 00000100:00100000:2.0:1746144892.608997:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175128960:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.609429:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175128960:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 434us (637us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.609435:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2009 00002000:00100000:2.0:1746144892.609440:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925a9f80 x1830965175128960/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.609448:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9f80 with x1830965175128960 ext(0->4095) 00010000:00010000:2.0:1746144892.609452:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94829 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.609461:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94829 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.609466:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925a9f80 00000100:00100000:0.0:1746144892.611121:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.611177:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175129088 00000100:00100000:3.0:1746144892.611187:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175129088 00010000:00010000:3.0:1746144892.611213:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94829 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.611247:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10843 00000100:00100000:3.0:1746144892.611253:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175129088:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.611264:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.611283:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94829 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.611294:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94829 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.611315:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514dc5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94829 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.611328:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.611330:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.611336:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514dcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94830 expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.611344:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514dcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94830 expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.611377:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514dcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94830 expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.611386:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172426752:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.611536:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167900 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.614343:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172426752:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.614365:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.614422:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175129088:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3167us (3305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.614432:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10843 00000100:00100000:0.0:1746144892.615048:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.615212:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175129344 00000100:00100000:2.0:1746144892.615218:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175129344 00002000:00100000:2.0:1746144892.615257:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925a9180 x1830965175129344/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.615266:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9180 with x1830965175129344 ext(0->4095) 00002000:00010000:2.0:1746144892.615270:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925a9180 00000100:00100000:2.0:1746144892.615284:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4002 00000100:00100000:2.0:1746144892.615291:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965175129344:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144892.615446:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965175129344:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 155us (399us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.615452:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4002 00002000:00100000:2.0:1746144892.615457:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925a9180 x1830965175129344/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.615463:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9180 with x1830965175129344 ext(0->4095) 00002000:00010000:2.0:1746144892.615466:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925a9180 00000100:00100000:0.0:1746144892.618465:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.618614:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175129472 00000100:00100000:2.0:1746144892.618622:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175129472 00000100:00100000:2.0:1746144892.618666:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5428 00000100:00100000:2.0:1746144892.618673:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175129472:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.618689:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.618706:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514dd3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94837 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.618733:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514dcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94830 expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.618741:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.618743:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.618746:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514dd3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94837 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.618805:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514dcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94830 expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.618822:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514dcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94830 expref: 89 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.618834:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172426880:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.618919:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.621044:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172426880:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.621075:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514dd3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94837 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144892.621078:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1746144892.621090:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:2.0:1746144892.621169:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175129472:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2494us (2712us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.621177:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175129600 00000100:00100000:2.0:1746144892.621177:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5428 00000100:00100000:3.0:1746144892.621183:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175129600 00010000:00010000:3.0:1746144892.621208:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514dcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94830 expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.621227:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10844 00000100:00100000:3.0:1746144892.621233:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965175129600:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.621245:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.621265:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514dcc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94830 expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.621275:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514dcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94830 expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.621414:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514dcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94830 expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.621515:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.621518:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.621526:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514dd3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94837 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.621534:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514dd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94837 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.621561:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514dd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94837 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.621571:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172427008:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.621662:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167900 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.623202:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172427008:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.623218:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.623244:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175129600:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2011us (2166us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.623253:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10844 00000100:00100000:0.0:1746144892.623982:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.624004:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175129856 00000100:00100000:0.0:1746144892.624010:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175129856 00002000:00100000:0.0:1746144892.624045:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925a9880 x1830965175129856/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144892.624055:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9880 with x1830965175129856 ext(0->4095) 00002000:00010000:0.0:1746144892.624059:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925a9880 00000100:00100000:0.0:1746144892.624089:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4003 00000100:00100000:0.0:1746144892.624095:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175129856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144892.624277:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175129856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 181us (296us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144892.624283:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4003 00002000:00100000:0.0:1746144892.624288:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925a9880 x1830965175129856/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144892.624294:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9880 with x1830965175129856 ext(0->4095) 00002000:00010000:0.0:1746144892.624297:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925a9880 00000100:00100000:0.0:1746144892.626586:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.627063:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175129984 00000100:00100000:2.0:1746144892.627073:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175129984 00000100:00100000:2.0:1746144892.627124:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5429 00000100:00100000:2.0:1746144892.627131:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31565:x1830965175129984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.627151:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.627171:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9483e expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.627205:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514dd3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94837 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.627219:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.627221:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.627225:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9483e expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.627267:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514dd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94837 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.627284:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514dd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94837 expref: 5 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.627296:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172427136:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144892.627806:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.627853:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175130112 00000100:00100000:0.0:1746144892.627857:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175130112 00000100:00100000:0.0:1746144892.627880:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5430 00000100:00100000:0.0:1746144892.627885:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31579:x1830965175130112:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144892.627892:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144892.627900:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514de1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94845 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.627915:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144892.627919:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9483e expref: 92 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.627924:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144892.627927:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514de1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94845 expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.627960:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9483e expref: 92 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.627971:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514de1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94845 expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.627982:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:0.0:1746144892.628022:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31579:x1830965175130112:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 137us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144892.628027:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5430 00000100:00100000:2.0:1746144892.628324:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f600 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.629475:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172427136:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.629502:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9483e expref: 91 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.629583:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5de00, rc 0) 00000100:00100000:2.0:1746144892.629690:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31565:x1830965175129984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2558us (3114us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.629696:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5429 00000100:00100000:0.0:1746144892.630478:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.630662:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175130240 00000100:00100000:3.0:1746144892.630671:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175130240 00010000:00010000:3.0:1746144892.630702:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514dd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94837 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.630732:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10845 00000100:00100000:3.0:1746144892.630737:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175130240:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.630751:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.630795:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514dd3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94837 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.630806:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514dd3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94837 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.630827:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514dd3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94837 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.630847:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.630850:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.630857:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9483e expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.630864:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9483e expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.630895:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9483e expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.630906:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9483e expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.630916:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172427392:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.631010:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167900 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.632845:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172427392:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.632866:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.632902:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175130240:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2163us (2424us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.632912:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10845 00000100:00100000:0.0:1746144892.633684:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.633810:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175130496 00000100:00100000:3.0:1746144892.633816:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175130496 00002000:00100000:3.0:1746144892.633856:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5f100 x1830965175130496/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.633865:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5f100 with x1830965175130496 ext(0->4095) 00010000:00010000:3.0:1746144892.633874:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9483e expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.633886:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9483e expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.633892:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5f100 00000100:00100000:3.0:1746144892.634015:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2010 00000100:00100000:3.0:1746144892.634023:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175130496:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144892.634191:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175130496:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 169us (510us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.634198:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2010 00002000:00100000:3.0:1746144892.634203:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5f100 x1830965175130496/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.634211:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5f100 with x1830965175130496 ext(0->4095) 00010000:00010000:3.0:1746144892.634215:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9483e expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.634224:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9483e expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.634229:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5f100 00000100:00100000:0.0:1746144892.635869:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.635928:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175130624 00000100:00100000:3.0:1746144892.635933:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175130624 00010000:00010000:3.0:1746144892.635959:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9483e expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.636048:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10846 00000100:00100000:3.0:1746144892.636053:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1985:x1830965175130624:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.636064:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.636080:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9483e expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.636090:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9483e expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.636112:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5de00/0x4076af6727514dda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9483e expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.636135:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.636137:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.636144:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514de1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94845 expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.636157:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514de1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94845 expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.636189:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514de1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94845 expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.636201:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172427520:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.636827:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.639211:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.639404:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172427520:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.639424:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.639464:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965175130624:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3410us (3600us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.639474:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10846 00000100:00100000:2.0:1746144892.639573:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175130880 00000100:00100000:2.0:1746144892.639579:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175130880 00002000:00100000:2.0:1746144892.639619:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5d180 x1830965175130880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.639634:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5d180 with x1830965175130880 ext(0->4095) 00002000:00010000:2.0:1746144892.639638:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5d180 00000100:00100000:2.0:1746144892.639668:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4004 00000100:00100000:2.0:1746144892.639676:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175130880:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.639869:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175130880:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 194us (668us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.639875:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4004 00002000:00100000:2.0:1746144892.639880:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5d180 x1830965175130880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.639887:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5d180 with x1830965175130880 ext(0->4095) 00002000:00010000:2.0:1746144892.639889:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5d180 00000100:00100000:0.0:1746144892.642126:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.642241:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175131008 00000100:00100000:2.0:1746144892.642249:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175131008 00000100:00100000:2.0:1746144892.642305:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5431 00000100:00100000:2.0:1746144892.642314:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175131008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.642329:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.642350:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514de8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9484c expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.642378:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514de1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94845 expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.642387:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.642388:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.642393:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514de8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9484c expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.642423:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514de1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94845 expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.642436:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94845 expref: 89 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.642447:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172427648:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.642544:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.645574:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172427648:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.645610:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514de8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9484c expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.645625:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:2.0:1746144892.645674:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175131008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3361us (3555us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.645683:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5431 00000100:00100000:0.0:1746144892.646858:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.646938:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175131136 00000100:00100000:3.0:1746144892.646946:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175131136 00010000:00010000:3.0:1746144892.647228:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94845 expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.647265:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10847 00000100:00100000:3.0:1746144892.647273:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965175131136:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.647286:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.647307:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514de1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94845 expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.647323:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514de1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94845 expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.647346:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727514de1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94845 expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.647373:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.647375:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.647382:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514de8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9484c expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.647389:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514de8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9484c expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.647423:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514de8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9484c expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.647434:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172427776:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.647651:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167600 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.649446:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172427776:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.649466:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.649502:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175131136:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2230us (2647us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.649510:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10847 00000100:00100000:0.0:1746144892.650644:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.650680:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.650744:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175131392 00000100:00100000:1.0:1746144892.650752:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175131392 00002000:00100000:1.0:1746144892.650849:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ca80 x1830965175131392/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.650859:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ca80 with x1830965175131392 ext(0->4095) 00002000:00010000:1.0:1746144892.650864:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ca80 00000100:00100000:1.0:1746144892.650883:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4005 00000100:00100000:1.0:1746144892.650890:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175131392:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144892.651068:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175131392:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 178us (429us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.651074:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4005 00002000:00100000:1.0:1746144892.651079:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ca80 x1830965175131392/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.651086:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ca80 with x1830965175131392 ext(0->4095) 00002000:00010000:1.0:1746144892.651089:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ca80 00000100:00100000:3.0:1746144892.651254:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175131520 00000100:00100000:3.0:1746144892.651259:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175131520 00000100:00100000:3.0:1746144892.651280:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5432 00000100:00100000:3.0:1746144892.651285:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31565:x1830965175131520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.651294:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.651310:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94853 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.651333:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514de8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9484c expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.651340:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.651342:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.651346:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94853 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.651376:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514de8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9484c expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.651387:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514de8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9484c expref: 5 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.651397:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172427904:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.653475:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167600 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.655380:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172427904:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.655412:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94853 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.655435:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f2b2400, rc 0) 00000100:00100000:3.0:1746144892.655479:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31565:x1830965175131520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4192us (4796us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.655488:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5432 00000100:00100000:0.0:1746144892.656706:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.657559:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175131648 00000100:00100000:3.0:1746144892.657567:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175131648 00000100:00100000:0.0:1746144892.658970:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.659062:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5433 00000100:00100000:3.0:1746144892.659075:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31579:x1830965175131648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.659094:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.659113:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514df6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9485a expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.659143:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.659149:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94853 expref: 91 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.659155:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.659158:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514df6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9485a expref: 91 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.659193:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94853 expref: 91 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.659204:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514df6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9485a expref: 91 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.659219:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f2b3c00, rc 0) 00000100:00100000:2.0:1746144892.659248:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175131776 00000100:00100000:2.0:1746144892.659253:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175131776 00000100:00100000:3.0:1746144892.659277:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31579:x1830965175131648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 206us (2575us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144892.659278:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514de8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9484c expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.659283:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5433 00000100:00100000:2.0:1746144892.659499:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10848 00000100:00100000:2.0:1746144892.659506:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175131776:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.659515:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144892.659657:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514de8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9484c expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.659669:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514de8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9484c expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.659687:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514de8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9484c expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.659711:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.659713:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.659719:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94853 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.659727:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94853 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.659748:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94853 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.659946:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94853 expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.659970:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172428160:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.660043:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.663190:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172428160:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.663220:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.663266:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175131776:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3759us (4302us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.663278:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10848 00000100:00100000:0.0:1746144892.663677:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.663973:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175132032 00000100:00100000:3.0:1746144892.663981:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175132032 00002000:00100000:3.0:1746144892.664019:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093254700 x1830965175132032/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.664029:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254700 with x1830965175132032 ext(0->4095) 00010000:00010000:3.0:1746144892.664038:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94853 expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.664052:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94853 expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.664058:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093254700 00000100:00100000:3.0:1746144892.664087:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2011 00000100:00100000:3.0:1746144892.664094:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175132032:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144892.665339:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175132032:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 1239us (1657us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.665347:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2011 00002000:00100000:3.0:1746144892.665354:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093254700 x1830965175132032/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.665367:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254700 with x1830965175132032 ext(0->4095) 00010000:00010000:3.0:1746144892.665373:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94853 expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.665386:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94853 expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.665392:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093254700 00000100:00100000:0.0:1746144892.667911:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.667987:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175132160 00000100:00100000:2.0:1746144892.667995:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175132160 00010000:00010000:2.0:1746144892.668042:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94853 expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.668701:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10849 00000100:00100000:2.0:1746144892.668710:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1983:x1830965175132160:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.668724:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144892.668744:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94853 expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.668756:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94853 expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.668819:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514def lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94853 expref: 91 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.668839:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.668841:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.668847:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514df6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9485a expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.668855:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514df6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9485a expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.668886:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514df6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9485a expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.668899:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172428288:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.668991:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.672034:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.672149:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175132416 00000100:00100000:3.0:1746144892.672161:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175132416 00002000:00100000:3.0:1746144892.672206:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093255180 x1830965175132416/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.672215:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093255180 with x1830965175132416 ext(0->4095) 00002000:00010000:3.0:1746144892.672220:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093255180 00000100:00100000:3.0:1746144892.672252:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4006 00000100:00100000:3.0:1746144892.672260:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175132416:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.672406:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172428288:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.672430:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.672450:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175132416:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 190us (424us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.672455:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1983:x1830965175132160:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3747us (4552us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.672458:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4006 00000100:00100000:2.0:1746144892.672463:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10849 00002000:00100000:3.0:1746144892.672464:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093255180 x1830965175132416/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.672472:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093255180 with x1830965175132416 ext(0->4095) 00002000:00010000:3.0:1746144892.672475:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093255180 00000100:00100000:0.0:1746144892.674116:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.674306:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175132544 00000100:00100000:1.0:1746144892.674312:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175132544 00000100:00100000:1.0:1746144892.674367:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5434 00000100:00100000:1.0:1746144892.674374:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175132544:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144892.674387:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144892.674403:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514dfd lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94861 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.674432:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514df6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9485a expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.674439:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144892.674441:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144892.674445:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514dfd lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94861 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.674474:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514df6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9485a expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.674487:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514df6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9485a expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.674498:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172428416:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144892.674614:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.676395:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172428416:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144892.676424:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514dfd lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94861 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.676440:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501200, rc 0) 00000100:00100000:1.0:1746144892.676480:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175132544:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2105us (2367us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.676488:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5434 00000100:00100000:0.0:1746144892.676856:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.677016:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175132672 00000100:00100000:2.0:1746144892.677022:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175132672 00010000:00010000:2.0:1746144892.677053:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514df6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9485a expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.677086:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10850 00000100:00100000:2.0:1746144892.677093:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965175132672:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.677105:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144892.677127:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514df6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9485a expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.677138:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514df6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9485a expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.677233:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514df6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9485a expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.677313:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.677316:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.677323:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514dfd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94861 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.677330:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514dfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94861 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.677359:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514dfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94861 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.677371:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172428544:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.677430:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.678884:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172428544:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.678906:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.679077:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175132672:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1983us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.679086:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10850 00000100:00100000:0.0:1746144892.680362:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.680579:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175132928 00000100:00100000:3.0:1746144892.680588:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175132928 00002000:00100000:3.0:1746144892.680629:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093254a80 x1830965175132928/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.680639:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254a80 with x1830965175132928 ext(0->4095) 00002000:00010000:3.0:1746144892.680644:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093254a80 00000100:00100000:3.0:1746144892.680673:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4007 00000100:00100000:3.0:1746144892.680679:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175132928:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144892.680873:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175132928:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 193us (516us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.680879:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4007 00002000:00100000:3.0:1746144892.680885:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093254a80 x1830965175132928/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.680891:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254a80 with x1830965175132928 ext(0->4095) 00002000:00010000:3.0:1746144892.680894:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093254a80 00000100:00100000:0.0:1746144892.683826:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.683860:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175133056 00000100:00100000:1.0:1746144892.683868:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175133056 00000100:00100000:0.0:1746144892.683908:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.683916:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175133184 00000100:00100000:1.0:1746144892.683918:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175133184 00000100:00100000:1.0:1746144892.683929:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5435 00000100:00100000:0.0:1746144892.683938:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5436 00000100:00100000:0.0:1746144892.683944:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31579:x1830965175133184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144892.683970:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144892.683990:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9486f expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.684018:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514dfd lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94861 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.684026:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144892.684027:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144892.684031:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9486f expref: 91 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.684063:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514dfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94861 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.684075:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514dfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94861 expref: 5 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:0.0:1746144892.684086:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087c5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172428672:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144892.684169:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3600 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.684349:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31565:x1830965175133056:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144892.684356:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144892.684362:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94868 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.684373:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.684377:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9486f expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.684382:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144892.684385:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94868 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.684407:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9486f expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.684416:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94868 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.684425:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500c00, rc 0) 00000100:00100000:1.0:1746144892.684463:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31565:x1830965175133056:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 527us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.684469:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5435 00000100:00100000:2.0:1746144892.686807:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172428672:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.686835:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9486f expref: 91 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.686852:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:2.0:1746144892.686930:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31579:x1830965175133184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2986us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.686937:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5436 00000100:00100000:0.0:1746144892.687924:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.688117:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175133312 00000100:00100000:2.0:1746144892.688124:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175133312 00010000:00010000:2.0:1746144892.688164:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514dfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94861 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.688748:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10851 00000100:00100000:2.0:1746144892.688758:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175133312:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.688805:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144892.688826:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514dfd lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94861 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.688839:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514dfd lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94861 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.688862:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099501200/0x4076af6727514dfd lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94861 expref: 6 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.688890:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.688892:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.688899:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9486f expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.688907:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9486f expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.688940:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9486f expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.688960:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9486f expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.688973:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172428928:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.689042:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.691643:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172428928:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.691670:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.691720:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175133312:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2963us (3796us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.691730:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10851 00000100:00100000:0.0:1746144892.692427:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.693210:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175133568 00000100:00100000:1.0:1746144892.693218:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175133568 00002000:00100000:1.0:1746144892.693256:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5f100 x1830965175133568/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.693264:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5f100 with x1830965175133568 ext(0->4095) 00010000:00010000:1.0:1746144892.693278:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9486f expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.693291:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9486f expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.693297:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5f100 00000100:00100000:1.0:1746144892.693327:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2012 00000100:00100000:1.0:1746144892.693333:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1985:x1830965175133568:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144892.693518:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1985:x1830965175133568:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 184us (1091us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.693524:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2012 00002000:00100000:1.0:1746144892.693529:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5f100 x1830965175133568/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.693536:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5f100 with x1830965175133568 ext(0->4095) 00010000:00010000:1.0:1746144892.693540:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9486f expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.693549:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9486f expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.693555:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5f100 00000100:00100000:0.0:1746144892.695620:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.695781:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175133696 00000100:00100000:2.0:1746144892.695788:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175133696 00000100:00100000:2.0:1746144892.695836:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5437 00000100:00100000:2.0:1746144892.695842:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175133696:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.695854:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.695870:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94876 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.695895:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.695900:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94868 expref: 90 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.695906:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144892.695909:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.695941:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94868 expref: 90 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.695968:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.695977:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:2.0:1746144892.696009:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175133696:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 168us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.696014:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5437 00000100:00100000:0.0:1746144892.697614:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.697681:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175133824 00000100:00100000:2.0:1746144892.697685:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175133824 00010000:00010000:2.0:1746144892.697717:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9486f expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.697746:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10852 00000100:00100000:2.0:1746144892.697753:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175133824:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.697794:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144892.697816:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9486f expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.697827:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9486f expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.697849:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727514e04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9486f expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.697877:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.697879:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.697886:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94868 expref: 90 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.697894:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94868 expref: 90 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.697920:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94868 expref: 90 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.697931:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94868 expref: 90 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.697941:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172429184:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.698009:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.699889:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172429184:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.699914:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.699959:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175133824:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2195us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.699970:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10852 00000100:00100000:0.0:1746144892.701007:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.701062:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175134080 00000100:00100000:1.0:1746144892.701069:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175134080 00002000:00100000:1.0:1746144892.701106:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5d880 x1830965175134080/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.701116:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5d880 with x1830965175134080 ext(0->4095) 00010000:00010000:1.0:1746144892.701125:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94868 expref: 90 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.701138:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94868 expref: 90 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.701144:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5d880 00000100:00100000:1.0:1746144892.701168:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2013 00000100:00100000:1.0:1746144892.701174:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965175134080:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144892.701344:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965175134080:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 169us (342us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.701349:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2013 00002000:00100000:1.0:1746144892.701354:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5d880 x1830965175134080/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.701361:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5d880 with x1830965175134080 ext(0->4095) 00010000:00010000:1.0:1746144892.701366:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94868 expref: 90 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.701375:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94868 expref: 90 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:1.0:1746144892.701385:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5d880 00000100:00100000:0.0:1746144892.702978:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.703051:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.703130:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175134336 00000100:00100000:2.0:1746144892.703136:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175134336 00010000:00010000:2.0:1746144892.703167:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94868 expref: 90 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.703170:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175134208 00000100:00100000:3.0:1746144892.703173:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175134208 00000100:00100000:3.0:1746144892.703202:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5438 00000100:00100000:3.0:1746144892.703209:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31565:x1830965175134208:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:2.0:1746144892.703211:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10853 00000100:00100000:2.0:1746144892.703216:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175134336:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.703220:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.703227:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.703233:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514e19 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9487d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.703243:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94868 expref: 92 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.703255:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.703260:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.703266:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144892.703269:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514e19 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9487d expref: 92 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.703415:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94868 expref: 92 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.703436:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e0b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94868 expref: 92 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.703520:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.703522:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.703528:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.703535:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.703565:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.703575:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 5 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.703586:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172429312:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.703853:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 5 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.703861:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 5 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.703870:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172429440:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.704175:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.704309:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.706942:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.707353:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172429312:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.707379:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.707420:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175134336:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4203us (4446us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.707431:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10853 00000100:00100000:3.0:1746144892.707567:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172429440:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.707589:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514e19 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9487d expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.707604:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f2b2400, rc 0) 00000100:00100000:3.0:1746144892.707627:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31565:x1830965175134208:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4419us (4576us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.707634:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5438 00000100:00100000:3.0:1746144892.707658:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175134592 00000100:00100000:3.0:1746144892.707664:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175134592 00002000:00100000:3.0:1746144892.707695:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5f480 x1830965175134592/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.707705:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5f480 with x1830965175134592 ext(0->4095) 00010000:00010000:3.0:1746144892.707711:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.707723:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.707730:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5f480 00000100:00100000:3.0:1746144892.707744:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2014 00000100:00100000:3.0:1746144892.707750:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175134592:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144892.707923:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175134592:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 172us (988us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.707928:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2014 00002000:00100000:3.0:1746144892.707933:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5f480 x1830965175134592/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.707940:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5f480 with x1830965175134592 ext(0->4095) 00010000:00010000:3.0:1746144892.707944:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.707965:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.707971:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5f480 00000100:00100000:0.0:1746144892.709917:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.709993:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175134720 00000100:00100000:2.0:1746144892.710000:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175134720 00010000:00010000:2.0:1746144892.710034:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.710066:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10854 00000100:00100000:2.0:1746144892.710073:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175134720:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.710086:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144892.710109:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.710119:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.710142:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94876 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.710158:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.710160:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.710166:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514e19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9487d expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.710173:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514e19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9487d expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.710204:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514e19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9487d expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.710214:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172429568:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.710282:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.712517:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172429568:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.712544:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.712599:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175134720:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2524us (2688us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.712609:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10854 00000100:00100000:0.0:1746144892.712877:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.712994:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175134976 00000100:00100000:1.0:1746144892.713001:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175134976 00002000:00100000:1.0:1746144892.713037:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5ce00 x1830965175134976/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.713046:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ce00 with x1830965175134976 ext(0->4095) 00002000:00010000:1.0:1746144892.713050:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5ce00 00000100:00100000:1.0:1746144892.713081:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4008 00000100:00100000:1.0:1746144892.713089:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175134976:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144892.713270:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175134976:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 181us (393us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.713276:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4008 00002000:00100000:1.0:1746144892.713282:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5ce00 x1830965175134976/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.713289:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ce00 with x1830965175134976 ext(0->4095) 00002000:00010000:1.0:1746144892.713292:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5ce00 00000100:00100000:0.0:1746144892.714657:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.714711:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175135104 00000100:00100000:3.0:1746144892.714716:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175135104 00000100:00100000:3.0:1746144892.714859:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5439 00000100:00100000:3.0:1746144892.714866:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175135104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.714876:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.714891:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3000/0x4076af6727514e20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94884 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.714915:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514e19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9487d expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.714922:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.714924:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.714927:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3000/0x4076af6727514e20 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94884 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.714967:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514e19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9487d expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.714978:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514e19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9487d expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.714989:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172429696:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.715212:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.716154:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172429696:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.716175:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3000/0x4076af6727514e20 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94884 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.716187:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f2b3000, rc 0) 00000100:00100000:3.0:1746144892.716224:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175135104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1358us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.716235:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5439 00000100:00100000:0.0:1746144892.717282:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.717351:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175135232 00000100:00100000:2.0:1746144892.717357:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175135232 00010000:00010000:2.0:1746144892.717388:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514e19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9487d expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.717421:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10855 00000100:00100000:2.0:1746144892.717427:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965175135232:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.717437:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144892.717456:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514e19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9487d expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.717466:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514e19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9487d expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.717487:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b2400/0x4076af6727514e19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9487d expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.717503:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.717505:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.717512:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3000/0x4076af6727514e20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94884 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.717519:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3000/0x4076af6727514e20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94884 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.718345:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3000/0x4076af6727514e20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94884 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.718360:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172429824:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.718445:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.722493:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172429824:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144892.722526:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144892.722578:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175135232:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5151us (5297us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144892.722588:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10855 00000100:00100000:0.0:1746144892.722970:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.723556:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175135488 00000100:00100000:3.0:1746144892.723563:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175135488 00002000:00100000:3.0:1746144892.723606:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5d180 x1830965175135488/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00000100:00100000:0.0:1746144892.723606:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00002000:00100000:3.0:1746144892.723615:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5d180 with x1830965175135488 ext(0->4095) 00002000:00010000:3.0:1746144892.723620:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5d180 00000100:00100000:3.0:1746144892.723648:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4009 00000100:00100000:3.0:1746144892.723655:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175135488:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.723753:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175135616 00000100:00100000:2.0:1746144892.723758:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175135616 00000100:00100000:2.0:1746144892.723808:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5440 00000100:00100000:2.0:1746144892.723814:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31565:x1830965175135616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.723823:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.723839:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9488b expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.723860:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175135488:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 204us (889us total) trans 0 rc 4096/4096 00010000:00010000:2.0:1746144892.723861:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3000/0x4076af6727514e20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94884 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.723865:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4009 00010000:00010000:2.0:1746144892.723868:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:3.0:1746144892.723870:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5d180 x1830965175135488/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00010000:00010000:2.0:1746144892.723871:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.723875:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9488b expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746144892.723877:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5d180 with x1830965175135488 ext(0->4095) 00010000:00010000:3.0:1746144892.723881:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3000/0x4076af6727514e20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94884 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.723888:0:31840:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3000/0x4076af6727514e20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94884 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746144892.723893:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5d180 00010000:00010000:2.0:1746144892.723903:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3000/0x4076af6727514e20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94884 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.723914:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3000/0x4076af6727514e20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94884 expref: 5 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.723926:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172429952:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.723994:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.726247:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.726335:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172429952:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.726369:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9488b expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.726386:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:2.0:1746144892.727719:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31565:x1830965175135616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3899us (4106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.727730:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5440 00000100:00100000:3.0:1746144892.727820:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175135744 00000100:00100000:3.0:1746144892.727827:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175135744 00000100:00100000:3.0:1746144892.727873:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5441 00000100:00100000:3.0:1746144892.727879:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31579:x1830965175135744:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.727894:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.727910:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514e2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94892 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.727934:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.727939:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9488b expref: 91 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.727944:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.727960:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514e2e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94892 expref: 91 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.727992:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9488b expref: 91 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.728002:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514e2e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94892 expref: 91 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.728010:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099537600, rc 0) 00000100:00100000:3.0:1746144892.728033:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31579:x1830965175135744:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 155us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.728037:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5441 00000100:00100000:3.0:1746144892.728520:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.728593:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175135872 00000100:00100000:1.0:1746144892.728597:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175135872 00010000:00010000:1.0:1746144892.728619:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3000/0x4076af6727514e20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94884 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.728906:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10856 00000100:00100000:1.0:1746144892.728912:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175135872:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.728924:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.728944:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3000/0x4076af6727514e20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94884 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.728967:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3000/0x4076af6727514e20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94884 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.728986:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3000/0x4076af6727514e20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94884 expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.729001:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.729003:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.729009:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9488b expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.729016:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9488b expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.729039:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9488b expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.729050:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9488b expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.729062:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172430208:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.730957:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.734215:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172430208:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.734237:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144892.734247:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.734287:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175135872:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5374us (5767us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.734298:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10856 00000100:00100000:2.0:1746144892.734413:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175136128 00000100:00100000:2.0:1746144892.734420:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175136128 00002000:00100000:2.0:1746144892.734466:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167e680 x1830965175136128/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.734476:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167e680 with x1830965175136128 ext(0->4095) 00010000:00010000:2.0:1746144892.734486:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9488b expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.734505:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9488b expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.734512:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009167e680 00000100:00100000:2.0:1746144892.735020:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2015 00000100:00100000:2.0:1746144892.735029:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175136128:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.735198:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175136128:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 171us (951us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.735204:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2015 00002000:00100000:2.0:1746144892.735209:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167e680 x1830965175136128/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.735216:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167e680 with x1830965175136128 ext(0->4095) 00010000:00010000:2.0:1746144892.735221:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9488b expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.735230:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9488b expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.735235:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009167e680 00000100:00100000:0.0:1746144892.736683:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.737222:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175136256 00000100:00100000:1.0:1746144892.737230:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175136256 00010000:00010000:1.0:1746144892.737258:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9488b expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.737298:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10857 00000100:00100000:1.0:1746144892.737305:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1983:x1830965175136256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.737413:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.737576:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9488b expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.737589:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9488b expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.737614:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9488b expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.737643:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.737645:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.737652:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514e2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94892 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.737660:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514e2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94892 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.737693:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514e2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94892 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.737705:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172430336:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.737900:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.740144:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.740212:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172430336:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.740233:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.740243:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175136512 00000100:00100000:2.0:1746144892.740248:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175136512 00000100:00100000:1.0:1746144892.740275:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1983:x1830965175136256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2969us (3597us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.740285:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10857 00002000:00100000:2.0:1746144892.740291:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e83b80 x1830965175136512/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.740300:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83b80 with x1830965175136512 ext(0->4095) 00002000:00010000:2.0:1746144892.740305:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e83b80 00000100:00100000:2.0:1746144892.740396:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4010 00000100:00100000:2.0:1746144892.740403:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175136512:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.740673:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175136512:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 270us (537us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.740680:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4010 00002000:00100000:2.0:1746144892.740685:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e83b80 x1830965175136512/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.740692:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83b80 with x1830965175136512 ext(0->4095) 00002000:00010000:2.0:1746144892.740694:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e83b80 00000100:00100000:0.0:1746144892.742122:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.742224:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175136640 00000100:00100000:2.0:1746144892.742230:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175136640 00000100:00100000:2.0:1746144892.742275:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5442 00000100:00100000:2.0:1746144892.742282:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175136640:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.742295:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.742313:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e35 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94899 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.742339:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514e2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94892 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.742347:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.742349:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.742352:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e35 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94899 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.742396:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514e2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94892 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.742408:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514e2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94892 expref: 89 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.742423:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172430464:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.742529:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.744265:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172430464:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144892.744290:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1746144892.744294:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e35 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94899 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.744308:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:1.0:1746144892.744445:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175136768 00000100:00100000:1.0:1746144892.744452:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175136768 00010000:00010000:1.0:1746144892.744477:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514e2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94892 expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.744513:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10858 00000100:00100000:1.0:1746144892.744519:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175136768:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.744532:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.744550:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514e2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94892 expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.744560:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514e2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94892 expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.744580:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099537600/0x4076af6727514e2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94892 expref: 90 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.744607:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.744608:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.744615:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94899 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.744623:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94899 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.744635:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175136640:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2353us (2518us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.744642:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5442 00010000:00010000:1.0:1746144892.744649:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94899 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.744659:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172430592:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.744792:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.745845:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172430592:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.745858:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.745893:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1984:x1830965175136768:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1373us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.745900:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10858 00000100:00100000:0.0:1746144892.746310:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.746452:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175137024 00000100:00100000:2.0:1746144892.746458:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175137024 00002000:00100000:2.0:1746144892.746493:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e82d80 x1830965175137024/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.746502:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82d80 with x1830965175137024 ext(0->4095) 00002000:00010000:2.0:1746144892.746506:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e82d80 00000100:00100000:2.0:1746144892.746532:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4011 00000100:00100000:2.0:1746144892.746539:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175137024:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.746826:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175137024:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 169us (397us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.746834:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4011 00002000:00100000:2.0:1746144892.746839:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e82d80 x1830965175137024/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.746846:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82d80 with x1830965175137024 ext(0->4095) 00002000:00010000:2.0:1746144892.746848:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e82d80 00000100:00100000:0.0:1746144892.749584:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.749678:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175137152 00000100:00100000:2.0:1746144892.749685:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175137152 00000100:00100000:2.0:1746144892.749906:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5443 00000100:00100000:2.0:1746144892.749914:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31579:x1830965175137152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.749930:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.749964:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af948a0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.749993:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e35 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94899 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.750001:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.750003:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.750006:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a0 expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.750034:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94899 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.750050:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94899 expref: 5 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.750062:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172430720:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144892.750935:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450f600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.751167:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.752828:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175137280 00000100:00100000:1.0:1746144892.752840:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175137280 00000100:00100000:1.0:1746144892.752902:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5444 00000100:00100000:1.0:1746144892.752911:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31565:x1830965175137280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144892.752927:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144892.752945:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af948a7 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.752989:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.752994:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a0 expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.753001:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144892.753004:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a7 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.753041:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a0 expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.753052:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a7 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.753061:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500e00, rc 0) 00000100:00100000:1.0:1746144892.753109:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31565:x1830965175137280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 200us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.753115:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5444 00000100:00100000:2.0:1746144892.754656:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172430720:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144892.754684:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a0 expref: 91 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.754697:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:2.0:1746144892.754730:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31579:x1830965175137152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4818us (5154us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.754737:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5443 00000100:00100000:0.0:1746144892.755353:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.755405:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175137408 00000100:00100000:1.0:1746144892.755411:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175137408 00010000:00010000:1.0:1746144892.755436:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94899 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.755913:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10859 00000100:00100000:1.0:1746144892.755921:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175137408:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.755934:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.755966:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e35 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94899 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.755976:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e35 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94899 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.755998:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e35 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94899 expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.756019:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.756021:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.756028:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a0 expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.756035:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a0 expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.756065:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a0 expref: 90 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.756076:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a0 expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.756087:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172430976:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.757254:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.759506:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172430976:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.759526:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.760118:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175137408:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4194us (4762us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.760130:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10859 00000100:00100000:2.0:1746144892.760236:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.760399:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175137664 00000100:00100000:0.0:1746144892.760406:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175137664 00002000:00100000:0.0:1746144892.760447:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e830e00 x1830965175137664/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144892.760457:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e830e00 with x1830965175137664 ext(0->4095) 00010000:00010000:0.0:1746144892.760465:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a0 expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:0.0:1746144892.760489:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a0 expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:0.0:1746144892.760495:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e830e00 00000100:00100000:0.0:1746144892.760522:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2016 00000100:00100000:0.0:1746144892.760529:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175137664:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144892.760690:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175137664:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 161us (454us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144892.760696:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2016 00002000:00100000:0.0:1746144892.760701:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e830e00 x1830965175137664/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144892.760708:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e830e00 with x1830965175137664 ext(0->4095) 00010000:00010000:0.0:1746144892.760713:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a0 expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:0.0:1746144892.760722:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a0 expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:0.0:1746144892.760728:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e830e00 00000100:00100000:0.0:1746144892.762836:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.763228:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175137792 00000100:00100000:2.0:1746144892.763235:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175137792 00000100:00100000:2.0:1746144892.763289:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5445 00000100:00100000:2.0:1746144892.763296:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175137792:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.763311:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.763327:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af948ae expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.763352:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.763358:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a7 expref: 90 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.763369:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144892.763372:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ae expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.763407:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a7 expref: 90 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.763417:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ae expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.763427:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:2.0:1746144892.763462:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175137792:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 167us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.763467:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5445 00000100:00100000:0.0:1746144892.764902:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.765077:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175137920 00000100:00100000:1.0:1746144892.765082:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175137920 00010000:00010000:1.0:1746144892.765111:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a0 expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.765146:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10860 00000100:00100000:1.0:1746144892.765153:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1983:x1830965175137920:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.765165:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.765187:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a0 expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.765199:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a0 expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.765219:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e3c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a0 expref: 91 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.765251:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.765253:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.765259:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a7 expref: 90 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.765267:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a7 expref: 90 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.765299:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a7 expref: 90 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.765310:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a7 expref: 90 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.765322:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172431232:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.765398:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.771066:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.771381:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175138176 00000100:00100000:2.0:1746144892.771392:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175138176 00002000:00100000:2.0:1746144892.771442:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e81f80 x1830965175138176/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.771453:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e81f80 with x1830965175138176 ext(0->4095) 00010000:00010000:2.0:1746144892.771463:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a7 expref: 91 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.771478:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a7 expref: 91 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.771485:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e81f80 00000100:00100000:2.0:1746144892.771520:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2017 00000100:00100000:2.0:1746144892.771528:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175138176:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.771742:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175138176:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 214us (687us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.771748:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2017 00002000:00100000:2.0:1746144892.771753:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e81f80 x1830965175138176/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.771759:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e81f80 with x1830965175138176 ext(0->4095) 00010000:00010000:2.0:1746144892.771778:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a7 expref: 91 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.771786:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a7 expref: 91 pid: 8430 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.771792:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e81f80 00000100:00100000:1.0:1746144892.771796:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172431232:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.771816:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.771844:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1983:x1830965175137920:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6693us (6954us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.771853:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10860 00000100:00100000:0.0:1746144892.775171:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.775229:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.775231:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175138304 00000100:00100000:2.0:1746144892.775241:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175138304 00000100:00100000:1.0:1746144892.775715:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175138432 00000100:00100000:1.0:1746144892.775719:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175138432 00010000:00010000:1.0:1746144892.775743:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a7 expref: 91 pid: 8430 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.775789:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5446 00000100:00100000:2.0:1746144892.775800:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31565:x1830965175138304:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.775815:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.775830:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af948b5 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.775856:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.775862:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ae expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.775873:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144892.775876:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948b5 expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.775912:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ae expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.775923:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948b5 expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.775932:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:2.0:1746144892.775992:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31565:x1830965175138304:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 195us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.775998:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5446 00000100:00100000:1.0:1746144892.776130:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10861 00000100:00100000:1.0:1746144892.776137:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1983:x1830965175138432:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.776147:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.776168:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a7 expref: 91 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.776184:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a7 expref: 91 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.776202:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500e00/0x4076af6727514e43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948a7 expref: 91 pid: 8430 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.776223:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.776225:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.776231:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ae expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.776237:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ae expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.776258:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ae expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.776268:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ae expref: 5 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.776279:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172431488:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.776343:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.780884:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172431488:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.780921:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.780986:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1983:x1830965175138432:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4847us (5754us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.781001:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10861 00000100:00100000:0.0:1746144892.782608:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.783378:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175138688 00000100:00100000:2.0:1746144892.783387:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175138688 00002000:00100000:2.0:1746144892.783439:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e82680 x1830965175138688/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.783449:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82680 with x1830965175138688 ext(0->4095) 00010000:00010000:2.0:1746144892.783459:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ae expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.783475:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ae expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.783482:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e82680 00000100:00100000:2.0:1746144892.783514:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2018 00000100:00100000:2.0:1746144892.783522:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175138688:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.783692:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175138688:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 171us (1090us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.783698:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2018 00002000:00100000:2.0:1746144892.783702:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e82680 x1830965175138688/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.783709:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82680 with x1830965175138688 ext(0->4095) 00010000:00010000:2.0:1746144892.783712:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ae expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.783721:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ae expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.783726:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e82680 00000100:00100000:0.0:1746144892.787443:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.788441:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175138816 00000100:00100000:1.0:1746144892.788450:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175138816 00010000:00010000:1.0:1746144892.788487:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ae expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.788905:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10862 00000100:00100000:1.0:1746144892.788915:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175138816:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.788929:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.788961:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ae expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.788973:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ae expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.788996:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af6727514e4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ae expref: 6 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.789025:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.789027:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.789035:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948b5 expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.789042:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948b5 expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.789079:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948b5 expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.789091:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172431616:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.789187:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.794486:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.794863:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175139072 00000100:00100000:3.0:1746144892.794874:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175139072 00002000:00100000:3.0:1746144892.794923:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230ea00 x1830965175139072/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.794933:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230ea00 with x1830965175139072 ext(0->4095) 00002000:00010000:3.0:1746144892.794939:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230ea00 00000100:00100000:3.0:1746144892.794984:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4012 00000100:00100000:3.0:1746144892.794993:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965175139072:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144892.795179:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965175139072:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 188us (706us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.795185:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4012 00002000:00100000:3.0:1746144892.795192:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230ea00 x1830965175139072/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.795198:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230ea00 with x1830965175139072 ext(0->4095) 00002000:00010000:3.0:1746144892.795201:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230ea00 00000100:00100000:1.0:1746144892.796015:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172431616:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.796034:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.796158:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175138816:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7244us (8725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.796167:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10862 00000100:00100000:0.0:1746144892.802896:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.803982:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175139200 00000100:00100000:3.0:1746144892.803994:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175139200 00000100:00100000:3.0:1746144892.804061:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5447 00000100:00100000:3.0:1746144892.804070:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175139200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.804091:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.804112:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3400/0x4076af6727514e58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af948bc expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.804147:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948b5 expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.804154:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.804157:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144892.804161:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3400/0x4076af6727514e58 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948bc expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.804204:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948b5 expref: 89 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.804215:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948b5 expref: 89 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.804228:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172431744:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.804317:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167900 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.808650:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172431744:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.808684:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3400/0x4076af6727514e58 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948bc expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.808703:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f2b3400, rc 0) 00000100:00100000:3.0:1746144892.808747:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175139200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4677us (5863us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.808757:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5447 00000100:00100000:0.0:1746144892.816982:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.818794:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175139328 00000100:00100000:2.0:1746144892.818806:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175139328 00002000:00100000:2.0:1746144892.818862:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009230f480 x1830965175139328/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 496/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.818871:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230f480 with x1830965175139328 ext(0->7) 00010000:00010000:2.0:1746144892.818881:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948b5 expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.818895:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948b5 expref: 90 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.818908:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230f480 00000100:00100000:2.0:1746144892.818944:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2019 00000100:00100000:2.0:1746144892.818965:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175139328:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144892.819369:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175139328:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 406us (2398us total) trans 4294968008 rc 0/0 00000100:00100000:2.0:1746144892.819376:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2019 00002000:00100000:2.0:1746144892.819382:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009230f480 x1830965175139328/t4294968008(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 496/448 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.819389:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230f480 with x1830965175139328 ext(0->7) 00010000:00010000:2.0:1746144892.819393:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948b5 expref: 92 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.819402:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948b5 expref: 92 pid: 20722 timeout: 586 lvb_type: 0 00002000:00010000:2.0:1746144892.819408:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230f480 00000100:00100000:0.0:1746144892.827161:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.827253:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175139456 00000100:00100000:1.0:1746144892.827263:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175139456 00010000:00010000:1.0:1746144892.827299:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948b5 expref: 92 pid: 20722 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.827339:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10863 00000100:00100000:1.0:1746144892.827346:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1983:x1830965175139456:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.827359:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.827379:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948b5 expref: 92 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.827391:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948b5 expref: 92 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.827412:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727514e51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948b5 expref: 92 pid: 20722 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.827431:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.827433:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.827440:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3400/0x4076af6727514e58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948bc expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.827448:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3400/0x4076af6727514e58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948bc expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.827479:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3400/0x4076af6727514e58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948bc expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144892.827491:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172431872:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.827573:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.829812:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.830147:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175139712 00000100:00100000:2.0:1746144892.830154:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175139712 00002000:00100000:2.0:1746144892.830199:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230ce00 x1830965175139712/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.830209:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230ce00 with x1830965175139712 ext(0->4095) 00002000:00010000:2.0:1746144892.830215:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230ce00 00000100:00100000:2.0:1746144892.830241:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4013 00000100:00100000:2.0:1746144892.830248:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175139712:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.830417:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175139712:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 169us (612us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.830423:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4013 00002000:00100000:2.0:1746144892.830428:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230ce00 x1830965175139712/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.830436:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230ce00 with x1830965175139712 ext(0->4095) 00002000:00010000:2.0:1746144892.830438:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230ce00 00000100:00100000:1.0:1746144892.830704:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172431872:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.830723:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.830747:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1983:x1830965175139456:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3402us (3598us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.830755:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10863 00000100:00100000:0.0:1746144892.832523:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.832649:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175139840 00000100:00100000:3.0:1746144892.832656:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175139840 00000100:00100000:3.0:1746144892.832834:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5448 00000100:00100000:3.0:1746144892.832842:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31565:x1830965175139840:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144892.832857:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144892.832875:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af948c3 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.833161:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3400/0x4076af6727514e58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948bc expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.833171:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.833172:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.833177:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948c3 expref: 92 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.833210:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3400/0x4076af6727514e58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948bc expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.833222:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3400/0x4076af6727514e58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948bc expref: 5 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:3.0:1746144892.833234:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172432000:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144892.834286:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.834511:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.834528:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175139968 00000100:00100000:2.0:1746144892.834533:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175139968 00000100:00100000:2.0:1746144892.834702:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5449 00000100:00100000:2.0:1746144892.834710:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31579:x1830965175139968:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.834725:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.834737:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af948ca expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.834760:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.834782:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948c3 expref: 94 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.834788:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.834791:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e66 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ca expref: 94 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.834816:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948c3 expref: 94 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.834831:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e66 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ca expref: 94 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.834841:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:2.0:1746144892.834887:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+94:31579:x1830965175139968:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 177us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.834894:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5449 00000100:00100000:3.0:1746144892.835969:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172432000:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144892.835989:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948c3 expref: 93 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144892.836204:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:3.0:1746144892.836224:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f2b3c00, rc 0) 00000100:00100000:3.0:1746144892.836251:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31565:x1830965175139840:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3410us (3733us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.836256:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5448 00000100:00100000:1.0:1746144892.836357:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175140096 00000100:00100000:1.0:1746144892.836362:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175140096 00010000:00010000:1.0:1746144892.836383:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3400/0x4076af6727514e58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948bc expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.836413:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10864 00000100:00100000:1.0:1746144892.836418:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175140096:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.836428:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.836449:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3400/0x4076af6727514e58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948bc expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.836464:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3400/0x4076af6727514e58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948bc expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.836486:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3400/0x4076af6727514e58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948bc expref: 6 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:1.0:1746144892.836511:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.836513:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.836519:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948c3 expref: 92 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.836526:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948c3 expref: 92 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.836548:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948c3 expref: 92 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.836557:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948c3 expref: 92 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:1.0:1746144892.836567:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172432256:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.836624:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4540 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.841065:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172432256:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144892.841091:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.841153:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175140096:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4732us (4947us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.841168:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10864 00000100:00100000:0.0:1746144892.841838:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.841994:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175140352 00000100:00100000:3.0:1746144892.842001:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175140352 00002000:00100000:3.0:1746144892.842041:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2f800 x1830965175140352/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.842050:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2f800 with x1830965175140352 ext(0->4095) 00010000:00010000:3.0:1746144892.842059:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948c3 expref: 93 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.842071:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948c3 expref: 93 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.842077:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2f800 00000100:00100000:3.0:1746144892.842244:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2020 00000100:00100000:3.0:1746144892.842252:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175140352:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144892.842442:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175140352:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 190us (605us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.842448:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2020 00002000:00100000:3.0:1746144892.842454:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2f800 x1830965175140352/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.842461:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2f800 with x1830965175140352 ext(0->4095) 00010000:00010000:3.0:1746144892.842465:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948c3 expref: 93 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:3.0:1746144892.842474:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948c3 expref: 93 pid: 8432 timeout: 586 lvb_type: 0 00002000:00010000:3.0:1746144892.842480:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2f800 00000100:00100000:0.0:1746144892.847706:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.847745:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.847805:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175140608 00000100:00100000:0.0:1746144892.847809:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.847817:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175140608 00000100:00100000:0.0:1746144892.847831:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.847857:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.847870:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175140864 00000100:00100000:2.0:1746144892.847873:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175140864 00000100:00100000:0.0:1746144892.847892:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 315 00000100:00100000:2.0:1746144892.847899:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 316 00000100:00100000:0.0:1746144892.847902:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1985:x1830965175140608:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1746144892.847904:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1985:x1830965175140864:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1746144892.847928:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175140480 00000100:00100000:1.0:1746144892.847932:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175140480 00000100:00100000:0.0:1746144892.847978:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1985:x1830965175140608:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144892.847984:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 315 00000100:00080000:3.0:1746144892.847997:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746144892.848009:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175140736 00000100:00100000:3.0:1746144892.848012:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175140736 00000100:00080000:3.0:1746144892.848023:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746144892.848041:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175140992 00000100:00100000:3.0:1746144892.848043:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175140992 00000100:00080000:3.0:1746144892.848049:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746144892.848067:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 390 00000100:00100000:3.0:1746144892.848072:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1985:x1830965175140736:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1746144892.848222:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 371 00000100:00100000:1.0:1746144892.848228:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4574b85-29c1-4863-b96a-3fe350afea52+12:1985:x1830965175140480:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1746144892.848615:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1985:x1830965175140864:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 709us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.848621:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 316 00000100:00100000:2.0:1746144892.848643:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 391 00000100:00100000:2.0:1746144892.848649:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175140992:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1746144892.848667:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175140992:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 20us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.848672:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 391 00000100:00100000:3.0:1746144892.848714:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1985:x1830965175140736:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 641us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.848719:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 390 00000100:00100000:1.0:1746144892.848794:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4574b85-29c1-4863-b96a-3fe350afea52+12:1985:x1830965175140480:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 566us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.848799:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 371 00000100:00100000:0.0:1746144892.848807:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.849394:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175141120 00000100:00100000:2.0:1746144892.849399:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175141120 00010000:00010000:2.0:1746144892.849424:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948c3 expref: 93 pid: 8432 timeout: 586 lvb_type: 0 00000100:00100000:2.0:1746144892.849465:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10865 00000100:00100000:2.0:1746144892.849471:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1982:x1830965175141120:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.849482:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144892.849503:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948c3 expref: 93 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.849514:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948c3 expref: 93 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.849541:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514e5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948c3 expref: 93 pid: 8432 timeout: 586 lvb_type: 0 00010000:00010000:2.0:1746144892.849569:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.849572:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.849579:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ca expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.849587:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ca expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.849619:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ca expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.849631:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172432384:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.849694:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144892.852827:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172432384:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.852853:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.852906:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1982:x1830965175141120:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3433us (4096us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.852916:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10865 00000100:00100000:0.0:1746144892.853013:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.855282:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175141376 00000100:00100000:2.0:1746144892.855294:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175141376 00002000:00100000:2.0:1746144892.855346:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea9f80 x1830965175141376/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.855356:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea9f80 with x1830965175141376 ext(0->4095) 00002000:00010000:2.0:1746144892.855361:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea9f80 00000100:00100000:2.0:1746144892.855404:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4014 00000100:00100000:2.0:1746144892.855412:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1982:x1830965175141376:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746144892.855759:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1982:x1830965175141376:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 342us (2740us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.855800:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4014 00002000:00100000:2.0:1746144892.855806:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea9f80 x1830965175141376/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.855812:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea9f80 with x1830965175141376 ext(0->4095) 00002000:00010000:2.0:1746144892.855815:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea9f80 00000100:00100000:0.0:1746144892.859486:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.859575:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175141504 00000100:00100000:1.0:1746144892.859585:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175141504 00000100:00100000:1.0:1746144892.859907:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5450 00000100:00100000:1.0:1746144892.859917:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175141504:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144892.859935:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144892.859965:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af948d1 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.859995:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ca expref: 91 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.860003:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144892.860005:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144892.860008:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d1 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.860039:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ca expref: 91 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.860056:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ca expref: 91 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:1.0:1746144892.860068:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172432512:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144892.860163:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.862496:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172432512:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144892.862525:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d1 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.862541:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500400, rc 0) 00000100:00100000:1.0:1746144892.862594:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175141504:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2678us (3119us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.862602:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5450 00000100:00100000:0.0:1746144892.863677:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.863725:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.863984:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175141632 00000100:00100000:2.0:1746144892.863992:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175141632 00010000:00010000:2.0:1746144892.864031:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ca expref: 92 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144892.864074:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10866 00000100:00100000:2.0:1746144892.864082:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175141632:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.864095:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144892.864117:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ca expref: 92 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144892.864129:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ca expref: 92 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144892.864156:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ca expref: 92 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144892.864182:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.864184:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.864190:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.864198:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.864229:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.864240:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172432640:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.864310:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.864563:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175141760 00000100:00100000:1.0:1746144892.864566:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175141760 00000100:00100000:1.0:1746144892.864743:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5451 00000100:00100000:1.0:1746144892.864749:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31565:x1830965175141760:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144892.864798:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144892.864809:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af948d8 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.864826:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.864835:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.864837:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.864839:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d8 expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.864854:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.864863:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d1 expref: 5 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:1.0:1746144892.864870:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172432768:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144892.864908:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.868719:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.868965:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175142016 00000100:00100000:3.0:1746144892.868974:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175142016 00002000:00100000:3.0:1746144892.869016:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135eaa300 x1830965175142016/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.869026:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135eaa300 with x1830965175142016 ext(0->4095) 00010000:00010000:3.0:1746144892.869035:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d1 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144892.869048:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d1 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144892.869056:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135eaa300 00000100:00100000:3.0:1746144892.869080:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2021 00000100:00100000:3.0:1746144892.869088:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175142016:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144892.869265:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175142016:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 177us (555us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144892.869272:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2021 00002000:00100000:3.0:1746144892.869277:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135eaa300 x1830965175142016/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.869284:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135eaa300 with x1830965175142016 ext(0->4095) 00010000:00010000:3.0:1746144892.869288:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d1 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144892.869297:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d1 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144892.869302:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135eaa300 00000100:00100000:1.0:1746144892.869562:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172432768:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144892.869584:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d8 expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.869598:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501800, rc 0) 00000100:00100000:1.0:1746144892.869629:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31565:x1830965175141760:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4880us (5904us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.869635:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5451 00000100:00100000:2.0:1746144892.869796:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172432640:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144892.869811:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.869827:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175141632:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5748us (6153us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.869834:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10866 00000100:00100000:0.0:1746144892.872901:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.873005:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175142144 00000100:00100000:2.0:1746144892.873014:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175142144 00010000:00010000:2.0:1746144892.873053:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d1 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144892.873090:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10867 00000100:00100000:2.0:1746144892.873099:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175142144:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144892.873111:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144892.873133:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d1 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144892.873144:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d1 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144892.873169:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500400/0x4076af6727514e6d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d1 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144892.873184:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.873186:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144892.873194:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d8 expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.873203:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d8 expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.873238:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d8 expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144892.873251:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172432896:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144892.873339:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a450fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.876589:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.876748:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172432896:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.877259:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175142400 00000100:00100000:1.0:1746144892.877268:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175142400 00002000:00100000:1.0:1746144892.877312:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea9c00 x1830965175142400/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.877329:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea9c00 with x1830965175142400 ext(0->4095) 00002000:00010000:1.0:1746144892.877333:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea9c00 00010000:00010000:2.0:1746144892.877390:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144892.877433:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175142144:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4335us (4670us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.877443:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10867 00000100:00100000:1.0:1746144892.877870:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4015 00000100:00100000:1.0:1746144892.877877:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175142400:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144892.878047:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175142400:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 171us (1467us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.878053:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4015 00002000:00100000:1.0:1746144892.878058:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea9c00 x1830965175142400/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.878064:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea9c00 with x1830965175142400 ext(0->4095) 00002000:00010000:1.0:1746144892.878066:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea9c00 00000100:00100000:0.0:1746144892.885315:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.885393:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175142528 00000100:00100000:1.0:1746144892.885403:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175142528 00000100:00100000:1.0:1746144892.886135:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5452 00000100:00100000:1.0:1746144892.886145:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175142528:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144892.886166:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144892.886185:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af948df expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.886218:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d8 expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.886225:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144892.886227:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144892.886230:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948df expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.886262:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d8 expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.886273:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d8 expref: 91 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:1.0:1746144892.886285:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172433024:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144892.886549:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144892.891303:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172433024:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144892.891339:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948df expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.891357:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500c00, rc 0) 00000100:00100000:1.0:1746144892.891402:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175142528:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5258us (6097us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.891412:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5452 00000100:00100000:0.0:1746144892.899191:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.899285:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175142656 00000100:00100000:3.0:1746144892.899294:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175142656 00002000:00100000:3.0:1746144892.899338:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880135ea8380 x1830965175142656/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 496/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.899347:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8380 with x1830965175142656 ext(0->7) 00010000:00010000:3.0:1746144892.899355:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d8 expref: 92 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144892.899368:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d8 expref: 92 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144892.899374:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea8380 00000100:00100000:3.0:1746144892.899401:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2022 00000100:00100000:3.0:1746144892.899407:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965175142656:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144892.899756:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1985:x1830965175142656:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 348us (574us total) trans 4294968009 rc 0/0 00000100:00100000:3.0:1746144892.899792:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2022 00002000:00100000:3.0:1746144892.899798:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880135ea8380 x1830965175142656/t4294968009(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 496/448 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144892.899805:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8380 with x1830965175142656 ext(0->7) 00010000:00010000:3.0:1746144892.899809:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d8 expref: 94 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144892.899818:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d8 expref: 94 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144892.899824:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea8380 00000100:00100000:0.0:1746144892.912697:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.913288:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175142784 00000100:00100000:1.0:1746144892.913299:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175142784 00000100:00100000:1.0:1746144892.913348:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5453 00000100:00100000:1.0:1746144892.913356:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+94:31565:x1830965175142784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144892.913375:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144892.913394:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af948e6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.913427:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144892.913433:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948df expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.913438:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144892.913441:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948e6 expref: 95 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.913478:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948df expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.913487:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948e6 expref: 95 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.913496:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500200, rc 0) 00000100:00100000:1.0:1746144892.913541:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+95:31565:x1830965175142784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 186us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.913546:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5453 00000100:00100000:1.0:1746144892.918677:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.918711:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175142912 00000100:00100000:1.0:1746144892.918720:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175142912 00010000:00010000:1.0:1746144892.918758:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d8 expref: 95 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:1.0:1746144892.918812:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10868 00000100:00100000:1.0:1746144892.918820:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1985:x1830965175142912:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144892.918836:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144892.918857:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d8 expref: 95 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144892.918869:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d8 expref: 95 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144892.918892:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099501800/0x4076af6727514e74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948d8 expref: 95 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144892.918909:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.918911:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144892.918918:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948df expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.918926:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948df expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.918971:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948df expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144892.918981:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948df expref: 5 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:1.0:1746144892.918991:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172433280:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144892.919064:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.926077:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172433280:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144892.926095:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144892.928112:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1985:x1830965175142912:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 9287us (9438us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144892.928122:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10868 00000100:00100000:2.0:1746144892.929481:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144892.929506:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175143168 00000100:00100000:2.0:1746144892.929512:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175143168 00002000:00100000:2.0:1746144892.929548:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e832300 x1830965175143168/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.929557:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e832300 with x1830965175143168 ext(0->4095) 00010000:00010000:2.0:1746144892.929564:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948df expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144892.929576:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948df expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144892.929582:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e832300 00000100:00100000:2.0:1746144892.929596:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2023 00000100:00100000:2.0:1746144892.929603:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175143168:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144892.929733:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175143168:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 130us (254us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144892.929738:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2023 00002000:00100000:2.0:1746144892.929743:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e832300 x1830965175143168/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144892.929750:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e832300 with x1830965175143168 ext(0->4095) 00010000:00010000:2.0:1746144892.929754:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948df expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144892.929788:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948df expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144892.929794:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e832300 00000100:00100000:3.0:1746144892.943012:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144892.943043:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175143296 00000100:00100000:3.0:1746144892.943050:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175143296 00010000:00010000:3.0:1746144892.945200:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948df expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144892.945246:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10869 00000100:00100000:3.0:1746144892.945257:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175143296:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144892.945269:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144892.945286:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948df expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144892.945297:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948df expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144892.945317:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514e7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948df expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144892.945329:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.945331:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144892.945336:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948e6 expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.945342:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948e6 expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144892.945370:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948e6 expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144892.945380:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172433408:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144892.945456:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144892.957626:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172433408:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144892.957643:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144892.957681:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175143296:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 12427us (14675us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144892.957690:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10869 00000100:00100000:0.0:1746144892.960849:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.960902:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175143552 00000100:00100000:1.0:1746144892.960909:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175143552 00002000:00100000:1.0:1746144892.960942:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398d880 x1830965175143552/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.960959:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398d880 with x1830965175143552 ext(0->4095) 00002000:00010000:1.0:1746144892.960963:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398d880 00000100:00100000:1.0:1746144892.960987:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4016 00000100:00100000:1.0:1746144892.960993:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1985:x1830965175143552:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144892.962684:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1985:x1830965175143552:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1686us (1834us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144892.962696:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4016 00002000:00100000:1.0:1746144892.962704:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398d880 x1830965175143552/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 488/4536 e 0 to 0 dl 1746144903 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.962711:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398d880 with x1830965175143552 ext(0->4095) 00002000:00010000:1.0:1746144892.962715:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398d880 00000100:00100000:3.0:1746144892.970502:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.972106:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175143680 00000100:00100000:0.0:1746144892.972114:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175143680 00000100:00100000:0.0:1746144892.972327:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5454 00000100:00100000:0.0:1746144892.972335:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175143680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144892.972349:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144892.972362:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af948ed expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.972385:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948e6 expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.972392:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144892.972393:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144892.972396:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ed expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.972421:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948e6 expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.972431:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948e6 expref: 93 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:0.0:1746144892.972442:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172433536:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144892.972515:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144892.974981:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172433536:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144892.975005:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ed expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144892.975019:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094234800, rc 0) 00000100:00100000:0.0:1746144892.975069:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175143680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2733us (4571us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144892.975076:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5454 00000001:00080000:1.0:1746144892.979109:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294968007 is committed 00000001:00080000:1.0:1746144892.979168:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294968008 is committed 00000001:00080000:1.0:1746144892.979217:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294968009 is committed 00000100:00100000:0.0:1746144892.998111:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144892.998154:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144892.998155:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175143808 00000100:00100000:1.0:1746144892.998163:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175143808 00002000:00100000:1.0:1746144892.998202:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009398c700 x1830965175143808/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 496/0 e 0 to 0 dl 1746144903 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.998211:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398c700 with x1830965175143808 ext(0->7) 00010000:00010000:1.0:1746144892.998219:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948e6 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144892.998223:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175143936 00000100:00100000:2.0:1746144892.998226:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175143936 00010000:00010000:1.0:1746144892.998230:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948e6 expref: 7 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144892.998236:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398c700 00000100:00100000:2.0:1746144892.998252:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5455 00000100:00100000:1.0:1746144892.998262:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2024 00000100:00100000:1.0:1746144892.998271:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175143808:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144892.998333:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:31565:x1830965175143936:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144892.998341:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144892.998353:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e90 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af948f4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.998370:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144892.998374:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ed expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.998379:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144892.998382:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e90 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948f4 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.998409:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ed expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.998419:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e90 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948f4 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144892.998426:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:2.0:1746144892.998462:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099699850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31565:x1830965175143936:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 130us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144892.998466:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5455 00000100:00100000:1.0:1746144892.998572:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175143808:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 305us (467us total) trans 4294968010 rc 0/0 00000100:00100000:1.0:1746144892.998578:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2024 00002000:00100000:1.0:1746144892.998583:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009398c700 x1830965175143808/t4294968010(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:533/0 lens 496/448 e 0 to 0 dl 1746144903 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144892.998589:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398c700 with x1830965175143808 ext(0->7) 00010000:00010000:1.0:1746144892.998594:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948e6 expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144892.998602:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948e6 expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144892.998607:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398c700 00000100:00100000:0.0:1746144893.000335:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.000447:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175144064 00000100:00100000:3.0:1746144893.000454:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175144064 00010000:00010000:3.0:1746144893.000487:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948e6 expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00000100:00080000:0.0:1746144893.000561:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746144893.000633:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10870 00000100:00100000:3.0:1746144893.000640:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175144064:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.000650:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.000665:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948e6 expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.000675:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948e6 expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.000690:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514e82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948e6 expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.001006:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.001008:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.001015:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ed expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.001023:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ed expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.001049:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ed expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.001059:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ed expref: 5 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.001074:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172433792:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.003108:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.004686:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172433792:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.004702:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.004733:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175144064:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4093us (4402us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.004741:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10870 00000100:00100000:0.0:1746144893.006035:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.006106:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175144320 00000100:00100000:1.0:1746144893.006113:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175144320 00000100:00080000:0.0:1746144893.006160:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:1.0:1746144893.006168:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ed80 x1830965175144320/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.006183:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ed80 with x1830965175144320 ext(0->4095) 00010000:00010000:1.0:1746144893.006190:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ed expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.006201:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ed expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.006207:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398ed80 00000100:00100000:1.0:1746144893.006234:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2025 00000100:00100000:1.0:1746144893.006242:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175144320:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144893.006437:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175144320:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 195us (404us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.006443:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2025 00002000:00100000:1.0:1746144893.006449:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ed80 x1830965175144320/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.006455:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ed80 with x1830965175144320 ext(0->4095) 00010000:00010000:1.0:1746144893.006460:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ed expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.006468:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ed expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.006473:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398ed80 00000100:00100000:0.0:1746144893.013604:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.013902:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175144448 00000100:00100000:3.0:1746144893.013911:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175144448 00010000:00010000:3.0:1746144893.013942:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ed expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.013992:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10871 00000100:00100000:3.0:1746144893.014000:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175144448:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.014010:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.014027:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ed expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.014037:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ed expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.014055:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094234800/0x4076af6727514e89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948ed expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.014071:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.014073:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.014079:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948f4 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.014086:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948f4 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.014114:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948f4 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.014124:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172433920:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.014195:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.017734:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172433920:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.017754:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.017826:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175144448:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3826us (4229us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.017836:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10871 00000100:00100000:0.0:1746144893.018309:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.018491:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175144704 00000100:00100000:2.0:1746144893.018497:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175144704 00002000:00100000:2.0:1746144893.018531:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398df80 x1830965175144704/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.018540:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398df80 with x1830965175144704 ext(0->4095) 00002000:00010000:2.0:1746144893.018543:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398df80 00000100:00100000:2.0:1746144893.018570:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4017 00000100:00100000:2.0:1746144893.018576:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175144704:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.018717:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175144704:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 140us (408us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.018722:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4017 00002000:00100000:2.0:1746144893.018728:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398df80 x1830965175144704/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.018739:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398df80 with x1830965175144704 ext(0->4095) 00002000:00010000:2.0:1746144893.018742:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398df80 00000100:00100000:0.0:1746144893.021892:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.022169:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175144832 00000100:00100000:2.0:1746144893.022177:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175144832 00000100:00100000:2.0:1746144893.022222:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5456 00000100:00100000:2.0:1746144893.022229:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175144832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.022244:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.022258:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af948fb expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.022280:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948f4 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.022286:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.022288:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.022291:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948fb expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.022313:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948f4 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.022324:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948f4 expref: 7 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.022335:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172434048:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.022944:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.026592:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.026655:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175144960 00000100:00100000:3.0:1746144893.026663:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175144960 00010000:00010000:3.0:1746144893.026692:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e90 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948f4 expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.026723:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172434048:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.026751:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948fb expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.026790:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:2.0:1746144893.026831:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175144832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4602us (4947us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.026837:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5456 00000100:00100000:3.0:1746144893.027100:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10872 00000100:00100000:3.0:1746144893.027108:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175144960:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.027120:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.027138:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e90 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948f4 expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.027152:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948f4 expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.027170:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514e90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948f4 expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.027184:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.027186:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.027191:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948fb expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.027198:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948fb expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.027224:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948fb expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.027234:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172434176:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.027273:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.028710:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.028757:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175145088 00000100:00100000:2.0:1746144893.028779:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175145088 00000100:00100000:2.0:1746144893.028814:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5457 00000100:00100000:2.0:1746144893.028821:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31565:x1830965175145088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.028833:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.028845:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94902 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.028864:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948fb expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.028870:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.028871:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.028874:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94902 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.029222:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948fb expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.029231:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948fb expref: 5 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.029241:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172434304:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144893.029469:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.029792:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.029809:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175145344 00000100:00100000:2.0:1746144893.029812:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175145344 00002000:00100000:2.0:1746144893.029834:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932aad80 x1830965175145344/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.029843:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932aad80 with x1830965175145344 ext(0->4095) 00010000:00010000:2.0:1746144893.029847:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948fb expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.029857:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948fb expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.029862:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932aad80 00000100:00100000:2.0:1746144893.029888:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2026 00000100:00100000:2.0:1746144893.029894:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175145344:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144893.030099:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172434176:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.030112:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.030147:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175144960:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3039us (3561us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.030153:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10872 00000100:00100000:2.0:1746144893.030464:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175145344:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 569us (994us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.030469:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2026 00002000:00100000:2.0:1746144893.030474:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932aad80 x1830965175145344/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.030481:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932aad80 with x1830965175145344 ext(0->4095) 00010000:00010000:2.0:1746144893.030486:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948fb expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.030496:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948fb expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.030500:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932aad80 00000100:00100000:0.0:1746144893.033218:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.033243:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172434304:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.033272:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94902 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.033285:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d400, rc 0) 00000100:00100000:1.0:1746144893.033411:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175145472 00000100:00100000:1.0:1746144893.033416:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175145472 00000100:00100000:1.0:1746144893.033452:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5458 00000100:00100000:1.0:1746144893.033458:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31579:x1830965175145472:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.033470:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.033481:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514ea5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94909 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.033497:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.033502:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94902 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.033506:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.033509:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514ea5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94909 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.033539:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94902 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.033547:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514ea5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94909 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.033554:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500c00, rc 0) 00000100:00100000:3.0:1746144893.033681:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+10:31565:x1830965175145088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4860us (4974us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.033687:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5457 00000100:00100000:1.0:1746144893.034415:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31579:x1830965175145472:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 954us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.034420:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5458 00000100:00100000:0.0:1746144893.034482:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.034977:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175145600 00000100:00100000:3.0:1746144893.034982:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175145600 00010000:00010000:3.0:1746144893.035003:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948fb expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.035031:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10873 00000100:00100000:3.0:1746144893.035037:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175145600:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.035046:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.035062:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948fb expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.035071:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948fb expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.035090:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514e97 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af948fb expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.035103:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.035105:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.035110:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94902 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.035116:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94902 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.035139:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94902 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.035148:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94902 expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.035157:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172434560:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.035212:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.038487:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.038652:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175145856 00000100:00100000:2.0:1746144893.038659:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175145856 00002000:00100000:2.0:1746144893.038698:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612e300 x1830965175145856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.038707:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612e300 with x1830965175145856 ext(0->4095) 00010000:00010000:2.0:1746144893.038715:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94902 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.038725:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94902 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.038730:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612e300 00000100:00100000:2.0:1746144893.038746:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2027 00000100:00100000:2.0:1746144893.038753:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175145856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144893.038785:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172434560:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.038801:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.038833:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175145600:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3796us (4351us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.038840:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10873 00000100:00100000:2.0:1746144893.038902:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175145856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 150us (422us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.038908:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2027 00002000:00100000:2.0:1746144893.038913:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612e300 x1830965175145856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.038920:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612e300 with x1830965175145856 ext(0->4095) 00010000:00010000:2.0:1746144893.038925:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94902 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.038932:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94902 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.038937:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612e300 00000100:00100000:0.0:1746144893.042325:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.042457:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175145984 00000100:00100000:2.0:1746144893.042465:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175145984 00010000:00010000:2.0:1746144893.042496:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94902 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.042517:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10874 00000100:00100000:2.0:1746144893.042524:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1983:x1830965175145984:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.042537:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.042556:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94902 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.042566:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94902 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.042585:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d400/0x4076af6727514e9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94902 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.042599:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.042601:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.042607:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514ea5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94909 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.042619:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514ea5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94909 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.042646:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514ea5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94909 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.042656:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172434688:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.042709:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.046815:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172434688:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.046839:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.046879:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175145984:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4355us (4561us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.046888:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10874 00000100:00100000:1.0:1746144893.047027:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.047247:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175146240 00000100:00100000:2.0:1746144893.047253:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175146240 00002000:00100000:2.0:1746144893.047285:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932ab480 x1830965175146240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.047294:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932ab480 with x1830965175146240 ext(0->4095) 00002000:00010000:2.0:1746144893.047297:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800932ab480 00000100:00100000:2.0:1746144893.047322:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4018 00000100:00100000:2.0:1746144893.047329:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175146240:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.047453:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175146240:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 125us (427us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.047461:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4018 00002000:00100000:2.0:1746144893.047465:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932ab480 x1830965175146240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.047471:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932ab480 with x1830965175146240 ext(0->4095) 00002000:00010000:2.0:1746144893.047474:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800932ab480 00000100:00100000:0.0:1746144893.050508:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.050624:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175146368 00000100:00100000:1.0:1746144893.050633:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175146368 00000100:00100000:1.0:1746144893.050733:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5459 00000100:00100000:1.0:1746144893.050741:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175146368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.050758:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.050795:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af6727514eac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94910 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.050821:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514ea5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94909 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.050827:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.050829:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.050832:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af6727514eac lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94910 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.050861:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514ea5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94909 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.050871:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514ea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94909 expref: 7 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:1.0:1746144893.050882:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172434816:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144893.051421:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.052828:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.052908:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172434816:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144893.052929:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af6727514eac lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94910 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.052956:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135fe5800, rc 0) 00000100:00100000:1.0:1746144893.052990:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175146368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2249us (2488us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.052996:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5459 00000100:00100000:2.0:1746144893.053061:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175146496 00000100:00100000:2.0:1746144893.053066:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175146496 00010000:00010000:2.0:1746144893.053090:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514ea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94909 expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.053107:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10875 00000100:00100000:2.0:1746144893.053112:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175146496:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.053122:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.053139:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514ea5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94909 expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.053148:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514ea5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94909 expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.053166:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500c00/0x4076af6727514ea5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94909 expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.053179:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.053180:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.053186:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af6727514eac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94910 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.053197:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af6727514eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94910 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.053218:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af6727514eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94910 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.053227:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172434944:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.053460:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093abacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.055585:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172434944:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.055605:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.055919:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175146496:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2805us (3095us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.055928:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10875 00000100:00100000:2.0:1746144893.056587:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.056803:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.056850:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175146752 00000100:00100000:3.0:1746144893.056856:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175146752 00002000:00100000:3.0:1746144893.056890:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e831f80 x1830965175146752/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.056898:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e831f80 with x1830965175146752 ext(0->4095) 00002000:00010000:3.0:1746144893.056902:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e831f80 00000100:00100000:3.0:1746144893.056916:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4019 00000100:00100000:3.0:1746144893.056921:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175146752:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144893.057083:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175146752:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 161us (497us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.057089:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4019 00002000:00100000:3.0:1746144893.057094:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e831f80 x1830965175146752/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.057100:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e831f80 with x1830965175146752 ext(0->4095) 00002000:00010000:3.0:1746144893.057103:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e831f80 00000100:00100000:1.0:1746144893.057152:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175146880 00000100:00100000:1.0:1746144893.057156:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175146880 00000100:00100000:1.0:1746144893.057185:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5460 00000100:00100000:1.0:1746144893.057189:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:31565:x1830965175146880:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.057197:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.057210:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94917 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.057229:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af6727514eac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94910 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.057235:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.057237:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.057239:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.057262:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af6727514eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94910 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.057271:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af6727514eac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94910 expref: 5 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:1.0:1746144893.057284:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172435072:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144893.057333:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.060595:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.060650:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175147008 00000100:00100000:3.0:1746144893.060657:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175147008 00000100:00100000:3.0:1746144893.060691:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5461 00000100:00100000:3.0:1746144893.060698:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31579:x1830965175147008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.060713:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.060732:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514eba lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9491e expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.060755:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.060760:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144893.060863:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172435072:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.060989:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.061008:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175147136 00000100:00100000:2.0:1746144893.061011:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175147136 00010000:00010000:2.0:1746144893.061028:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af6727514eac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94910 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.061045:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10876 00000100:00100000:2.0:1746144893.061050:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175147136:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.061057:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.061061:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.061065:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514eba lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9491e expref: 10 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.061107:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af6727514eac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94910 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.061108:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.061116:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af6727514eac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94910 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.061132:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af6727514eac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94910 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.061135:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.061136:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.061141:0:8430:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.061147:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.061155:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144893.061166:0:8430:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.061175:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 10 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.061184:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175147136:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 134us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.061185:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172435200:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.061190:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10876 00010000:00010000:3.0:1746144893.061548:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 7/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 10 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.061560:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 7/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 10 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.061568:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172435328:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144893.062063:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.062138:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.063594:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172435328:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.063615:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514eba lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9491e expref: 10 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.063628:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377a00, rc 0) 00000100:00100000:1.0:1746144893.063634:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932ab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172435200:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144893.063643:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500200, rc 0) 00000100:00100000:3.0:1746144893.063667:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+10:31579:x1830965175147008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2969us (3079us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.063675:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5461 00000100:00100000:1.0:1746144893.063708:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31565:x1830965175146880:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6518us (6905us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.063713:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5460 00000100:00100000:0.0:1746144893.065837:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.065907:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175147392 00000100:00100000:2.0:1746144893.065914:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175147392 00002000:00100000:2.0:1746144893.065958:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a4f08e00 x1830965175147392/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.065967:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f08e00 with x1830965175147392 ext(0->4095) 00010000:00010000:2.0:1746144893.065974:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.065989:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.065995:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4f08e00 00000100:00100000:2.0:1746144893.066018:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2028 00000100:00100000:2.0:1746144893.066025:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175147392:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.066173:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175147392:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 149us (342us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.066179:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2028 00002000:00100000:2.0:1746144893.066184:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a4f08e00 x1830965175147392/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.066191:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f08e00 with x1830965175147392 ext(0->4095) 00010000:00010000:2.0:1746144893.066195:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.066203:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.066207:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4f08e00 00000100:00100000:0.0:1746144893.068400:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.068451:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175147520 00000100:00100000:2.0:1746144893.068458:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175147520 00010000:00010000:2.0:1746144893.068487:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.068518:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10877 00000100:00100000:2.0:1746144893.068525:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175147520:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.068535:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.068552:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.068561:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.068579:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099500200/0x4076af6727514eb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94917 expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.068894:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.068896:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.068902:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514eba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9491e expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.068909:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514eba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9491e expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.068939:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514eba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9491e expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.068963:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172435456:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.069046:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.071181:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172435456:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.071204:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.071246:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175147520:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2721us (2851us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.071254:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10877 00000100:00100000:1.0:1746144893.072561:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.072801:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175147776 00000100:00100000:2.0:1746144893.072806:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175147776 00002000:00100000:2.0:1746144893.072841:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932ab800 x1830965175147776/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.072854:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932ab800 with x1830965175147776 ext(0->4095) 00002000:00010000:2.0:1746144893.072857:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800932ab800 00000100:00100000:2.0:1746144893.072885:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4020 00000100:00100000:2.0:1746144893.072892:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175147776:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144893.073050:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175147776:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 157us (491us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.073055:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4020 00002000:00100000:2.0:1746144893.073061:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932ab800 x1830965175147776/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.073067:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932ab800 with x1830965175147776 ext(0->4095) 00002000:00010000:2.0:1746144893.073070:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800932ab800 00000100:00100000:0.0:1746144893.076711:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.076805:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175147904 00000100:00100000:1.0:1746144893.076812:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175147904 00000100:00100000:1.0:1746144893.076858:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5462 00000100:00100000:1.0:1746144893.076865:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d367b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175147904:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.076880:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.076896:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af6727514ec1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94925 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.076924:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514eba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9491e expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.076930:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.076932:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.076935:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af6727514ec1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94925 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.076971:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514eba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9491e expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.076982:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514eba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9491e expref: 7 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:1.0:1746144893.076993:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172435584:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144893.077077:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144893.078890:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172435584:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144893.079042:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af6727514ec1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94925 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.079056:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a9600, rc 0) 00000100:00100000:1.0:1746144893.079280:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d367b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175147904:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2413us (2574us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.079287:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5462 00000100:00100000:0.0:1746144893.079704:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.079852:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175148032 00000100:00100000:2.0:1746144893.079857:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175148032 00010000:00010000:2.0:1746144893.079883:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514eba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9491e expref: 8 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.079903:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10878 00000100:00100000:2.0:1746144893.079910:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d366d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175148032:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.079921:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.079937:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514eba lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9491e expref: 8 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.079955:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514eba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9491e expref: 8 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.079974:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514eba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9491e expref: 8 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.079998:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.080000:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.080006:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af6727514ec1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94925 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.080013:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af6727514ec1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94925 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.080038:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af6727514ec1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94925 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.080049:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172435712:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.080110:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.082029:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172435712:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.082048:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.082087:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d366d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175148032:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2176us (2382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.082094:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10878 00000100:00100000:0.0:1746144893.082513:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.083328:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175148160 00000100:00100000:1.0:1746144893.083335:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175148160 00000100:00100000:0.0:1746144893.083492:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.083547:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175148416 00000100:00100000:2.0:1746144893.083551:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175148416 00002000:00100000:2.0:1746144893.083580:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d365500 x1830965175148416/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.083593:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d365500 with x1830965175148416 ext(0->4095) 00002000:00010000:2.0:1746144893.083597:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d365500 00000100:00100000:1.0:1746144893.083704:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5463 00000100:00100000:1.0:1746144893.083711:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:31565:x1830965175148160:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.083724:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.083736:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9492c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.083757:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af6727514ec1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94925 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.083780:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.083781:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.083784:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9492c expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.083811:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af6727514ec1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94925 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.083821:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af6727514ec1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94925 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:1.0:1746144893.083831:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172435840:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144893.083893:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.084169:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2029 00000100:00100000:2.0:1746144893.084177:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175148416:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.084298:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175148416:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 122us (805us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.084303:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2029 00002000:00100000:2.0:1746144893.084308:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d365500 x1830965175148416/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.084316:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d365500 with x1830965175148416 ext(0->4095) 00010000:00010000:2.0:1746144893.084320:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af6727514ec1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94925 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.084329:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af6727514ec1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94925 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.084334:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d365500 00000100:00100000:1.0:1746144893.086303:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172435840:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144893.086328:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9492c expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.086341:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135fe4600, rc 0) 00000100:00100000:1.0:1746144893.087333:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31565:x1830965175148160:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3619us (4817us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.087341:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5463 00000100:00100000:0.0:1746144893.087496:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.087574:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175148544 00000100:00100000:1.0:1746144893.087579:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175148544 00000100:00100000:1.0:1746144893.088546:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5464 00000100:00100000:1.0:1746144893.088554:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31579:x1830965175148544:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.088567:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.088581:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514ecf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94933 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.088602:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.088606:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9492c expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.088611:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.088614:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514ecf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94933 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.088645:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9492c expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.088655:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514ecf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94933 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.088662:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939000, rc 0) 00000100:00100000:1.0:1746144893.088700:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31579:x1830965175148544:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 147us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.088705:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5464 00000100:00100000:0.0:1746144893.088963:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.089065:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175148672 00000100:00100000:3.0:1746144893.089069:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175148672 00010000:00010000:3.0:1746144893.089083:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af6727514ec1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94925 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.089104:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10879 00000100:00100000:3.0:1746144893.089109:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175148672:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.089115:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.089130:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af6727514ec1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94925 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.089143:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af6727514ec1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94925 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.089156:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af6727514ec1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94925 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.089176:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.089178:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.089183:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9492c expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.089189:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9492c expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.089208:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9492c expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.089217:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9492c expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.089227:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172436096:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.089275:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.091093:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172436096:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.091109:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.091453:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175148672:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2341us (2488us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.091464:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10879 00000100:00100000:0.0:1746144893.092463:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.092601:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175148928 00000100:00100000:3.0:1746144893.092607:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175148928 00002000:00100000:3.0:1746144893.092637:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d366a00 x1830965175148928/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.092646:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d366a00 with x1830965175148928 ext(0->4095) 00010000:00010000:3.0:1746144893.092653:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9492c expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.092663:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9492c expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.092669:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d366a00 00000100:00100000:3.0:1746144893.092694:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2030 00000100:00100000:3.0:1746144893.092701:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175148928:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144893.092854:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175148928:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 154us (392us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.092860:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2030 00002000:00100000:3.0:1746144893.092864:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d366a00 x1830965175148928/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.092871:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d366a00 with x1830965175148928 ext(0->4095) 00010000:00010000:3.0:1746144893.092875:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9492c expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.092886:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9492c expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.092891:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d366a00 00000100:00100000:1.0:1746144893.095348:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.095494:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175149056 00000100:00100000:3.0:1746144893.095500:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175149056 00010000:00010000:3.0:1746144893.095523:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9492c expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.095830:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10880 00000100:00100000:3.0:1746144893.095837:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1983:x1830965175149056:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.095848:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.095866:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9492c expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.095876:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9492c expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.095894:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135fe4600/0x4076af6727514ec8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9492c expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.096212:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.096214:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.096220:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514ecf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94933 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.096232:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514ecf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94933 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.096262:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514ecf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94933 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.096272:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172436224:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.096638:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.098756:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.098890:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172436224:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.098907:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.098954:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175149056:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3109us (3603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.098964:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10880 00000100:00100000:2.0:1746144893.099321:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175149312 00000100:00100000:2.0:1746144893.099327:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175149312 00002000:00100000:2.0:1746144893.099360:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d365180 x1830965175149312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.099368:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d365180 with x1830965175149312 ext(0->4095) 00002000:00010000:2.0:1746144893.099371:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d365180 00000100:00100000:2.0:1746144893.099386:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4022 00000100:00100000:2.0:1746144893.099392:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175149312:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.099515:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175149312:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 123us (764us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.099521:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4022 00002000:00100000:2.0:1746144893.099526:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d365180 x1830965175149312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.099532:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d365180 with x1830965175149312 ext(0->4095) 00002000:00010000:2.0:1746144893.099535:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d365180 00000100:00100000:0.0:1746144893.101545:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.102423:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175149440 00000100:00100000:3.0:1746144893.102431:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175149440 00000100:00100000:3.0:1746144893.102498:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5465 00000100:00100000:3.0:1746144893.102505:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175149440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.102519:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.102532:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514ed6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9493a expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.102554:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514ecf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94933 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.102560:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.102562:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.102565:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514ed6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9493a expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.102589:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514ecf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94933 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.102598:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514ecf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94933 expref: 7 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.102609:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172436352:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.103312:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.104707:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.104790:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172436352:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.104809:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514ed6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9493a expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.104822:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094376600, rc 0) 00000100:00100000:2.0:1746144893.105418:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175149568 00000100:00100000:2.0:1746144893.105423:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175149568 00010000:00010000:2.0:1746144893.105450:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514ecf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94933 expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.105478:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10881 00000100:00100000:2.0:1746144893.105485:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175149568:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.105495:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.105513:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514ecf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94933 expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.105522:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514ecf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94933 expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.105539:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514ecf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94933 expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.105574:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175149440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3069us (4032us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.105580:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5465 00010000:00010000:2.0:1746144893.106010:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.106013:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.106020:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514ed6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9493a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.106028:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514ed6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9493a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.106056:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514ed6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9493a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.106066:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172436480:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.107003:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.109375:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.109449:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175149824 00000100:00100000:3.0:1746144893.109456:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175149824 00002000:00100000:3.0:1746144893.109490:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f71500 x1830965175149824/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.109499:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f71500 with x1830965175149824 ext(0->4095) 00002000:00010000:3.0:1746144893.109503:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f71500 00000100:00100000:3.0:1746144893.109520:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4023 00000100:00100000:3.0:1746144893.109532:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175149824:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144893.109684:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175149824:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 156us (315us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.109690:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4023 00002000:00100000:3.0:1746144893.109695:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f71500 x1830965175149824/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.109701:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f71500 with x1830965175149824 ext(0->4095) 00002000:00010000:3.0:1746144893.109703:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f71500 00000100:00100000:2.0:1746144893.109993:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172436480:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.110009:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.110052:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175149568:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4568us (5348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.110059:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10881 00000100:00100000:0.0:1746144893.111202:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.111682:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175149952 00000100:00100000:3.0:1746144893.111688:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175149952 00000100:00100000:3.0:1746144893.111723:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5466 00000100:00100000:3.0:1746144893.111729:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+7:31565:x1830965175149952:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.111740:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.111753:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94941 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.111798:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514ed6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9493a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.111805:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.111806:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.111809:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94941 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.111832:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514ed6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9493a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.111846:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514ed6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9493a expref: 5 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.111855:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172436608:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.112832:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144893.113425:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.113446:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175150080 00000100:00100000:2.0:1746144893.113451:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175150080 00000100:00100000:2.0:1746144893.113487:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5467 00000100:00100000:2.0:1746144893.113493:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31579:x1830965175150080:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.113503:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.113513:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727514ee4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94948 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.113533:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.113537:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94941 expref: 10 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.113542:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.113544:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727514ee4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94948 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.113566:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94941 expref: 10 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.113575:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727514ee4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94948 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.113582:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4ab5200, rc 0) 00000100:00100000:2.0:1746144893.113619:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:31579:x1830965175150080:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 126us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.113624:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5467 00000100:00100000:3.0:1746144893.113972:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172436608:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.113986:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94941 expref: 9 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.113994:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377000, rc 0) 00000100:00100000:3.0:1746144893.114025:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31565:x1830965175149952:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2296us (2824us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.114033:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5466 00000100:00100000:0.0:1746144893.114664:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.114974:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175150208 00000100:00100000:2.0:1746144893.114978:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175150208 00010000:00010000:2.0:1746144893.114998:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514ed6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9493a expref: 6 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.115016:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10882 00000100:00100000:2.0:1746144893.115022:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175150208:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.115031:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.115049:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514ed6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9493a expref: 6 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.115057:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514ed6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9493a expref: 6 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.115073:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514ed6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9493a expref: 6 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.115096:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.115098:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.115103:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94941 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.115110:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94941 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.115133:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94941 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.115142:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94941 expref: 8 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.115150:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172436864:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.115192:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.117521:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172436864:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.117540:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.117577:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175150208:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2554us (2913us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.117584:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10882 00000100:00100000:0.0:1746144893.118033:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.118105:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175150464 00000100:00100000:1.0:1746144893.118110:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175150464 00002000:00100000:1.0:1746144893.118140:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f73480 x1830965175150464/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.118150:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f73480 with x1830965175150464 ext(0->4095) 00010000:00010000:1.0:1746144893.118160:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94941 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.118172:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94941 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.118178:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f73480 00000100:00100000:1.0:1746144893.118204:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2031 00000100:00100000:1.0:1746144893.118213:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175150464:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144893.118340:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175150464:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 130us (309us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.118344:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2031 00002000:00100000:1.0:1746144893.118348:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f73480 x1830965175150464/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.118352:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f73480 with x1830965175150464 ext(0->4095) 00010000:00010000:1.0:1746144893.118355:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94941 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.118361:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94941 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.118365:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f73480 00000100:00100000:0.0:1746144893.120145:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.120194:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175150592 00000100:00100000:2.0:1746144893.120199:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175150592 00010000:00010000:2.0:1746144893.120224:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94941 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.120336:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10883 00000100:00100000:2.0:1746144893.120343:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175150592:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.120354:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.120370:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94941 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.120378:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94941 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.120402:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514edd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94941 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.120413:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.120415:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.120420:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727514ee4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94948 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.120427:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727514ee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94948 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.120453:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727514ee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94948 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.120464:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172436992:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.120824:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.123469:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172436992:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.123491:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.123527:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175150592:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3184us (3384us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.123535:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10883 00000100:00100000:0.0:1746144893.123711:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.124287:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175150848 00000100:00100000:2.0:1746144893.124293:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175150848 00002000:00100000:2.0:1746144893.124325:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70a80 x1830965175150848/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.124333:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70a80 with x1830965175150848 ext(0->4095) 00002000:00010000:2.0:1746144893.124337:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f70a80 00000100:00100000:2.0:1746144893.124366:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4024 00000100:00100000:2.0:1746144893.124373:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175150848:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.124511:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175150848:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 138us (800us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.124517:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4024 00002000:00100000:2.0:1746144893.124522:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70a80 x1830965175150848/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.124529:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70a80 with x1830965175150848 ext(0->4095) 00002000:00010000:2.0:1746144893.124532:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f70a80 00000100:00100000:2.0:1746144893.127112:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.127209:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175150976 00000100:00100000:3.0:1746144893.127216:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175150976 00000100:00100000:3.0:1746144893.127253:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5468 00000100:00100000:3.0:1746144893.127259:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175150976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.127273:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.127285:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514eeb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9494f expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.127309:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727514ee4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94948 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.127318:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.127320:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.127323:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514eeb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9494f expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.127345:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727514ee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94948 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.127353:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727514ee4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94948 expref: 7 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.127362:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172437120:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.127870:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.129520:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172437120:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.129545:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514eeb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9494f expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.129559:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094376600, rc 0) 00000100:00100000:3.0:1746144893.129604:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175150976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2344us (2498us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.129611:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5468 00000100:00100000:0.0:1746144893.131016:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.131102:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175151104 00000100:00100000:2.0:1746144893.131108:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175151104 00010000:00010000:2.0:1746144893.131137:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727514ee4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94948 expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.131156:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10884 00000100:00100000:2.0:1746144893.131162:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175151104:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.131173:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.131190:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727514ee4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94948 expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.131199:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727514ee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94948 expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.131216:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727514ee4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94948 expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.131462:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.131464:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.131471:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514eeb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9494f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.131477:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514eeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9494f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.131503:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514eeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9494f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.131518:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172437248:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.131941:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.135305:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.135420:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.135478:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175151488 00000100:00100000:3.0:1746144893.135486:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175151488 00002000:00100000:3.0:1746144893.135527:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70380 x1830965175151488/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.135541:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70380 with x1830965175151488 ext(0->4095) 00002000:00010000:3.0:1746144893.135545:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f70380 00000100:00100000:3.0:1746144893.135563:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4025 00000100:00100000:3.0:1746144893.135570:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175151488:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144893.135733:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175151488:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 162us (312us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.135739:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4025 00002000:00100000:3.0:1746144893.135744:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70380 x1830965175151488/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.135750:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70380 with x1830965175151488 ext(0->4095) 00002000:00010000:3.0:1746144893.135753:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f70380 00000100:00100000:3.0:1746144893.135791:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175151232 00000100:00100000:3.0:1746144893.135794:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175151232 00000100:00100000:3.0:1746144893.135817:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5469 00000100:00100000:3.0:1746144893.135821:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31565:x1830965175151232:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.135829:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.135842:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94956 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.135906:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172437248:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.135925:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.135958:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175151104:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4796us (4945us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.135965:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10884 00010000:00010000:3.0:1746144893.136537:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514eeb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9494f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.136546:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.136547:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.136551:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94956 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.136577:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514eeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9494f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.136586:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514eeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9494f expref: 5 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.136596:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172437376:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.137241:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.138844:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.139038:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175151616 00000100:00100000:2.0:1746144893.139044:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175151616 00000100:00100000:2.0:1746144893.139074:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5470 00000100:00100000:2.0:1746144893.139081:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31579:x1830965175151616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.139093:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.139107:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514ef9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9495d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.139125:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.139131:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94956 expref: 10 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.139136:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.139139:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514ef9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9495d expref: 10 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.139162:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94956 expref: 10 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.139177:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514ef9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9495d expref: 10 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.139184:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b3ae000, rc 0) 00000100:00100000:2.0:1746144893.139801:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+10:31579:x1830965175151616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 718us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.139808:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5470 00000100:00100000:3.0:1746144893.140338:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172437376:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.140355:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94956 expref: 9 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.140366:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377800, rc 0) 00000100:00100000:3.0:1746144893.140394:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31565:x1830965175151232:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4572us (5096us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.140399:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5469 00000100:00100000:1.0:1746144893.142673:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.142850:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175151744 00000100:00100000:2.0:1746144893.142858:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175151744 00010000:00010000:2.0:1746144893.142887:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514eeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9494f expref: 6 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.143073:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10885 00000100:00100000:2.0:1746144893.143082:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175151744:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.143093:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.143111:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514eeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9494f expref: 6 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.143122:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514eeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9494f expref: 6 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.143140:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514eeb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9494f expref: 6 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.143169:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.143172:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.143178:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94956 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.143184:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94956 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.143211:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94956 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.143221:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94956 expref: 8 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.143230:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172437632:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.143306:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.145920:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.146094:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175152000 00000100:00100000:1.0:1746144893.146101:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175152000 00002000:00100000:1.0:1746144893.146137:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa0380 x1830965175152000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.146147:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0380 with x1830965175152000 ext(0->4095) 00010000:00010000:1.0:1746144893.146153:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94956 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.146164:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94956 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.146174:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa0380 00000100:00100000:1.0:1746144893.146201:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2032 00000100:00100000:1.0:1746144893.146208:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175152000:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.146391:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172437632:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.146409:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.146442:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175151744:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3363us (3774us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.146450:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10885 00000100:00100000:1.0:1746144893.146581:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175152000:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 373us (667us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.146587:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2032 00002000:00100000:1.0:1746144893.146591:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa0380 x1830965175152000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.146600:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0380 with x1830965175152000 ext(0->4095) 00010000:00010000:1.0:1746144893.146605:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94956 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.146613:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94956 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.146618:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa0380 00000100:00100000:0.0:1746144893.149606:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.149755:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175152128 00000100:00100000:2.0:1746144893.149788:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175152128 00010000:00010000:2.0:1746144893.149819:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94956 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.149846:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10886 00000100:00100000:2.0:1746144893.149853:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175152128:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.149866:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.149882:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94956 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.149891:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94956 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.149909:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514ef2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94956 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.149935:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.149937:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.149951:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514ef9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9495d expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.149958:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514ef9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9495d expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.150034:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514ef9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9495d expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.150049:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172437760:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.151880:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.152748:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.152940:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172437760:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.152969:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.153004:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175152128:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3151us (3404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.153016:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10886 00000100:00100000:1.0:1746144893.153094:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175152384 00000100:00100000:1.0:1746144893.153100:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175152384 00002000:00100000:1.0:1746144893.153129:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa1500 x1830965175152384/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.153137:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1500 with x1830965175152384 ext(0->4095) 00002000:00010000:1.0:1746144893.153140:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa1500 00000100:00100000:1.0:1746144893.153167:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4026 00000100:00100000:1.0:1746144893.153173:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175152384:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144893.153300:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175152384:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 126us (555us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.153305:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4026 00002000:00100000:1.0:1746144893.153311:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa1500 x1830965175152384/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.153318:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1500 with x1830965175152384 ext(0->4095) 00002000:00010000:1.0:1746144893.153320:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa1500 00000100:00100000:0.0:1746144893.155485:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.155563:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175152512 00000100:00100000:3.0:1746144893.155569:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175152512 00000100:00100000:3.0:1746144893.155689:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5471 00000100:00100000:3.0:1746144893.155697:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175152512:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.155710:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.155724:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514f00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94964 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.155750:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514ef9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9495d expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.155757:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.155759:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.155879:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514f00 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94964 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.155905:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514ef9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9495d expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.155915:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514ef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9495d expref: 7 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.155925:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172437888:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.156120:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.157653:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172437888:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.157675:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514f00 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94964 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.157687:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377000, rc 0) 00000100:00100000:3.0:1746144893.157717:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175152512:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2021us (2238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.157724:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5471 00000100:00100000:0.0:1746144893.158119:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.158365:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175152640 00000100:00100000:3.0:1746144893.158370:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175152640 00010000:00010000:3.0:1746144893.158388:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514ef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9495d expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.158438:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10887 00000100:00100000:3.0:1746144893.158445:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175152640:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.158455:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.158472:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514ef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9495d expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.158481:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514ef9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9495d expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.158497:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b3ae000/0x4076af6727514ef9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9495d expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.158635:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.158637:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.158642:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514f00 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94964 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.158648:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514f00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94964 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.158671:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514f00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94964 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.158680:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172438016:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.159143:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.161197:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172438016:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.161218:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.161462:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175152640:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3015us (3341us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.161471:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10887 00000100:00100000:0.0:1746144893.161912:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.162190:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175152896 00000100:00100000:3.0:1746144893.162196:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175152896 00002000:00100000:3.0:1746144893.162222:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa0a80 x1830965175152896/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.162230:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0a80 with x1830965175152896 ext(0->4095) 00002000:00010000:3.0:1746144893.162234:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa0a80 00000100:00100000:3.0:1746144893.162259:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4027 00000100:00100000:3.0:1746144893.162265:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175152896:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144893.162805:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175152896:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 539us (893us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.162811:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4027 00002000:00100000:3.0:1746144893.162816:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa0a80 x1830965175152896/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.162822:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0a80 with x1830965175152896 ext(0->4095) 00002000:00010000:3.0:1746144893.162825:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa0a80 00000100:00100000:0.0:1746144893.163453:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.163603:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175153024 00000100:00100000:3.0:1746144893.163607:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175153024 00000100:00100000:3.0:1746144893.163635:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5472 00000100:00100000:3.0:1746144893.163641:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+7:31565:x1830965175153024:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.163649:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.163663:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9496b expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.163683:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514f00 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94964 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.163690:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.163691:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.163694:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9496b expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.163717:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514f00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94964 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.163727:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514f00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94964 expref: 5 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.163736:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172438144:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.163820:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.166015:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.166190:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172438144:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.166237:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175153152 00000100:00100000:2.0:1746144893.166241:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175153152 00000100:00100000:2.0:1746144893.166268:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5473 00000100:00100000:2.0:1746144893.166273:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31579:x1830965175153152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.166283:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.166294:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f0e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94972 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.166316:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.166321:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9496b expref: 10 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.166326:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.166329:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f0e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94972 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.166351:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9496b expref: 10 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.166361:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f0e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94972 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.166369:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094198000, rc 0) 00010000:00010000:3.0:1746144893.166409:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9496b expref: 10 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.166417:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377600, rc 0) 00000100:00100000:3.0:1746144893.166431:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+10:31565:x1830965175153024:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2791us (2980us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.166439:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5472 00000100:00100000:0.0:1746144893.166452:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.166472:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175153280 00000100:00100000:3.0:1746144893.166475:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175153280 00010000:00010000:3.0:1746144893.166488:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514f00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94964 expref: 6 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.166504:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10888 00000100:00100000:3.0:1746144893.166509:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175153280:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.166516:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.166531:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514f00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94964 expref: 6 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.166540:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514f00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94964 expref: 6 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.166554:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727514f00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94964 expref: 6 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.166576:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.166578:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.166582:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9496b expref: 9 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.166588:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9496b expref: 9 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.166605:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9496b expref: 9 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.166614:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9496b expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.166622:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172438400:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.166665:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.166894:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31579:x1830965175153152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 618us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.166899:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5473 00000100:00100000:3.0:1746144893.168373:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172438400:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.168386:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.168740:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175153280:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2228us (2285us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.168748:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10888 00000100:00100000:0.0:1746144893.168915:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.169216:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175153536 00000100:00100000:3.0:1746144893.169221:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175153536 00002000:00100000:3.0:1746144893.169246:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa1f80 x1830965175153536/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.169254:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1f80 with x1830965175153536 ext(0->4095) 00010000:00010000:3.0:1746144893.169261:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9496b expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.169271:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9496b expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.169276:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa1f80 00000100:00100000:3.0:1746144893.169852:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2033 00000100:00100000:3.0:1746144893.169860:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175153536:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144893.170009:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175153536:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 150us (1094us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.170015:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2033 00002000:00100000:3.0:1746144893.170020:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa1f80 x1830965175153536/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.170027:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1f80 with x1830965175153536 ext(0->4095) 00010000:00010000:3.0:1746144893.170031:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9496b expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.170040:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9496b expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.170045:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa1f80 00000100:00100000:0.0:1746144893.171754:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.171989:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175153664 00000100:00100000:3.0:1746144893.171995:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175153664 00010000:00010000:3.0:1746144893.172017:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9496b expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.172036:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10889 00000100:00100000:3.0:1746144893.172041:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1983:x1830965175153664:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.172049:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.172065:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9496b expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.172074:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9496b expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.172091:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9496b expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.172103:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.172105:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.172111:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94972 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.172118:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94972 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.172155:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94972 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.172165:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172438528:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.172226:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.174113:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172438528:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.174131:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.174332:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175153664:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2289us (2581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.174340:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10889 00000100:00100000:0.0:1746144893.175349:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.175394:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175153920 00000100:00100000:1.0:1746144893.175399:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175153920 00002000:00100000:1.0:1746144893.175429:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa2680 x1830965175153920/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.175437:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa2680 with x1830965175153920 ext(0->4095) 00002000:00010000:1.0:1746144893.175441:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa2680 00000100:00100000:1.0:1746144893.175461:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4028 00000100:00100000:1.0:1746144893.175466:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175153920:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144893.175602:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175153920:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 134us (252us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.175608:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4028 00002000:00100000:1.0:1746144893.175613:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa2680 x1830965175153920/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.175619:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa2680 with x1830965175153920 ext(0->4095) 00002000:00010000:1.0:1746144893.175621:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa2680 00000100:00100000:0.0:1746144893.177350:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.177460:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175154048 00000100:00100000:2.0:1746144893.177464:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175154048 00000100:00100000:2.0:1746144893.177505:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5474 00000100:00100000:2.0:1746144893.177511:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175154048:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.177522:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.177536:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727514f15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94979 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.177557:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94972 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.177567:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.177569:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.177572:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727514f15 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94979 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.177594:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94972 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.177604:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94972 expref: 7 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.177618:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172438656:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.177689:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.179960:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172438656:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.179985:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727514f15 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94979 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.180003:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4165800, rc 0) 00000100:00100000:2.0:1746144893.180051:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175154048:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2540us (2703us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.180058:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5474 00000100:00100000:0.0:1746144893.180117:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.180435:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175154176 00000100:00100000:3.0:1746144893.180440:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175154176 00010000:00010000:3.0:1746144893.180460:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94972 expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.180491:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10890 00000100:00100000:3.0:1746144893.180497:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175154176:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.180507:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.180524:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f0e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94972 expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.180534:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94972 expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.180551:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94972 expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.180571:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.180573:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.180578:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727514f15 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94979 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.180585:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727514f15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94979 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.180609:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727514f15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94979 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.180618:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172438784:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.180656:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.183530:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.183540:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172438784:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.183558:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.183599:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175154176:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3101us (3480us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.183607:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10890 00000100:00100000:2.0:1746144893.184091:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175154432 00000100:00100000:2.0:1746144893.184097:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175154432 00002000:00100000:2.0:1746144893.184130:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093f44e00 x1830965175154432/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.184138:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f44e00 with x1830965175154432 ext(0->4095) 00002000:00010000:2.0:1746144893.184142:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f44e00 00000100:00100000:2.0:1746144893.184157:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4029 00000100:00100000:2.0:1746144893.184163:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175154432:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.184304:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175154432:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 140us (781us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.184310:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4029 00002000:00100000:2.0:1746144893.184315:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093f44e00 x1830965175154432/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.184322:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f44e00 with x1830965175154432 ext(0->4095) 00002000:00010000:2.0:1746144893.184324:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f44e00 00000100:00100000:0.0:1746144893.186216:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.186600:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175154560 00000100:00100000:2.0:1746144893.186606:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175154560 00000100:00100000:2.0:1746144893.187030:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5475 00000100:00100000:2.0:1746144893.187039:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:31565:x1830965175154560:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.187053:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.187067:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94980 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.187091:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727514f15 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94979 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.187098:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.187099:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.187103:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94980 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.187128:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727514f15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94979 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.187138:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727514f15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94979 expref: 5 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.187148:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172438912:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.187219:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.187570:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.187894:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175154688 00000100:00100000:1.0:1746144893.187900:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175154688 00000100:00100000:1.0:1746144893.187923:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5476 00000100:00100000:1.0:1746144893.187928:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31579:x1830965175154688:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.187935:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.187942:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514f23 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94987 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.187964:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.187967:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94980 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.187972:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.187975:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514f23 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94987 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.187996:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94980 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.188005:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514f23 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94987 expref: 10 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.188019:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939000, rc 0) 00000100:00100000:1.0:1746144893.188048:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:31579:x1830965175154688:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 120us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.188053:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5476 00000100:00100000:2.0:1746144893.190732:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172438912:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.190757:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94980 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.190797:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cc000, rc 0) 00000100:00100000:2.0:1746144893.190828:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31565:x1830965175154560:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3791us (4618us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.190838:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5475 00000100:00100000:0.0:1746144893.191609:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.191738:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175154816 00000100:00100000:3.0:1746144893.191743:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175154816 00010000:00010000:3.0:1746144893.191783:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727514f15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94979 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.191803:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10891 00000100:00100000:3.0:1746144893.191809:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092584e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175154816:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.191819:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.191835:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727514f15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94979 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.191844:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727514f15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94979 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.191861:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727514f15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94979 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.191883:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.191884:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.191889:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94980 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.191896:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94980 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.191919:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94980 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.191928:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94980 expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.191937:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172439168:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.191994:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.195455:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.195558:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172439168:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.195572:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.195611:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092584e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175154816:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3802us (4004us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.195620:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10891 00000100:00100000:1.0:1746144893.195683:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175155072 00000100:00100000:1.0:1746144893.195688:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175155072 00002000:00100000:1.0:1746144893.195717:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092585c00 x1830965175155072/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.195725:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092585c00 with x1830965175155072 ext(0->4095) 00010000:00010000:1.0:1746144893.195731:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94980 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.195741:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94980 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.195746:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092585c00 00000100:00100000:1.0:1746144893.195996:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2034 00000100:00100000:1.0:1746144893.196002:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175155072:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144893.196373:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175155072:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 370us (923us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.196379:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2034 00002000:00100000:1.0:1746144893.196384:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092585c00 x1830965175155072/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.196391:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092585c00 with x1830965175155072 ext(0->4095) 00010000:00010000:1.0:1746144893.196395:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94980 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.196403:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94980 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.196408:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092585c00 00000100:00100000:0.0:1746144893.198643:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.199022:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175155200 00000100:00100000:3.0:1746144893.199029:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175155200 00010000:00010000:3.0:1746144893.199056:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94980 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.199081:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10892 00000100:00100000:3.0:1746144893.199087:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175155200:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.199097:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.199116:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94980 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.199125:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94980 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.199146:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727514f1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94980 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.199159:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.199161:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.199166:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514f23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94987 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.199172:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514f23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94987 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.199199:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514f23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94987 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.199209:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172439296:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.200093:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.203567:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.203647:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172439296:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.203663:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.203708:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175155200:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4620us (5069us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.203716:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10892 00000100:00100000:2.0:1746144893.204037:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175155456 00000100:00100000:2.0:1746144893.204043:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175155456 00002000:00100000:2.0:1746144893.204078:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092586d80 x1830965175155456/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.204087:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092586d80 with x1830965175155456 ext(0->4095) 00002000:00010000:2.0:1746144893.204090:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092586d80 00000100:00100000:2.0:1746144893.204119:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4030 00000100:00100000:2.0:1746144893.204126:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175155456:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.204247:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175155456:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 121us (686us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.204253:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4030 00002000:00100000:2.0:1746144893.204258:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092586d80 x1830965175155456/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.204265:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092586d80 with x1830965175155456 ext(0->4095) 00002000:00010000:2.0:1746144893.204268:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092586d80 00000100:00100000:0.0:1746144893.206871:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.206988:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175155584 00000100:00100000:2.0:1746144893.206996:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175155584 00000100:00100000:2.0:1746144893.207082:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5477 00000100:00100000:2.0:1746144893.207090:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175155584:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.207104:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.207118:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514f2a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9498e expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.207145:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514f23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94987 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.207151:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.207153:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.207155:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514f2a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9498e expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.207179:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514f23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94987 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.207188:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514f23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94987 expref: 7 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.207198:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172439424:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.207539:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093abac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.208703:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172439424:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.208720:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514f2a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9498e expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.208732:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cdc00, rc 0) 00000100:00100000:2.0:1746144893.208757:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175155584:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1668us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.208783:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5477 00000100:00100000:0.0:1746144893.209819:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.209892:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175155712 00000100:00100000:3.0:1746144893.209897:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175155712 00010000:00010000:3.0:1746144893.209919:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514f23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94987 expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.209962:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10893 00000100:00100000:3.0:1746144893.209968:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175155712:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.209979:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.209995:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514f23 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94987 expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.210003:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514f23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94987 expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.210020:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727514f23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94987 expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.210062:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.210064:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.210069:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514f2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9498e expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.210075:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514f2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9498e expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.210098:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514f2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9498e expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.210105:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172439552:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.210368:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.213185:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172439552:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.213202:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.213234:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175155712:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3265us (3416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.213241:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10893 00000100:00100000:0.0:1746144893.213880:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.213938:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175155968 00000100:00100000:1.0:1746144893.213953:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175155968 00002000:00100000:1.0:1746144893.213984:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4ad80 x1830965175155968/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.213993:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4ad80 with x1830965175155968 ext(0->4095) 00002000:00010000:1.0:1746144893.213996:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4ad80 00000100:00100000:1.0:1746144893.214017:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4031 00000100:00100000:1.0:1746144893.214022:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175155968:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144893.214145:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175155968:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 123us (266us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.214150:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4031 00002000:00100000:1.0:1746144893.214155:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4ad80 x1830965175155968/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.214161:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4ad80 with x1830965175155968 ext(0->4095) 00002000:00010000:1.0:1746144893.214164:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4ad80 00000100:00100000:0.0:1746144893.214991:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.215534:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.215793:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175156096 00000100:00100000:2.0:1746144893.215799:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175156096 00000100:00100000:2.0:1746144893.215865:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175156224 00000100:00100000:2.0:1746144893.215867:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175156224 00000100:00100000:2.0:1746144893.215923:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5478 00000100:00100000:1.0:1746144893.215931:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5479 00000100:00100000:2.0:1746144893.215966:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31565:x1830965175156096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:1.0:1746144893.215966:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31579:x1830965175156224:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.215985:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.215986:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.215998:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94995 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.215998:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514f38 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9499c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.216016:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514f2a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9498e expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.216042:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.216044:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.216047:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94995 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.216056:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.216059:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94995 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.216067:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.216069:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514f38 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9499c expref: 10 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.216087:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514f2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9498e expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.216096:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514f2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9498e expref: 5 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.216105:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172439808:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144893.216108:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94995 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.216116:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514f38 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9499c expref: 10 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.216123:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939c00, rc 0) 00000100:00100000:1.0:1746144893.216152:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:31579:x1830965175156224:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 215us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.216158:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5479 00000100:00100000:2.0:1746144893.216226:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093abac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.217813:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172439808:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.217836:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94995 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.217852:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cd800, rc 0) 00000100:00100000:2.0:1746144893.217880:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31565:x1830965175156096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1951us (2889us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.217885:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5478 00000100:00100000:0.0:1746144893.218310:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.218383:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175156352 00000100:00100000:3.0:1746144893.218389:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175156352 00010000:00010000:3.0:1746144893.218408:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514f2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9498e expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.218669:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10894 00000100:00100000:3.0:1746144893.218676:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175156352:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.218688:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.218705:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514f2a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9498e expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.218715:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514f2a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9498e expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.218732:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727514f2a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9498e expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.218757:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.218758:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.218781:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94995 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.218788:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94995 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.218813:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94995 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.218821:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94995 expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.218830:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172439936:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.218883:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.221136:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172439936:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.221151:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.221181:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175156352:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2505us (2871us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.221189:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10894 00000100:00100000:0.0:1746144893.222713:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.222897:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175156608 00000100:00100000:3.0:1746144893.222904:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175156608 00002000:00100000:3.0:1746144893.222937:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4b800 x1830965175156608/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.222958:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b800 with x1830965175156608 ext(0->4095) 00010000:00010000:3.0:1746144893.222965:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94995 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.222976:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94995 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.222983:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb4b800 00000100:00100000:3.0:1746144893.223011:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2035 00000100:00100000:3.0:1746144893.223017:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175156608:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144893.223267:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175156608:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 249us (557us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.223274:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2035 00002000:00100000:3.0:1746144893.223279:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4b800 x1830965175156608/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.223286:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b800 with x1830965175156608 ext(0->4095) 00010000:00010000:3.0:1746144893.223291:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94995 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.223300:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94995 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.223305:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb4b800 00000100:00100000:0.0:1746144893.227871:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.227967:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175156736 00000100:00100000:3.0:1746144893.227974:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175156736 00010000:00010000:3.0:1746144893.228002:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94995 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.228031:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10895 00000100:00100000:3.0:1746144893.228037:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175156736:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.228048:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.228067:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94995 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.228082:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94995 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.228101:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cd800/0x4076af6727514f31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94995 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.228115:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.228117:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.228122:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514f38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9499c expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.228129:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514f38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9499c expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.228436:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514f38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9499c expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.228448:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172440064:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.228698:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.233139:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172440064:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.233159:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.233193:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175156736:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5156us (5327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.233202:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10895 00000100:00100000:0.0:1746144893.233533:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.233894:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175156992 00000100:00100000:3.0:1746144893.233900:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175156992 00002000:00100000:3.0:1746144893.233927:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4b100 x1830965175156992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.233935:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b100 with x1830965175156992 ext(0->4095) 00002000:00010000:3.0:1746144893.233938:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4b100 00000100:00100000:3.0:1746144893.233973:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4032 00000100:00100000:3.0:1746144893.233978:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175156992:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144893.234113:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175156992:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 134us (580us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.234119:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4032 00002000:00100000:3.0:1746144893.234124:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4b100 x1830965175156992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.234130:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b100 with x1830965175156992 ext(0->4095) 00002000:00010000:3.0:1746144893.234133:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4b100 00000100:00100000:0.0:1746144893.236006:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.236090:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175157120 00000100:00100000:2.0:1746144893.236096:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175157120 00000100:00100000:2.0:1746144893.236213:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5480 00000100:00100000:2.0:1746144893.236221:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175157120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.236232:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.236247:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af949a3 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.236269:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514f38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9499c expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.236276:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.236278:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.236281:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f3f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949a3 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.236305:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514f38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9499c expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.236314:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514f38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9499c expref: 7 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.236329:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172440192:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.236405:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093abac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.238443:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172440192:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.238469:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f3f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949a3 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.238482:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094198000, rc 0) 00000100:00100000:2.0:1746144893.238521:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175157120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2301us (2519us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.238528:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5480 00000100:00100000:0.0:1746144893.239605:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.240015:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175157248 00000100:00100000:3.0:1746144893.240020:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175157248 00010000:00010000:3.0:1746144893.240045:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514f38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9499c expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.240223:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10896 00000100:00100000:3.0:1746144893.240231:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175157248:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.240242:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.240259:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514f38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9499c expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.240274:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514f38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9499c expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.240291:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514f38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9499c expref: 8 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.240315:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.240317:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.240323:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949a3 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.240330:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949a3 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.240354:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949a3 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.240364:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172440320:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.240426:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.242044:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172440320:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.242059:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.242084:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae40e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175157248:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1854us (2481us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.242092:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10896 00000100:00100000:0.0:1746144893.243645:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.243728:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175157504 00000100:00100000:3.0:1746144893.243735:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175157504 00002000:00100000:3.0:1746144893.243884:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ae43480 x1830965175157504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.243892:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae43480 with x1830965175157504 ext(0->4095) 00002000:00010000:3.0:1746144893.243896:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae43480 00000100:00100000:3.0:1746144893.243924:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4033 00000100:00100000:3.0:1746144893.243931:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175157504:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144893.244095:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175157504:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 163us (454us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.244101:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4033 00002000:00100000:3.0:1746144893.244106:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ae43480 x1830965175157504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.244113:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae43480 with x1830965175157504 ext(0->4095) 00002000:00010000:3.0:1746144893.244115:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae43480 00000100:00100000:0.0:1746144893.244373:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.244549:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175157632 00000100:00100000:2.0:1746144893.244553:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175157632 00000100:00100000:2.0:1746144893.244589:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5481 00000100:00100000:2.0:1746144893.244595:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:31565:x1830965175157632:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.244603:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.244616:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af949aa expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.244637:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949a3 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.244643:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.244644:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.244647:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949aa expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.244676:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949a3 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.244684:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949a3 expref: 5 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.244694:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172440448:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.244759:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093abac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.247170:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.247386:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172440448:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.247411:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949aa expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.247424:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea47e00, rc 0) 00000100:00100000:2.0:1746144893.247462:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31565:x1830965175157632:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2866us (3088us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.247469:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5481 00000100:00100000:0.0:1746144893.247647:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.247834:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175157888 00000100:00100000:3.0:1746144893.247840:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175157888 00010000:00010000:3.0:1746144893.247860:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949a3 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.247883:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10897 00000100:00100000:3.0:1746144893.247890:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175157888:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.247900:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.247916:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949a3 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.247929:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949a3 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.247956:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727514f3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949a3 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.247969:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.247970:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.247976:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949aa expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.247983:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949aa expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.248005:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949aa expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.248014:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172440576:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.248059:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.248636:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175157760 00000100:00100000:2.0:1746144893.248640:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175157760 00000100:00100000:2.0:1746144893.248658:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5482 00000100:00100000:2.0:1746144893.248663:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31579:x1830965175157760:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.248672:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.248681:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727514f4d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af949b1 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.248694:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949aa expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.248700:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.248702:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.248705:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727514f4d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b1 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.248719:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949aa expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.248729:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949aa expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.248736:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172440704:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.248783:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093abac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.250585:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172440576:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.250599:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.250627:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175157888:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2737us (2979us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.250635:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10897 00000100:00100000:0.0:1746144893.252017:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.252799:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175158144 00000100:00100000:1.0:1746144893.252806:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175158144 00002000:00100000:1.0:1746144893.252840:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea4a80 x1830965175158144/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.252848:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4a80 with x1830965175158144 ext(0->4095) 00010000:00010000:1.0:1746144893.252855:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949aa expref: 10 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.252866:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949aa expref: 10 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.252872:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea4a80 00000100:00100000:1.0:1746144893.252894:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2036 00000100:00100000:1.0:1746144893.252900:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965175158144:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144893.253217:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172440704:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.253240:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727514f4d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b1 expref: 10 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.253252:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0cb200, rc 0) 00000100:00100000:2.0:1746144893.253280:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+10:31579:x1830965175157760:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4617us (6117us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.253285:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5482 00000100:00100000:1.0:1746144893.253704:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175158144:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 804us (1689us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.253711:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2036 00002000:00100000:1.0:1746144893.253716:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea4a80 x1830965175158144/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.253723:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4a80 with x1830965175158144 ext(0->4095) 00010000:00010000:1.0:1746144893.253727:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949aa expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.253735:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949aa expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.253741:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea4a80 00000100:00100000:0.0:1746144893.256831:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.256898:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175158272 00000100:00100000:3.0:1746144893.256904:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175158272 00010000:00010000:3.0:1746144893.256927:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949aa expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.256958:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10898 00000100:00100000:3.0:1746144893.256964:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1983:x1830965175158272:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.256973:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.256988:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949aa expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.256997:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949aa expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.257013:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af6727514f46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949aa expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.257035:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.257037:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.257043:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727514f4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b1 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.257049:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727514f4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b1 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.257073:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727514f4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b1 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.257082:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172440832:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.257139:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.258399:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172440832:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.258413:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.258436:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175158272:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1471us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.258443:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10898 00000100:00100000:0.0:1746144893.260151:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.260495:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175158528 00000100:00100000:1.0:1746144893.260592:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175158528 00002000:00100000:1.0:1746144893.260626:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea4000 x1830965175158528/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.260634:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4000 with x1830965175158528 ext(0->4095) 00002000:00010000:1.0:1746144893.260637:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea4000 00000100:00100000:1.0:1746144893.260664:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4034 00000100:00100000:1.0:1746144893.260671:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175158528:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144893.260969:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175158528:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 298us (822us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.260975:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4034 00002000:00100000:1.0:1746144893.260980:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea4000 x1830965175158528/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.260986:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4000 with x1830965175158528 ext(0->4095) 00002000:00010000:1.0:1746144893.260989:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea4000 00000100:00100000:0.0:1746144893.263193:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.263712:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175158656 00000100:00100000:2.0:1746144893.263720:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175158656 00000100:00100000:2.0:1746144893.263789:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5483 00000100:00100000:2.0:1746144893.263797:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175158656:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.263812:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.263825:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514f54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af949b8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.263847:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727514f4d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b1 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.263853:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.263855:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.263858:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514f54 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b8 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.263882:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727514f4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b1 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.263891:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727514f4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b1 expref: 7 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.263902:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172440960:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.263980:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093abac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.265557:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172440960:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.265577:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514f54 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b8 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.265588:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0caa00, rc 0) 00000100:00100000:2.0:1746144893.265622:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175158656:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1825us (2433us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.265630:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5483 00000100:00100000:0.0:1746144893.266413:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.266497:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175158784 00000100:00100000:3.0:1746144893.266502:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175158784 00010000:00010000:3.0:1746144893.266523:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727514f4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b1 expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.266547:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10899 00000100:00100000:3.0:1746144893.266553:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175158784:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.266563:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.266578:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727514f4d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b1 expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.266587:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727514f4d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b1 expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.266605:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727514f4d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b1 expref: 8 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.267087:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.267090:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.267096:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514f54 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b8 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.267107:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514f54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b8 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.267133:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514f54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b8 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.267144:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172441088:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.267203:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.269360:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.269427:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175159040 00000100:00100000:1.0:1746144893.269433:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175159040 00002000:00100000:1.0:1746144893.269465:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e3b800 x1830965175159040/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.269473:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3b800 with x1830965175159040 ext(0->4095) 00002000:00010000:1.0:1746144893.269477:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e3b800 00000100:00100000:1.0:1746144893.269503:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4035 00000100:00100000:1.0:1746144893.269510:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175159040:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144893.269646:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175159040:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 136us (291us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.269652:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4035 00002000:00100000:1.0:1746144893.269657:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e3b800 x1830965175159040/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.269664:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3b800 with x1830965175159040 ext(0->4095) 00002000:00010000:1.0:1746144893.269667:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e3b800 00000100:00100000:3.0:1746144893.269895:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172441088:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.269910:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.269930:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175158784:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3378us (3519us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.269937:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10899 00000100:00100000:0.0:1746144893.271151:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.271239:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175159168 00000100:00100000:2.0:1746144893.271245:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175159168 00000100:00100000:2.0:1746144893.271662:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5484 00000100:00100000:2.0:1746144893.271824:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:31565:x1830965175159168:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.271838:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.271851:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af949bf expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.271873:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514f54 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b8 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.271879:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.271881:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.271884:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949bf expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.271908:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514f54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b8 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.271917:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514f54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b8 expref: 5 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.271928:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172441216:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.272002:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093abac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.273008:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.273727:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175159296 00000100:00100000:1.0:1746144893.273733:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175159296 00000100:00100000:3.0:1746144893.274019:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5485 00000100:00100000:3.0:1746144893.274026:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31579:x1830965175159296:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.274036:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.274046:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514f62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af949c6 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.274061:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.274065:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949bf expref: 10 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.274070:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.274073:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514f62 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949c6 expref: 10 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.274094:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949bf expref: 10 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.274104:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514f62 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949c6 expref: 10 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.274111:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377a00, rc 0) 00000100:00100000:3.0:1746144893.274136:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+10:31579:x1830965175159296:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 111us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.274141:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5485 00000100:00100000:0.0:1746144893.274972:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.275097:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172441216:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.275116:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949bf expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.275125:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094199a00, rc 0) 00000100:00100000:2.0:1746144893.275281:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175159424 00000100:00100000:2.0:1746144893.275286:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175159424 00010000:00010000:2.0:1746144893.275304:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514f54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b8 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.275325:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10900 00000100:00100000:2.0:1746144893.275330:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175159424:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.275340:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.275356:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514f54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b8 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.275365:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514f54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b8 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.275380:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af6727514f54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949b8 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.275397:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.275399:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.275404:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949bf expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.275411:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949bf expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.275430:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949bf expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.275438:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949bf expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.275453:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172441472:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.275666:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31565:x1830965175159168:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3997us (4516us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.275671:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5484 00000100:00100000:2.0:1746144893.276189:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093abac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.278638:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.278716:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172441472:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.278735:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.278902:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175159424:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3570us (3930us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.278909:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10900 00000100:00100000:3.0:1746144893.279132:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175159680 00000100:00100000:3.0:1746144893.279137:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175159680 00002000:00100000:3.0:1746144893.279163:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e3b480 x1830965175159680/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.279170:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3b480 with x1830965175159680 ext(0->4095) 00010000:00010000:3.0:1746144893.279177:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949bf expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.279188:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949bf expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.279193:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e3b480 00000100:00100000:3.0:1746144893.279216:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2037 00000100:00100000:3.0:1746144893.279222:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175159680:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144893.279337:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175159680:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 114us (704us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.279342:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2037 00002000:00100000:3.0:1746144893.279346:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e3b480 x1830965175159680/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.279352:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3b480 with x1830965175159680 ext(0->4095) 00010000:00010000:3.0:1746144893.279356:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949bf expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.279363:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949bf expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.279368:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e3b480 00000100:00100000:0.0:1746144893.281868:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.282000:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175159808 00000100:00100000:2.0:1746144893.282008:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175159808 00010000:00010000:2.0:1746144893.282039:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949bf expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.282072:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10901 00000100:00100000:2.0:1746144893.282079:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175159808:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.282091:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.282106:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949bf expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.282116:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949bf expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.282135:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514f5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949bf expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.282161:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.282164:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.282169:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514f62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949c6 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.282176:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514f62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949c6 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.282208:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514f62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949c6 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.282218:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172441600:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.282953:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093abac00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.285493:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172441600:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.285514:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.285558:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175159808:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3478us (3695us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.285567:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10901 00000100:00100000:0.0:1746144893.286515:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.286804:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175160064 00000100:00100000:2.0:1746144893.286809:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175160064 00002000:00100000:2.0:1746144893.286838:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e3bb80 x1830965175160064/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.286847:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3bb80 with x1830965175160064 ext(0->4095) 00002000:00010000:2.0:1746144893.286851:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e3bb80 00000100:00100000:2.0:1746144893.286875:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4036 00000100:00100000:2.0:1746144893.286881:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175160064:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.287023:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175160064:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 142us (508us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.287029:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4036 00002000:00100000:2.0:1746144893.287034:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e3bb80 x1830965175160064/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.287040:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3bb80 with x1830965175160064 ext(0->4095) 00002000:00010000:2.0:1746144893.287043:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e3bb80 00000100:00100000:0.0:1746144893.289436:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.289598:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175160192 00000100:00100000:3.0:1746144893.289604:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175160192 00000100:00100000:3.0:1746144893.289633:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5486 00000100:00100000:3.0:1746144893.289639:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175160192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.289650:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.289665:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af949cd expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.289693:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514f62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949c6 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.289698:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.289700:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.289703:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949cd expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.289725:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514f62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949c6 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.289736:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514f62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949c6 expref: 7 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.289745:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172441728:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.289837:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.299043:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172441728:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.299068:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949cd expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.299083:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377800, rc 0) 00000100:00100000:3.0:1746144893.299133:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175160192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 9494us (9701us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.299141:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5486 00000100:00100000:0.0:1746144893.299473:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.299565:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.299621:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175160448 00000100:00100000:3.0:1746144893.299626:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175160448 00000100:00100000:3.0:1746144893.299649:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5487 00000100:00100000:3.0:1746144893.299654:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31565:x1830965175160448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.299665:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.299675:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af949d4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.299692:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.299696:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949cd expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.299701:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144893.299704:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949d4 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.299726:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949cd expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.299735:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949d4 expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.299742:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377600, rc 0) 00000100:00100000:3.0:1746144893.299759:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31565:x1830965175160448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 106us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.299785:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5487 00000100:00100000:2.0:1746144893.300140:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175160320 00000100:00100000:2.0:1746144893.300144:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175160320 00010000:00010000:2.0:1746144893.300162:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514f62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949c6 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.300853:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10902 00000100:00100000:2.0:1746144893.300861:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175160320:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.300869:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.300886:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514f62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949c6 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.300896:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514f62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949c6 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.300911:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514f62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949c6 expref: 9 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.301477:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.301479:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.301484:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949cd expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.301497:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949cd expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.301517:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949cd expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.301526:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949cd expref: 5 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.301537:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172441984:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.301597:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.304849:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.305005:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172441984:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.305023:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.305055:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175160320:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4195us (5582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.305063:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10902 00000100:00100000:3.0:1746144893.305370:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175160704 00000100:00100000:3.0:1746144893.305375:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175160704 00002000:00100000:3.0:1746144893.305405:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093369c00 x1830965175160704/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.305414:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369c00 with x1830965175160704 ext(0->4095) 00010000:00010000:3.0:1746144893.305421:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949cd expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.305431:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949cd expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.305437:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093369c00 00000100:00100000:3.0:1746144893.305451:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2038 00000100:00100000:3.0:1746144893.305457:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175160704:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144893.305595:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175160704:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 138us (751us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.305601:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2038 00002000:00100000:3.0:1746144893.305605:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093369c00 x1830965175160704/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.305613:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369c00 with x1830965175160704 ext(0->4095) 00010000:00010000:3.0:1746144893.305617:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949cd expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.305625:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949cd expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.305630:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093369c00 00000100:00100000:0.0:1746144893.308235:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.308313:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175160832 00000100:00100000:2.0:1746144893.308319:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175160832 00010000:00010000:2.0:1746144893.308345:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949cd expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.308364:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10903 00000100:00100000:2.0:1746144893.308370:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175160832:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.308379:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.308394:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949cd expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.308404:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949cd expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.308422:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514f69 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949cd expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.308583:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.308585:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.308591:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949d4 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.308599:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949d4 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.308625:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949d4 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.308635:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172442112:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.309093:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.312034:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.312116:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172442112:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.312134:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.312163:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175160832:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3793us (3934us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.312171:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10903 00000100:00100000:3.0:1746144893.312233:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175161088 00000100:00100000:3.0:1746144893.312237:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175161088 00002000:00100000:3.0:1746144893.312264:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336b800 x1830965175161088/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.312272:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336b800 with x1830965175161088 ext(0->4095) 00002000:00010000:3.0:1746144893.312275:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009336b800 00000100:00100000:3.0:1746144893.312295:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4037 00000100:00100000:3.0:1746144893.312300:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175161088:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144893.312745:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175161088:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 444us (716us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.312751:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4037 00002000:00100000:3.0:1746144893.312756:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336b800 x1830965175161088/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.312778:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336b800 with x1830965175161088 ext(0->4095) 00002000:00010000:3.0:1746144893.312780:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009336b800 00000100:00100000:0.0:1746144893.319181:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.319274:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175161216 00000100:00100000:2.0:1746144893.319283:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175161216 00000100:00100000:2.0:1746144893.319335:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5488 00000100:00100000:2.0:1746144893.319342:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175161216:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.319357:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.319371:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af949db expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.319395:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949d4 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.319401:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.319403:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.319406:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949db expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.319430:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949d4 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.319440:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949d4 expref: 7 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.319451:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172442240:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.319973:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.331989:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172442240:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.332017:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949db expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.332033:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1aa00, rc 0) 00000100:00100000:2.0:1746144893.332066:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175161216:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 12725us (12892us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.332073:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5488 00000100:00100000:0.0:1746144893.332960:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.334444:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175161344 00000100:00100000:2.0:1746144893.334453:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175161344 00000100:00100000:2.0:1746144893.334501:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5489 00000100:00100000:2.0:1746144893.334507:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31565:x1830965175161344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.334521:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.334535:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af949e2 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.334555:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.334559:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949db expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.334564:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144893.334566:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e2 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.334592:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949db expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.334600:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e2 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.334611:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b000, rc 0) 00000100:00100000:2.0:1746144893.335138:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31565:x1830965175161344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 629us (2178us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.335144:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5489 00000100:00100000:0.0:1746144893.337517:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.337628:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175161472 00000100:00100000:3.0:1746144893.337635:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175161472 00002000:00100000:3.0:1746144893.337670:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880093369500 x1830965175161472/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 496/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.337678:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369500 with x1830965175161472 ext(0->7) 00010000:00010000:3.0:1746144893.337686:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949d4 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.337698:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949d4 expref: 9 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.337708:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093369500 00000100:00100000:3.0:1746144893.337736:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2039 00000100:00100000:3.0:1746144893.337742:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175161472:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144893.338034:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1985:x1830965175161472:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 291us (521us total) trans 4294968011 rc 0/0 00000100:00100000:3.0:1746144893.338040:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2039 00002000:00100000:3.0:1746144893.338045:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880093369500 x1830965175161472/t4294968011(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 496/448 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.338052:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369500 with x1830965175161472 ext(0->7) 00010000:00010000:3.0:1746144893.338056:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949d4 expref: 11 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.338064:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949d4 expref: 11 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.338069:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093369500 00000100:00100000:0.0:1746144893.350564:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.350677:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175161600 00000100:00100000:2.0:1746144893.350686:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175161600 00010000:00010000:2.0:1746144893.350719:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949d4 expref: 11 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.350753:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10904 00000100:00100000:2.0:1746144893.350759:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1985:x1830965175161600:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.350791:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.350810:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949d4 expref: 11 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.350820:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949d4 expref: 11 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.350837:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514f70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949d4 expref: 11 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.350860:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.350862:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.350867:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949db expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.350878:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949db expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.350901:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949db expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.350909:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949db expref: 5 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.350918:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172442496:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.351409:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.354891:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.354971:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175161856 00000100:00100000:3.0:1746144893.354977:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175161856 00002000:00100000:3.0:1746144893.355010:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368e00 x1830965175161856/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.355018:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368e00 with x1830965175161856 ext(0->4095) 00010000:00010000:3.0:1746144893.355025:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949db expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.355039:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949db expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.355040:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172442496:192.168.202.16@tcp:105: 00002000:00010000:3.0:1746144893.355045:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093368e00 00010000:00010000:2.0:1746144893.355057:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.355065:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2040 00000100:00100000:3.0:1746144893.355070:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175161856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144893.355100:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175161600:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4341us (4542us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.355107:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10904 00000100:00100000:3.0:1746144893.355200:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175161856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 129us (316us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.355206:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2040 00002000:00100000:3.0:1746144893.355210:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368e00 x1830965175161856/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.355216:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368e00 with x1830965175161856 ext(0->4095) 00010000:00010000:3.0:1746144893.355220:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949db expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.355228:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949db expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.355233:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093368e00 00000100:00100000:0.0:1746144893.357897:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.358023:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175161984 00000100:00100000:2.0:1746144893.358030:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175161984 00010000:00010000:2.0:1746144893.358061:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949db expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.358082:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10905 00000100:00100000:2.0:1746144893.358088:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175161984:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.358098:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.358115:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949db expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.358126:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949db expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.358142:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514f77 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949db expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.358172:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.358174:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.358179:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e2 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.358187:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e2 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.358214:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e2 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.358223:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172442624:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.358287:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.360585:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172442624:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.360604:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.361065:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175161984:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2975us (3171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.361073:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10905 00000100:00100000:1.0:1746144893.361600:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.361819:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175162240 00000100:00100000:0.0:1746144893.361825:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175162240 00002000:00100000:0.0:1746144893.361856:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932a8700 x1830965175162240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144893.361863:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a8700 with x1830965175162240 ext(0->4095) 00002000:00010000:0.0:1746144893.361867:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800932a8700 00000100:00100000:0.0:1746144893.361890:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4038 00000100:00100000:0.0:1746144893.361896:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1983:x1830965175162240:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:0.0:1746144893.362038:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1983:x1830965175162240:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 141us (438us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144893.362043:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4038 00002000:00100000:0.0:1746144893.362048:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932a8700 x1830965175162240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144893.362054:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a8700 with x1830965175162240 ext(0->4095) 00002000:00010000:0.0:1746144893.362057:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800932a8700 00000100:00100000:0.0:1746144893.367718:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.367878:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175162368 00000100:00100000:2.0:1746144893.367886:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175162368 00000100:00100000:2.0:1746144893.367925:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5490 00000100:00100000:2.0:1746144893.367933:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175162368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.367958:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.367973:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af949e9 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.367998:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e2 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.368005:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.368007:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.368010:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e9 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.368035:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e2 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.368046:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e2 expref: 9 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.368057:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172442752:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.368234:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.370971:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172442752:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.371000:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e9 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.371019:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1ae00, rc 0) 00000100:00100000:2.0:1746144893.375053:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175162368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7108us (7329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.375062:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5490 00000100:00100000:0.0:1746144893.380252:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.380335:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175162496 00000100:00100000:3.0:1746144893.380344:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175162496 00002000:00100000:3.0:1746144893.380384:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008ee6a300 x1830965175162496/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 496/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.380393:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6a300 with x1830965175162496 ext(0->7) 00010000:00010000:3.0:1746144893.380402:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e2 expref: 10 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.380413:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e2 expref: 10 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.380421:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ee6a300 00000100:00100000:3.0:1746144893.380437:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2041 00000100:00100000:3.0:1746144893.380444:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965175162496:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144893.380738:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1984:x1830965175162496:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 293us (493us total) trans 4294968012 rc 0/0 00000100:00100000:3.0:1746144893.380745:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2041 00002000:00100000:3.0:1746144893.380750:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008ee6a300 x1830965175162496/t4294968012(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 496/448 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.380757:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6a300 with x1830965175162496 ext(0->7) 00010000:00010000:3.0:1746144893.380778:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e2 expref: 12 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.380787:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e2 expref: 12 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.380793:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ee6a300 00000100:00100000:0.0:1746144893.384439:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.384521:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175162624 00000100:00100000:2.0:1746144893.384529:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175162624 00010000:00010000:2.0:1746144893.384559:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e2 expref: 12 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.384580:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10906 00000100:00100000:2.0:1746144893.384586:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1984:x1830965175162624:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.384596:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.384612:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e2 expref: 12 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.384622:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e2 expref: 12 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.384639:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727514f7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e2 expref: 12 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.384667:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.384669:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.384675:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e9 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.384686:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e9 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.384712:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e9 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.384723:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172442880:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.384807:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.387025:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.387101:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175162752 00000100:00100000:3.0:1746144893.387107:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175162752 00000100:00100000:3.0:1746144893.387135:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5491 00000100:00100000:3.0:1746144893.387141:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+12:31565:x1830965175162752:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.387155:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.387167:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af949f0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.387188:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e9 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.387194:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.387195:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.387198:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f0 expref: 13 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.387221:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e9 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.387230:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e9 expref: 5 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.387239:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172443008:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.387302:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.387502:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172442880:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.387518:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.387592:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+13:1984:x1830965175162624:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3004us (3157us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.387599:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10906 00000100:00100000:0.0:1746144893.390183:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.390312:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172443008:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.390334:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f0 expref: 12 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.390348:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377400, rc 0) 00000100:00100000:3.0:1746144893.390399:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+12:31565:x1830965175162752:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3257us (3378us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.390409:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5491 00000100:00100000:2.0:1746144893.390600:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175163008 00000100:00100000:2.0:1746144893.390605:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175163008 00002000:00100000:2.0:1746144893.390636:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee6ad80 x1830965175163008/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.390644:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6ad80 with x1830965175163008 ext(0->4095) 00010000:00010000:2.0:1746144893.390650:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e9 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.390661:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e9 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.390666:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ee6ad80 00000100:00100000:2.0:1746144893.390679:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2042 00000100:00100000:2.0:1746144893.390684:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175163008:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144893.391543:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175163008:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 857us (1363us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.391550:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2042 00002000:00100000:2.0:1746144893.391555:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee6ad80 x1830965175163008/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.391562:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6ad80 with x1830965175163008 ext(0->4095) 00010000:00010000:2.0:1746144893.391567:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e9 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.391577:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e9 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.391582:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ee6ad80 00000100:00100000:0.0:1746144893.394192:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.394283:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175163136 00000100:00100000:2.0:1746144893.394290:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175163136 00010000:00010000:2.0:1746144893.394321:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e9 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.394696:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10907 00000100:00100000:2.0:1746144893.394704:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175163136:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.394715:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.394731:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e9 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.394744:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e9 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.394760:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727514f85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949e9 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.395649:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.395652:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.395659:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f0 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.395667:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f0 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.395695:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f0 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.395706:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172443136:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.397330:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.401631:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.401723:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175163392 00000100:00100000:3.0:1746144893.401730:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175163392 00002000:00100000:3.0:1746144893.401784:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee68e00 x1830965175163392/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.401792:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee68e00 with x1830965175163392 ext(0->4095) 00002000:00010000:3.0:1746144893.401796:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee68e00 00000100:00100000:3.0:1746144893.401812:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4039 00000100:00100000:3.0:1746144893.401818:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1982:x1830965175163392:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:3.0:1746144893.401976:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1982:x1830965175163392:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 157us (352us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.401982:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4039 00002000:00100000:3.0:1746144893.401987:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee68e00 x1830965175163392/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.401993:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee68e00 with x1830965175163392 ext(0->4095) 00002000:00010000:3.0:1746144893.401996:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee68e00 00000100:00100000:2.0:1746144893.402737:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172443136:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.402756:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.403108:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175163136:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 8404us (8920us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.403115:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10907 00000100:00100000:0.0:1746144893.412401:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.412499:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175163520 00000100:00100000:3.0:1746144893.412508:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175163520 00000100:00100000:3.0:1746144893.412545:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5492 00000100:00100000:3.0:1746144893.412551:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175163520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.412565:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.412578:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af949f7 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.412606:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f0 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.412612:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.412614:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.412617:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f7 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.412641:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f0 expref: 11 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.412651:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f0 expref: 11 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.412662:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172443264:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.412740:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.415707:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172443264:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.415732:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f7 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.415747:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094376e00, rc 0) 00000100:00100000:3.0:1746144893.416114:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175163520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3561us (3718us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.416122:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5492 00000100:00100000:0.0:1746144893.419879:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.419978:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.420065:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175163648 00000100:00100000:3.0:1746144893.420074:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175163648 00000100:00100000:1.0:1746144893.420099:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175163776 00000100:00100000:1.0:1746144893.420102:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175163776 00000100:00100000:3.0:1746144893.420108:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5493 00000100:00100000:3.0:1746144893.420114:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+13:31565:x1830965175163648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00002000:00100000:1.0:1746144893.420124:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008ee6b800 x1830965175163776/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 496/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1746144893.420126:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1746144893.420132:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6b800 with x1830965175163776 ext(0->7) 00010000:00010000:1.0:1746144893.420138:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f0 expref: 13 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.420139:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af949fe expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.420149:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f0 expref: 14 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.420154:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ee6b800 00010000:00010000:3.0:1746144893.420161:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.420165:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f7 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.420170:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144893.420173:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949fe expref: 14 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144893.420177:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2043 00000100:00100000:1.0:1746144893.420182:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+14:1985:x1830965175163776:12345-192.168.202.16@tcp:4:ldlm_bl.0 00010000:00010000:3.0:1746144893.420202:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f7 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.420212:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949fe expref: 14 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.420219:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094376600, rc 0) 00000100:00100000:3.0:1746144893.420251:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+14:31565:x1830965175163648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 138us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.420256:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5493 00000100:00100000:1.0:1746144893.420434:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+15:1985:x1830965175163776:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 250us (454us total) trans 4294968013 rc 0/0 00000100:00100000:1.0:1746144893.420440:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2043 00002000:00100000:1.0:1746144893.420445:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008ee6b800 x1830965175163776/t4294968013(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 496/448 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.420452:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6b800 with x1830965175163776 ext(0->7) 00010000:00010000:1.0:1746144893.420456:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f0 expref: 15 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.420465:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f0 expref: 15 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.420474:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ee6b800 00000100:00100000:0.0:1746144893.422093:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.422958:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175163904 00000100:00100000:2.0:1746144893.422966:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175163904 00010000:00010000:2.0:1746144893.422999:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f0 expref: 15 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.423021:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10908 00000100:00100000:2.0:1746144893.423027:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+15:1983:x1830965175163904:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.423037:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.423053:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f0 expref: 15 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.423062:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f0 expref: 15 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.423087:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377400/0x4076af6727514f8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f0 expref: 15 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.423110:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.423111:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.423117:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f7 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.423124:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f7 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.423149:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f7 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.423159:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f7 expref: 5 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.423169:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172443520:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.423234:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.426112:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172443520:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.426138:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.426185:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+14:1983:x1830965175163904:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3156us (4096us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.426194:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10908 00000100:00100000:0.0:1746144893.426570:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.426654:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175164160 00000100:00100000:1.0:1746144893.426660:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175164160 00002000:00100000:1.0:1746144893.426693:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee69f80 x1830965175164160/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.426702:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee69f80 with x1830965175164160 ext(0->4095) 00010000:00010000:1.0:1746144893.426709:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f7 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.426720:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f7 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.426726:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ee69f80 00000100:00100000:1.0:1746144893.426750:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2044 00000100:00100000:1.0:1746144893.426757:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175164160:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144893.426909:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175164160:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 153us (340us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.426914:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2044 00002000:00100000:1.0:1746144893.426919:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee69f80 x1830965175164160/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.426928:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee69f80 with x1830965175164160 ext(0->4095) 00010000:00010000:1.0:1746144893.426932:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f7 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.426956:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f7 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.426961:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ee69f80 00000100:00100000:0.0:1746144893.428301:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.428426:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175164288 00000100:00100000:2.0:1746144893.428431:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175164288 00010000:00010000:2.0:1746144893.428455:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f7 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.428484:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10909 00000100:00100000:2.0:1746144893.428490:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175164288:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.428498:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.428513:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f7 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.428522:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f7 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.428540:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727514f93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949f7 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.428552:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.428555:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.428560:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949fe expref: 13 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.428567:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949fe expref: 13 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.428590:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949fe expref: 13 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.428601:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172443648:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.428672:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.430097:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172443648:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.430114:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.430161:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175164288:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1670us (1862us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.430169:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10909 00000100:00100000:0.0:1746144893.430352:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.431127:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175164544 00000100:00100000:2.0:1746144893.431132:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175164544 00002000:00100000:2.0:1746144893.431162:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee6b100 x1830965175164544/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.431170:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6b100 with x1830965175164544 ext(0->4095) 00002000:00010000:2.0:1746144893.431173:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee6b100 00000100:00100000:2.0:1746144893.431188:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4040 00000100:00100000:2.0:1746144893.431193:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+14:1982:x1830965175164544:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746144893.431334:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+14:1982:x1830965175164544:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 140us (982us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.431341:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4040 00002000:00100000:2.0:1746144893.431345:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee6b100 x1830965175164544/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.431352:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6b100 with x1830965175164544 ext(0->4095) 00002000:00010000:2.0:1746144893.431354:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee6b100 00000100:00100000:0.0:1746144893.433398:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.433488:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175164672 00000100:00100000:2.0:1746144893.433494:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175164672 00000100:00100000:2.0:1746144893.433538:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5494 00000100:00100000:2.0:1746144893.433543:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175164672:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.433571:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.433583:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514fa1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a05 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.433603:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949fe expref: 13 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.433609:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.433611:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.433614:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514fa1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a05 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.433634:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949fe expref: 13 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.433643:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949fe expref: 13 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.433656:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172443776:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.433726:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.436148:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172443776:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.436177:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514fa1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a05 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.436191:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1ac00, rc 0) 00000100:00100000:2.0:1746144893.436240:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175164672:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2695us (2845us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.436246:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5494 00000100:00100000:0.0:1746144893.436307:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.436512:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175164800 00000100:00100000:2.0:1746144893.436517:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175164800 00002000:00100000:2.0:1746144893.436543:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008ee68a80 x1830965175164800/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 496/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.436551:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee68a80 with x1830965175164800 ext(0->7) 00010000:00010000:2.0:1746144893.436557:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949fe expref: 14 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.436566:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949fe expref: 14 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.436572:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ee68a80 00000100:00100000:2.0:1746144893.436648:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2045 00000100:00100000:2.0:1746144893.436654:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+14:1985:x1830965175164800:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144893.437259:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1985:x1830965175164800:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 603us (950us total) trans 4294968014 rc 0/0 00000100:00100000:2.0:1746144893.437264:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2045 00002000:00100000:2.0:1746144893.437269:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008ee68a80 x1830965175164800/t4294968014(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 496/448 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.437276:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee68a80 with x1830965175164800 ext(0->7) 00010000:00010000:2.0:1746144893.437280:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949fe expref: 16 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.437288:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949fe expref: 16 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.437292:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008ee68a80 00000100:00100000:0.0:1746144893.439896:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.440029:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175164928 00000100:00100000:2.0:1746144893.440035:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175164928 00010000:00010000:2.0:1746144893.440065:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949fe expref: 16 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.440092:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10910 00000100:00100000:2.0:1746144893.440098:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1985:x1830965175164928:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.440108:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.440124:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949fe expref: 16 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.440133:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949fe expref: 16 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.440153:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514f9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af949fe expref: 16 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.440177:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.440179:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.440185:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514fa1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a05 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.440192:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514fa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a05 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.440217:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514fa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a05 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.440226:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172443904:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.440864:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.445387:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.445670:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172443904:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.445691:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.445728:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+15:1985:x1830965175164928:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5628us (5837us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.445737:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10910 00000100:00100000:3.0:1746144893.445834:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175165184 00000100:00100000:3.0:1746144893.445840:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175165184 00002000:00100000:3.0:1746144893.445871:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b3480 x1830965175165184/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.445886:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b3480 with x1830965175165184 ext(0->4095) 00002000:00010000:3.0:1746144893.445890:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012a2b3480 00000100:00100000:3.0:1746144893.445917:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4041 00000100:00100000:3.0:1746144893.445925:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175165184:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144893.446069:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175165184:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 145us (690us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.446075:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4041 00002000:00100000:3.0:1746144893.446080:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b3480 x1830965175165184/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.446086:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b3480 with x1830965175165184 ext(0->4095) 00002000:00010000:3.0:1746144893.446089:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012a2b3480 00000100:00100000:0.0:1746144893.447863:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.447904:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175165312 00000100:00100000:2.0:1746144893.447911:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175165312 00000100:00100000:0.0:1746144893.448689:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.449035:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175165440 00000100:00100000:2.0:1746144893.449040:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175165440 00000100:00100000:2.0:1746144893.449063:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5495 00000100:00100000:2.0:1746144893.449070:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+16:31579:x1830965175165312:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.449083:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.449101:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514fa8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a0c expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.449135:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5496 00000100:00100000:3.0:1746144893.449141:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+17:31565:x1830965175165440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.449147:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.449153:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a13 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.449170:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514fa1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a05 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.449176:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.449178:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.449181:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a13 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.449210:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514fa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a05 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.449219:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514fa1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a05 expref: 5 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.449229:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172444032:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.449334:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.449338:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a13 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.449343:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.449345:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514fa8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a0c expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.449363:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a13 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.449374:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514fa8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a0c expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.449382:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1aa00, rc 0) 00000100:00100000:2.0:1746144893.449401:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31579:x1830965175165312:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 332us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.449406:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5495 00000100:00100000:3.0:1746144893.449614:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.451453:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172444032:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.451474:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a13 expref: 17 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.451486:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377a00, rc 0) 00000100:00100000:3.0:1746144893.451516:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+17:31565:x1830965175165440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2375us (2827us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.451522:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5496 00000100:00100000:0.0:1746144893.451691:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.451819:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175165568 00000100:00100000:3.0:1746144893.451824:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175165568 00010000:00010000:3.0:1746144893.451844:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514fa1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a05 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.451859:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10911 00000100:00100000:3.0:1746144893.451865:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175165568:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.451874:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.451891:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514fa1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a05 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.451899:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514fa1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a05 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.451916:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727514fa1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a05 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.452183:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.452185:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.452191:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a13 expref: 16 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.452198:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a13 expref: 16 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.452222:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a13 expref: 16 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.452231:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a13 expref: 16 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.452240:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172444288:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.452503:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.454057:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.454186:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175165824 00000100:00100000:1.0:1746144893.454192:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175165824 00002000:00100000:1.0:1746144893.454225:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b0700 x1830965175165824/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.454235:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b0700 with x1830965175165824 ext(0->4095) 00010000:00010000:1.0:1746144893.454242:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a13 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.454253:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a13 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.454258:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012a2b0700 00000100:00100000:1.0:1746144893.454288:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2046 00000100:00100000:1.0:1746144893.454294:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1982:x1830965175165824:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144893.454432:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1982:x1830965175165824:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 138us (379us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.454438:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2046 00002000:00100000:1.0:1746144893.454443:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b0700 x1830965175165824/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.454450:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b0700 with x1830965175165824 ext(0->4095) 00010000:00010000:1.0:1746144893.454454:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a13 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.454463:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a13 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.454468:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012a2b0700 00000100:00100000:3.0:1746144893.454547:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172444288:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.454560:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.454581:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175165568:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2716us (2890us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.454587:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10911 00000100:00100000:0.0:1746144893.456826:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.456921:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175165952 00000100:00100000:3.0:1746144893.456927:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175165952 00010000:00010000:3.0:1746144893.456960:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a13 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.456980:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10912 00000100:00100000:3.0:1746144893.456986:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1983:x1830965175165952:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.456995:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.457011:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a13 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.457021:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a13 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.457038:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af6727514faf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a13 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.457049:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.457051:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.457056:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514fa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a0c expref: 16 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.457063:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514fa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a0c expref: 16 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.457089:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514fa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a0c expref: 16 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.457099:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172444416:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.457167:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.460364:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172444416:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.460380:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.460424:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1983:x1830965175165952:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3437us (3603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.460434:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10912 00000100:00100000:1.0:1746144893.460584:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.460700:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175166208 00000100:00100000:2.0:1746144893.460706:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175166208 00002000:00100000:2.0:1746144893.460740:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932ab100 x1830965175166208/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.460753:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932ab100 with x1830965175166208 ext(0->4095) 00002000:00010000:2.0:1746144893.460757:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800932ab100 00000100:00100000:2.0:1746144893.460797:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4042 00000100:00100000:2.0:1746144893.460804:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1984:x1830965175166208:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.460927:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1984:x1830965175166208:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 124us (343us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.460933:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4042 00002000:00100000:2.0:1746144893.460938:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932ab100 x1830965175166208/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.460955:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932ab100 with x1830965175166208 ext(0->4095) 00002000:00010000:2.0:1746144893.460958:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800932ab100 00000100:00100000:0.0:1746144893.462328:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.462458:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175166336 00000100:00100000:3.0:1746144893.462464:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175166336 00000100:00100000:3.0:1746144893.462750:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5497 00000100:00100000:3.0:1746144893.462759:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175166336:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.462789:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.462802:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fb6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a1a expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.462824:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514fa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a0c expref: 15 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.462832:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.462837:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.462840:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fb6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a1a expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.462869:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514fa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a0c expref: 15 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.462879:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514fa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a0c expref: 15 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.462889:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172444544:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.463043:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.465442:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172444544:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.465466:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fb6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a1a expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.465480:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377800, rc 0) 00000100:00100000:3.0:1746144893.465530:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175166336:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2772us (3204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.465537:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5497 00000100:00100000:0.0:1746144893.466204:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.466378:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175166464 00000100:00100000:3.0:1746144893.466384:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175166464 00010000:00010000:3.0:1746144893.466406:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514fa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a0c expref: 16 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.466438:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10913 00000100:00100000:3.0:1746144893.466444:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1984:x1830965175166464:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.466453:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.466470:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514fa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a0c expref: 16 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.466479:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514fa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a0c expref: 16 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.466496:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727514fa8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a0c expref: 16 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.467572:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.467576:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.467585:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fb6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a1a expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.467594:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a1a expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.467624:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a1a expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.467636:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172444672:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.467704:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.469385:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172444672:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.469400:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.469600:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+15:1984:x1830965175166464:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3155us (3396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.469610:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10913 00000100:00100000:0.0:1746144893.470081:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.470190:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175166720 00000100:00100000:2.0:1746144893.470197:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175166720 00002000:00100000:2.0:1746144893.470233:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918eed80 x1830965175166720/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.470241:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eed80 with x1830965175166720 ext(0->4095) 00002000:00010000:2.0:1746144893.470245:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918eed80 00000100:00100000:2.0:1746144893.470270:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4043 00000100:00100000:2.0:1746144893.470276:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175166720:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.470413:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175166720:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 137us (336us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.470419:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4043 00002000:00100000:2.0:1746144893.471043:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918eed80 x1830965175166720/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.471051:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eed80 with x1830965175166720 ext(0->4095) 00002000:00010000:2.0:1746144893.471054:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918eed80 00000100:00100000:0.0:1746144893.471554:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.471639:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175166848 00000100:00100000:3.0:1746144893.471643:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175166848 00000100:00100000:3.0:1746144893.471666:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5498 00000100:00100000:3.0:1746144893.471671:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+15:31565:x1830965175166848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.471681:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.471694:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a21 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.471715:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fb6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a1a expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.471721:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.471723:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.471725:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a21 expref: 16 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.471748:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a1a expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.471757:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a1a expref: 5 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.471786:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172444800:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.471847:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.472542:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.472603:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175166976 00000100:00100000:0.0:1746144893.472607:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175166976 00000100:00100000:0.0:1746144893.472631:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5499 00000100:00100000:0.0:1746144893.472636:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+17:31579:x1830965175166976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144893.472643:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144893.472649:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727514fc4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a28 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144893.472660:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144893.472663:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a21 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144893.472669:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144893.472671:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727514fc4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a28 expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144893.472687:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a21 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144893.472695:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727514fc4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a28 expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144893.472703:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b2600, rc 0) 00000100:00100000:0.0:1746144893.473189:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31579:x1830965175166976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 551us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144893.473195:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5499 00000100:00100000:3.0:1746144893.474144:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172444800:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.474161:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a21 expref: 17 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.474177:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377600, rc 0) 00000100:00100000:3.0:1746144893.474337:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+17:31565:x1830965175166848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2664us (2782us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.474342:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5498 00000100:00100000:0.0:1746144893.474745:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.474824:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175167104 00000100:00100000:3.0:1746144893.474829:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175167104 00010000:00010000:3.0:1746144893.474848:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a1a expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.474866:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10914 00000100:00100000:3.0:1746144893.474872:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175167104:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.474882:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.474899:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fb6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a1a expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.474909:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fb6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a1a expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.474928:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fb6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a1a expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.474956:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.474957:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.474963:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a21 expref: 16 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.474974:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a21 expref: 16 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.475001:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a21 expref: 16 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.475010:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a21 expref: 16 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.475021:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172445056:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.475075:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.476082:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172445056:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.476092:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.476124:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175167104:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1252us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.476130:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10914 00000100:00100000:0.0:1746144893.476712:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.476818:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175167360 00000100:00100000:2.0:1746144893.476823:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175167360 00002000:00100000:2.0:1746144893.476853:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918efb80 x1830965175167360/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.476861:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918efb80 with x1830965175167360 ext(0->4095) 00010000:00010000:2.0:1746144893.476867:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a21 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.476877:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a21 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.476883:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918efb80 00000100:00100000:2.0:1746144893.476905:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2047 00000100:00100000:2.0:1746144893.476911:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1984:x1830965175167360:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144893.477054:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1984:x1830965175167360:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 142us (342us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.477059:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2047 00002000:00100000:2.0:1746144893.477064:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918efb80 x1830965175167360/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.477070:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918efb80 with x1830965175167360 ext(0->4095) 00010000:00010000:2.0:1746144893.477075:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a21 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.477083:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a21 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.477088:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918efb80 00000100:00100000:0.0:1746144893.478634:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.478821:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175167488 00000100:00100000:3.0:1746144893.478826:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175167488 00010000:00010000:3.0:1746144893.478847:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a21 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.478866:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10915 00000100:00100000:3.0:1746144893.478871:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1982:x1830965175167488:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.478880:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.478895:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a21 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.478904:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a21 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.478921:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727514fbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a21 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.479112:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.479114:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.479121:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727514fc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a28 expref: 16 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.479128:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727514fc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a28 expref: 16 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.479154:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727514fc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a28 expref: 16 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.479164:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172445184:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.479701:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.482187:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.482273:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172445184:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.482290:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.482318:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175167744 00000100:00100000:3.0:1746144893.482324:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ed180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1982:x1830965175167488:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3451us (3693us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.482325:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175167744 00000100:00100000:3.0:1746144893.482333:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10915 00002000:00100000:2.0:1746144893.482362:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ee300 x1830965175167744/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.482370:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ee300 with x1830965175167744 ext(0->4095) 00002000:00010000:2.0:1746144893.482979:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ee300 00000100:00100000:2.0:1746144893.483296:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4044 00000100:00100000:2.0:1746144893.483306:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1983:x1830965175167744:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746144893.483454:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1983:x1830965175167744:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 150us (1273us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.483461:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4044 00002000:00100000:2.0:1746144893.483466:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ee300 x1830965175167744/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.483473:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ee300 with x1830965175167744 ext(0->4095) 00002000:00010000:2.0:1746144893.483476:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ee300 00000100:00100000:2.0:1746144893.486637:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.486717:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175167872 00000100:00100000:3.0:1746144893.486725:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175167872 00000100:00100000:3.0:1746144893.488033:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5500 00000100:00100000:3.0:1746144893.488044:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175167872:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.488061:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.488075:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a2f expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.488098:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727514fc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a28 expref: 15 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.488105:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.488107:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.488109:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a2f expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.488133:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727514fc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a28 expref: 15 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.488143:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727514fc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a28 expref: 15 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.488152:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172445312:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.488900:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.491445:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172445312:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.491627:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a2f expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.491648:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094376600, rc 0) 00000100:00100000:3.0:1746144893.491697:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175167872:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3655us (5067us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.491704:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5500 00000100:00100000:0.0:1746144893.492157:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.492219:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175168000 00000100:00100000:3.0:1746144893.492224:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175168000 00010000:00010000:3.0:1746144893.492246:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727514fc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a28 expref: 16 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.492263:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10916 00000100:00100000:3.0:1746144893.492268:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1985:x1830965175168000:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.492278:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.492299:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727514fc4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a28 expref: 16 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.492309:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727514fc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a28 expref: 16 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.492327:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727514fc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a28 expref: 16 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.492352:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.492353:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.492359:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a2f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.492488:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a2f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.492519:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a2f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.492530:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172445440:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.492705:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.493019:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.493089:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175168128 00000100:00100000:3.0:1746144893.493092:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175168128 00000100:00100000:3.0:1746144893.493111:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5501 00000100:00100000:3.0:1746144893.493116:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+16:31565:x1830965175168128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.493126:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.493134:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a36 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.493150:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a2f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.493155:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.493157:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.493159:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a36 expref: 17 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.493173:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a2f expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.493186:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a2f expref: 5 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.493193:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172445568:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.493240:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.495323:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172445440:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.495340:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.495371:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1985:x1830965175168000:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3102us (3215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.495381:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10916 00000100:00100000:3.0:1746144893.495475:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172445568:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.495493:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a36 expref: 16 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.495505:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377800, rc 0) 00000100:00100000:3.0:1746144893.495523:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+16:31565:x1830965175168128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2407us (2505us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.495529:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5501 00000100:00100000:0.0:1746144893.495701:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.496013:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175168384 00000100:00100000:2.0:1746144893.496018:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175168384 00002000:00100000:2.0:1746144893.496051:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918eea00 x1830965175168384/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.496058:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eea00 with x1830965175168384 ext(0->4095) 00010000:00010000:2.0:1746144893.496064:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a2f expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.496074:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a2f expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.496079:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918eea00 00000100:00100000:2.0:1746144893.496103:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2048 00000100:00100000:2.0:1746144893.496110:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175168384:12345-192.168.202.16@tcp:3:ldlm_bl.0 00000100:00100000:2.0:1746144893.496237:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175168384:12345-192.168.202.16@tcp:3:ldlm_bl.0 Request processed in 128us (536us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.496247:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2048 00002000:00100000:2.0:1746144893.496252:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918eea00 x1830965175168384/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.496258:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eea00 with x1830965175168384 ext(0->4095) 00010000:00010000:2.0:1746144893.496262:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a2f expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.496737:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a2f expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.496746:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918eea00 00000100:00100000:2.0:1746144893.499697:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.500231:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175168512 00000100:00100000:3.0:1746144893.500238:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175168512 00010000:00010000:3.0:1746144893.500269:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a2f expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.500302:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10917 00000100:00100000:3.0:1746144893.500309:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175168512:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.500322:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.500339:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a2f expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.500354:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a2f expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.500372:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727514fcb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a2f expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.500547:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.500549:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.500556:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a36 expref: 15 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.500563:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a36 expref: 15 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.500592:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a36 expref: 15 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.500604:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172445696:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.500840:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.503147:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.503365:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175168768 00000100:00100000:2.0:1746144893.503371:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175168768 00002000:00100000:2.0:1746144893.503408:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ec380 x1830965175168768/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.503418:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec380 with x1830965175168768 ext(0->4095) 00002000:00010000:2.0:1746144893.503422:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ec380 00000100:00100000:2.0:1746144893.503451:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4045 00000100:00100000:2.0:1746144893.503458:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1983:x1830965175168768:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:3.0:1746144893.503555:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172445696:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.503574:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.503608:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175168512:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3300us (3917us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.503616:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10917 00000100:00100000:2.0:1746144893.503841:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1983:x1830965175168768:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 383us (699us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.503848:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4045 00002000:00100000:2.0:1746144893.503853:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ec380 x1830965175168768/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.503860:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec380 with x1830965175168768 ext(0->4095) 00002000:00010000:2.0:1746144893.503863:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ec380 00000100:00100000:0.0:1746144893.507053:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.507208:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175168896 00000100:00100000:3.0:1746144893.507217:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175168896 00000100:00100000:3.0:1746144893.507249:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5502 00000100:00100000:3.0:1746144893.507255:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175168896:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.507269:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.507284:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514fd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a3d expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.507308:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a36 expref: 15 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.507315:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.507317:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.507320:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514fd9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a3d expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.507344:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a36 expref: 15 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.507354:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a36 expref: 15 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.507365:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172445824:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.507619:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.509350:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172445824:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.509374:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514fd9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a3d expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.509391:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094199a00, rc 0) 00000100:00100000:3.0:1746144893.509424:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099699450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175168896:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2168us (2376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.509431:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5502 00000100:00100000:0.0:1746144893.513320:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.513526:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175169024 00000100:00100000:2.0:1746144893.513533:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175169024 00002000:00100000:2.0:1746144893.513576:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800918eca80 x1830965175169024/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 496/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.513590:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eca80 with x1830965175169024 ext(0->7) 00010000:00010000:2.0:1746144893.513597:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a36 expref: 16 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.513610:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a36 expref: 16 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.513617:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918eca80 00000100:00100000:2.0:1746144893.513645:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2049 00000100:00100000:2.0:1746144893.513653:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1984:x1830965175169024:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144893.513988:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175169024:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 335us (675us total) trans 4294968015 rc 0/0 00000100:00100000:2.0:1746144893.513994:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2049 00002000:00100000:2.0:1746144893.513999:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800918eca80 x1830965175169024/t4294968015(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 496/448 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.514005:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eca80 with x1830965175169024 ext(0->7) 00010000:00010000:2.0:1746144893.514010:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a36 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.514019:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a36 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.514024:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918eca80 00000100:00100000:0.0:1746144893.518138:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.519032:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175169152 00000100:00100000:3.0:1746144893.519041:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175169152 00010000:00010000:3.0:1746144893.519074:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a36 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.519109:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10918 00000100:00100000:3.0:1746144893.519116:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1983:x1830965175169152:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.519127:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.519144:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a36 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.519154:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a36 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.519174:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af6727514fd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a36 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.519201:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.519203:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.519719:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514fd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a3d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.519732:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514fd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a3d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.520022:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514fd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a3d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.520035:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172445952:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.520110:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.521569:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172445952:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.521585:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.521614:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1983:x1830965175169152:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2498us (3483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.521622:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10918 00000100:00100000:0.0:1746144893.523744:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.524503:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175169408 00000100:00100000:2.0:1746144893.524511:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175169408 00002000:00100000:2.0:1746144893.524551:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ef100 x1830965175169408/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.524560:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ef100 with x1830965175169408 ext(0->4095) 00002000:00010000:2.0:1746144893.524564:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ef100 00000100:00100000:2.0:1746144893.524601:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4046 00000100:00100000:2.0:1746144893.524611:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175169408:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:0.0:1746144893.524915:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.525041:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175169408:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 433us (1301us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.525048:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4046 00002000:00100000:2.0:1746144893.525053:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ef100 x1830965175169408/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.525060:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ef100 with x1830965175169408 ext(0->4095) 00002000:00010000:2.0:1746144893.525063:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ef100 00000100:00100000:3.0:1746144893.525210:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175169536 00000100:00100000:3.0:1746144893.525214:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175169536 00000100:00100000:3.0:1746144893.525275:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5503 00000100:00100000:3.0:1746144893.525281:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+17:31565:x1830965175169536:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.525290:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.525304:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a44 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.525324:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514fd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a3d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.525329:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.525332:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.525334:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a44 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.525357:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514fd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a3d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.525643:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514fd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a3d expref: 5 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.525653:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172446080:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.525716:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.527027:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172446080:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144893.527027:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.527199:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175169664 00000100:00100000:1.0:1746144893.527203:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175169664 00000100:00100000:1.0:1746144893.527240:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5504 00000100:00100000:1.0:1746144893.527246:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31579:x1830965175169664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.527258:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.527269:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514fe7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a4b expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.527287:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.527291:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a44 expref: 20 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.527296:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.527299:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514fe7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a4b expref: 20 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.527320:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a44 expref: 20 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.527330:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514fe7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a4b expref: 20 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.527344:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939c00, rc 0) 00010000:00010000:3.0:1746144893.527366:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a44 expref: 20 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144893.527370:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31579:x1830965175169664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 124us (343us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144893.527374:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f2b3c00, rc 0) 00000100:00100000:1.0:1746144893.527375:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5504 00000100:00100000:3.0:1746144893.527387:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31565:x1830965175169536:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2107us (2472us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.527391:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5503 00000100:00100000:0.0:1746144893.527413:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.527433:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175169792 00000100:00100000:3.0:1746144893.527436:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175169792 00010000:00010000:3.0:1746144893.527449:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514fd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a3d expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.527476:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10919 00000100:00100000:3.0:1746144893.527481:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175169792:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.527491:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.527507:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514fd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a3d expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.527517:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514fd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a3d expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.527531:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094199a00/0x4076af6727514fd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a3d expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.527543:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.527544:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.527549:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a44 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.527556:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a44 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.527574:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a44 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.527582:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a44 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.527590:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172446336:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.527620:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.528358:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172446336:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.528366:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.528382:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175169792:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 901us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.528387:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10919 00000100:00100000:0.0:1746144893.528659:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.528801:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175170048 00000100:00100000:2.0:1746144893.528806:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175170048 00002000:00100000:2.0:1746144893.528833:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ed500 x1830965175170048/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.528842:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ed500 with x1830965175170048 ext(0->4095) 00010000:00010000:2.0:1746144893.528848:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a44 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.528858:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a44 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.528869:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ed500 00000100:00100000:2.0:1746144893.528889:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2050 00000100:00100000:2.0:1746144893.528895:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175170048:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144893.529039:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175170048:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 143us (379us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.529045:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2050 00002000:00100000:2.0:1746144893.529050:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ed500 x1830965175170048/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.529057:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ed500 with x1830965175170048 ext(0->4095) 00010000:00010000:2.0:1746144893.529062:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a44 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.529070:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a44 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.529075:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ed500 00000100:00100000:0.0:1746144893.531286:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.531597:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175170176 00000100:00100000:3.0:1746144893.531603:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175170176 00010000:00010000:3.0:1746144893.531626:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a44 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.531660:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10920 00000100:00100000:3.0:1746144893.531667:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175170176:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.531676:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.531692:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a44 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.531701:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a44 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.531717:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f2b3c00/0x4076af6727514fe0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a44 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.531934:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.531937:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.531954:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514fe7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a4b expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.531963:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514fe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a4b expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.531991:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514fe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a4b expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.532002:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172446464:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.532104:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.534459:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.534461:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172446464:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.534570:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.534602:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175170176:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2935us (3321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.534610:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10920 00000100:00100000:2.0:1746144893.534621:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175170432 00000100:00100000:2.0:1746144893.534626:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175170432 00002000:00100000:2.0:1746144893.534663:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ef480 x1830965175170432/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.534672:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ef480 with x1830965175170432 ext(0->4095) 00002000:00010000:2.0:1746144893.534675:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ef480 00000100:00100000:2.0:1746144893.534704:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4047 00000100:00100000:2.0:1746144893.534711:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175170432:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.535034:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175170432:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 323us (580us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.535041:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4047 00002000:00100000:2.0:1746144893.535046:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ef480 x1830965175170432/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.535052:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ef480 with x1830965175170432 ext(0->4095) 00002000:00010000:2.0:1746144893.535055:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ef480 00000100:00100000:0.0:1746144893.536826:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.537014:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175170560 00000100:00100000:3.0:1746144893.537020:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175170560 00000100:00100000:3.0:1746144893.537062:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5505 00000100:00100000:3.0:1746144893.537068:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175170560:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.537080:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.537095:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514fee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a52 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.537116:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514fe7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a4b expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.537122:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.537123:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.537126:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514fee lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a52 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.537152:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514fe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a4b expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.537161:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514fe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a4b expref: 17 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.537171:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172446592:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.537251:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.538373:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172446592:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.538392:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514fee lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a52 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.538403:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:3.0:1746144893.538426:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175170560:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1359us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.538432:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5505 00000100:00100000:0.0:1746144893.539022:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.540301:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175170688 00000100:00100000:3.0:1746144893.540308:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175170688 00010000:00010000:3.0:1746144893.540337:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514fe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a4b expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.540377:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10921 00000100:00100000:3.0:1746144893.540384:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175170688:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.540395:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.540414:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514fe7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a4b expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.540426:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514fe7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a4b expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.540445:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af6727514fe7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a4b expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.540474:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.540476:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.540483:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514fee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a52 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.540489:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514fee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a52 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.540516:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514fee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a52 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.540526:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172446720:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.540599:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.543356:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172446720:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.543376:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.543429:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1985:x1830965175170688:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3045us (4406us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.543438:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10921 00000100:00100000:0.0:1746144893.543643:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.543699:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175170944 00000100:00100000:2.0:1746144893.543706:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175170944 00002000:00100000:2.0:1746144893.543746:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ed180 x1830965175170944/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.543755:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ed180 with x1830965175170944 ext(0->4095) 00002000:00010000:2.0:1746144893.543759:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ed180 00000100:00100000:2.0:1746144893.543814:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4048 00000100:00100000:2.0:1746144893.543820:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175170944:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144893.543968:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175170944:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 120us (298us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.543973:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4048 00002000:00100000:2.0:1746144893.543978:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ed180 x1830965175170944/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.543985:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ed180 with x1830965175170944 ext(0->4095) 00002000:00010000:2.0:1746144893.543988:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ed180 00000100:00100000:0.0:1746144893.546056:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.546158:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175171072 00000100:00100000:3.0:1746144893.546167:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175171072 00000100:00100000:3.0:1746144893.546213:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5506 00000100:00100000:3.0:1746144893.546220:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+17:31565:x1830965175171072:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.546236:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.546252:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a59 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.546276:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514fee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a52 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.546283:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.546285:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.546288:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a59 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.546315:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514fee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a52 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.546325:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514fee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a52 expref: 5 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.546336:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172446848:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.546419:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.547575:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.547610:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175171200 00000100:00100000:1.0:1746144893.547616:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175171200 00000100:00100000:1.0:1746144893.547649:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5507 00000100:00100000:1.0:1746144893.547655:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31579:x1830965175171200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.547666:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.547680:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727514ffc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a60 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.547700:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.547707:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a59 expref: 20 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.547712:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.547715:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727514ffc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a60 expref: 20 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.547741:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a59 expref: 20 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.547749:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727514ffc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a60 expref: 20 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.547785:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939800, rc 0) 00000100:00100000:1.0:1746144893.547810:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31579:x1830965175171200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 155us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.547815:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5507 00000100:00100000:3.0:1746144893.549151:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172446848:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.549171:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a59 expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.549187:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:3.0:1746144893.549254:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31565:x1830965175171072:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3033us (3205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.549260:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5506 00000100:00100000:0.0:1746144893.550372:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.550489:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175171328 00000100:00100000:3.0:1746144893.550495:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175171328 00010000:00010000:3.0:1746144893.550517:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514fee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a52 expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.550708:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10922 00000100:00100000:3.0:1746144893.550715:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175171328:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.550725:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.550742:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514fee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a52 expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.550751:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514fee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a52 expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.550795:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727514fee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a52 expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.550907:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.550909:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.550915:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a59 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.550927:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a59 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.550962:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a59 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.550971:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a59 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.550981:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172447104:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.551028:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.552935:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.553094:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175171584 00000100:00100000:1.0:1746144893.553099:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175171584 00002000:00100000:1.0:1746144893.553128:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bae1880 x1830965175171584/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.553135:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae1880 with x1830965175171584 ext(0->4095) 00010000:00010000:1.0:1746144893.553141:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a59 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.553151:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a59 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.553156:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bae1880 00000100:00100000:3.0:1746144893.553229:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172447104:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.553242:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.553270:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175171328:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2555us (2901us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.553277:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10922 00000100:00100000:1.0:1746144893.553373:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2051 00000100:00100000:1.0:1746144893.553379:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175171584:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144893.553494:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175171584:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 116us (564us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.553498:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2051 00002000:00100000:1.0:1746144893.553502:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bae1880 x1830965175171584/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.553514:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae1880 with x1830965175171584 ext(0->4095) 00010000:00010000:1.0:1746144893.553518:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a59 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.553526:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a59 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:1.0:1746144893.553530:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bae1880 00000100:00100000:0.0:1746144893.555927:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.556013:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175171712 00000100:00100000:3.0:1746144893.556019:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175171712 00010000:00010000:3.0:1746144893.556044:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a59 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.556469:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10923 00000100:00100000:3.0:1746144893.556477:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a513a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175171712:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.556488:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.556506:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a59 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.556517:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a59 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.556534:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c600/0x4076af6727514ff5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a59 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.556563:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.556565:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.556571:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727514ffc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a60 expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.556578:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727514ffc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a60 expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.556604:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727514ffc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a60 expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.556615:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172447232:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.556692:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7d480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.558789:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.558923:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175171968 00000100:00100000:2.0:1746144893.558930:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175171968 00002000:00100000:2.0:1746144893.558980:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bae2300 x1830965175171968/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.558990:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae2300 with x1830965175171968 ext(0->4095) 00002000:00010000:2.0:1746144893.558993:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae2300 00000100:00100000:2.0:1746144893.559024:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4049 00000100:00100000:2.0:1746144893.559031:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175171968:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144893.559115:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172447232:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.559130:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.559159:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a513a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175171712:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2684us (3238us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.559166:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10923 00000100:00100000:2.0:1746144893.559498:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175171968:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 467us (739us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.559504:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4049 00002000:00100000:2.0:1746144893.559509:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bae2300 x1830965175171968/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.559516:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae2300 with x1830965175171968 ext(0->4095) 00002000:00010000:2.0:1746144893.559519:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae2300 00000100:00100000:0.0:1746144893.561853:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.561935:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175172096 00000100:00100000:3.0:1746144893.561953:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175172096 00000100:00100000:3.0:1746144893.561995:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5508 00000100:00100000:3.0:1746144893.562002:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175172096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.562016:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.562029:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727515003 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a67 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.562053:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727514ffc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a60 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.562059:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.562061:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.562064:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727515003 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a67 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.562089:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727514ffc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a60 expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.562100:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727514ffc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a60 expref: 17 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.562111:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172447360:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.562297:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.564459:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172447360:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.564482:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727515003 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a67 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.564500:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5dc00, rc 0) 00000100:00100000:3.0:1746144893.564544:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175172096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2542us (2696us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.564552:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5508 00000100:00100000:0.0:1746144893.565251:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.565634:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175172224 00000100:00100000:3.0:1746144893.565639:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175172224 00010000:00010000:3.0:1746144893.565662:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727514ffc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a60 expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.566012:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10924 00000100:00100000:2.0:1746144893.566023:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175172224:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.566034:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.566050:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727514ffc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a60 expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.566060:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727514ffc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a60 expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.566082:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727514ffc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a60 expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.566109:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.566111:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.566117:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727515003 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a67 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.566125:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727515003 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a67 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.566150:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727515003 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a67 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.566160:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172447488:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.566220:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093abacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.568826:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.568951:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172447488:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.568968:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.569099:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175172480 00000100:00100000:3.0:1746144893.569104:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175172480 00002000:00100000:3.0:1746144893.569484:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bae1c00 x1830965175172480/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.569492:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae1c00 with x1830965175172480 ext(0->4095) 00002000:00010000:3.0:1746144893.569496:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae1c00 00000100:00100000:2.0:1746144893.569603:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1984:x1830965175172224:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3583us (4353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.569610:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10924 00000100:00100000:3.0:1746144893.569900:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4050 00000100:00100000:3.0:1746144893.569907:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175172480:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144893.570749:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.570774:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175172480:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 853us (1940us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144893.570782:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4050 00002000:00100000:0.0:1746144893.570788:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bae1c00 x1830965175172480/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144893.570795:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae1c00 with x1830965175172480 ext(0->4095) 00002000:00010000:0.0:1746144893.570799:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae1c00 00000100:00100000:3.0:1746144893.570817:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175172608 00000100:00100000:3.0:1746144893.570821:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175172608 00000100:00100000:3.0:1746144893.570900:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5509 00000100:00100000:3.0:1746144893.570905:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+17:31565:x1830965175172608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.570914:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.570926:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a6e expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.570962:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727515003 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a67 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.570969:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.570970:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.570974:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a6e expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.570995:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727515003 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a67 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.571003:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727515003 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a67 expref: 5 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.571012:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172447616:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.571070:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.575818:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172447616:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.575843:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a6e expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.575856:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:3.0:1746144893.576952:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175172608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6033us (6191us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.576961:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5509 00000100:00100000:0.0:1746144893.578559:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.578600:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.579088:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175172736 00000100:00100000:3.0:1746144893.579096:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175172736 00000100:00100000:2.0:1746144893.579784:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175172864 00000100:00100000:2.0:1746144893.579788:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175172864 00010000:00010000:2.0:1746144893.579815:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727515003 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a67 expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.579841:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10925 00000100:00100000:2.0:1746144893.579848:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175172864:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.579859:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.579876:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727515003 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a67 expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.579887:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727515003 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a67 expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.579905:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5dc00/0x4076af6727515003 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a67 expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.579930:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.579932:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.579938:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a6e expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.579954:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a6e expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.579981:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a6e expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.579991:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172447744:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.580052:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093abacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.580104:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5510 00000100:00100000:3.0:1746144893.580111:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31579:x1830965175172736:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.580121:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.580130:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727515011 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a75 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.580145:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a6e expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.580149:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.580151:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.580153:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727515011 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a75 expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.580168:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a6e expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.580175:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a6e expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.580183:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172447872:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.580202:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.584216:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172447744:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.584236:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.584271:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175172864:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4423us (5669us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.584280:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10925 00000100:00100000:3.0:1746144893.584630:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172447872:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.584647:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727515011 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a75 expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.584665:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094198000, rc 0) 00000100:00100000:3.0:1746144893.584684:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31579:x1830965175172736:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4574us (6129us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.584690:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5510 00000100:00100000:0.0:1746144893.586479:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.586551:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175173120 00000100:00100000:2.0:1746144893.586558:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175173120 00002000:00100000:2.0:1746144893.586592:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bae0000 x1830965175173120/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.586600:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae0000 with x1830965175173120 ext(0->4095) 00010000:00010000:2.0:1746144893.586607:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a6e expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.586617:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a6e expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.586622:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bae0000 00000100:00100000:2.0:1746144893.586646:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2052 00000100:00100000:2.0:1746144893.586653:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175173120:12345-192.168.202.16@tcp:3:ldlm_bl.0 00000100:00100000:2.0:1746144893.586892:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175173120:12345-192.168.202.16@tcp:3:ldlm_bl.0 Request processed in 238us (416us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.586898:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2052 00002000:00100000:2.0:1746144893.586903:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bae0000 x1830965175173120/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.586909:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae0000 with x1830965175173120 ext(0->4095) 00010000:00010000:2.0:1746144893.586914:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a6e expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.586922:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a6e expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.586927:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bae0000 00000100:00100000:0.0:1746144893.589298:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.589555:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175173248 00000100:00100000:2.0:1746144893.589562:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175173248 00010000:00010000:2.0:1746144893.589595:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a6e expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.589629:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10926 00000100:00100000:2.0:1746144893.589637:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1982:x1830965175173248:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.589647:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.589665:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a6e expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.589675:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a6e expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.589693:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af672751500a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a6e expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.589722:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.589725:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.589731:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727515011 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a75 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.589741:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727515011 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a75 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.589796:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727515011 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a75 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.589807:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172448000:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.589972:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.592609:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172448000:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.592629:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.592663:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1982:x1830965175173248:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3026us (3371us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.592673:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10926 00000100:00100000:0.0:1746144893.592873:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.592988:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175173504 00000100:00100000:3.0:1746144893.592994:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175173504 00002000:00100000:3.0:1746144893.593023:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924d8700 x1830965175173504/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.593031:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d8700 with x1830965175173504 ext(0->4095) 00002000:00010000:3.0:1746144893.593034:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d8700 00000100:00100000:3.0:1746144893.593059:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4051 00000100:00100000:3.0:1746144893.593065:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175173504:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144893.593462:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175173504:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 396us (588us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.593467:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4051 00002000:00100000:3.0:1746144893.593472:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924d8700 x1830965175173504/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.593478:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d8700 with x1830965175173504 ext(0->4095) 00002000:00010000:3.0:1746144893.593481:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d8700 00000100:00100000:0.0:1746144893.596537:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.596613:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175173632 00000100:00100000:3.0:1746144893.596619:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175173632 00000100:00100000:3.0:1746144893.596659:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5511 00000100:00100000:3.0:1746144893.596666:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175173632:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.596679:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.596693:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a7c expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.596715:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727515011 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a75 expref: 17 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.596721:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.596723:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.596725:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a7c expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.596747:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727515011 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a75 expref: 17 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.596756:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727515011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a75 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.596860:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172448128:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.597073:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.599328:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172448128:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.599352:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a7c expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.599366:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5d600, rc 0) 00000100:00100000:3.0:1746144893.599398:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175173632:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2732us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.599409:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5511 00000100:00100000:0.0:1746144893.600069:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.600409:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175173760 00000100:00100000:3.0:1746144893.600415:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175173760 00010000:00010000:3.0:1746144893.600434:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727515011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a75 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.600459:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10927 00000100:00100000:3.0:1746144893.600463:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175173760:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.600472:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.600487:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727515011 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a75 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.600495:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727515011 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a75 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.600511:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094198000/0x4076af6727515011 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a75 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.600529:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.600531:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.600536:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a7c expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.600543:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a7c expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.600564:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a7c expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.600573:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172448256:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.601555:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.604457:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.604487:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.604562:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175174144 00000100:00100000:1.0:1746144893.604569:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175174144 00000100:00100000:1.0:1746144893.604604:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5512 00000100:00100000:1.0:1746144893.604611:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175174144:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.604625:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.604637:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a83 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.604662:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a7c expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.604668:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.604670:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.604673:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a83 expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.604696:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a7c expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.604710:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a7c expref: 5 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:1.0:1746144893.604721:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172448384:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.604806:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746144893.604834:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172448256:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.604848:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.605347:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175173760:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4881us (5276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.605355:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10927 00000100:00100000:3.0:1746144893.605380:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175174016 00000100:00100000:3.0:1746144893.605383:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175174016 00002000:00100000:3.0:1746144893.605401:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924db800 x1830965175174016/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.605408:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924db800 with x1830965175174016 ext(0->4095) 00010000:00010000:3.0:1746144893.605413:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a7c expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.605421:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a7c expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.605427:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924db800 00000100:00100000:3.0:1746144893.605438:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2053 00000100:00100000:3.0:1746144893.605443:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175174016:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144893.605563:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175174016:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 119us (1114us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.605572:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2053 00002000:00100000:3.0:1746144893.605577:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924db800 x1830965175174016/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.605584:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924db800 with x1830965175174016 ext(0->4095) 00010000:00010000:3.0:1746144893.605588:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a7c expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.605596:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a7c expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.605602:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924db800 00000100:00100000:1.0:1746144893.605681:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.608656:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.608863:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172448384:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144893.608885:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a83 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.608897:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939c00, rc 0) 00000100:00100000:1.0:1746144893.608931:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175174144:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4321us (4444us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.608938:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5512 00000100:00100000:1.0:1746144893.609562:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175174272 00000100:00100000:1.0:1746144893.609567:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175174272 00000100:00100000:1.0:1746144893.609599:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5513 00000100:00100000:1.0:1746144893.609604:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31579:x1830965175174272:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.609615:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.609627:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515026 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a8a expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.609644:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.609648:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a83 expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.609657:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.609660:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515026 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a8a expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.609682:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a83 expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.609689:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515026 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a8a expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.609696:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939800, rc 0) 00000100:00100000:1.0:1746144893.609714:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31579:x1830965175174272:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 110us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.609718:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5513 00000100:00100000:0.0:1746144893.611677:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.611880:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175174400 00000100:00100000:3.0:1746144893.611886:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175174400 00010000:00010000:3.0:1746144893.611912:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a7c expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.611934:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10928 00000100:00100000:3.0:1746144893.611951:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175174400:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.611963:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.611982:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a7c expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.611991:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a7c expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.612008:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727515018 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a7c expref: 6 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.612024:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.612026:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.612031:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a83 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.612038:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a83 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.612065:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a83 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.612075:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a83 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.612085:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172448640:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.612910:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.616430:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172448640:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.616451:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.616491:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175174400:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4550us (4819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.616501:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10928 00000100:00100000:0.0:1746144893.617193:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.617565:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175174656 00000100:00100000:2.0:1746144893.617572:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175174656 00002000:00100000:2.0:1746144893.617609:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924d9c00 x1830965175174656/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.617617:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d9c00 with x1830965175174656 ext(0->4095) 00010000:00010000:2.0:1746144893.617624:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a83 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.617634:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a83 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.617639:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924d9c00 00000100:00100000:2.0:1746144893.617665:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2054 00000100:00100000:2.0:1746144893.617672:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175174656:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144893.617827:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175174656:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 156us (635us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.617833:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2054 00002000:00100000:2.0:1746144893.617837:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924d9c00 x1830965175174656/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.617844:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d9c00 with x1830965175174656 ext(0->4095) 00010000:00010000:2.0:1746144893.617848:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a83 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.617856:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a83 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.617861:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924d9c00 00000100:00100000:0.0:1746144893.621247:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.621427:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175174784 00000100:00100000:3.0:1746144893.621435:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175174784 00010000:00010000:3.0:1746144893.621466:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a83 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.621495:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10929 00000100:00100000:3.0:1746144893.621502:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175174784:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.621513:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.621531:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a83 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.621540:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a83 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.621560:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af672751501f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a83 expref: 19 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.621996:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.621998:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.622004:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515026 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a8a expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.622012:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515026 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a8a expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.622039:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515026 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a8a expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.622049:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172448768:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.622120:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.625335:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172448768:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.625353:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.625385:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175174784:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3883us (4144us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.625393:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10929 00000100:00100000:0.0:1746144893.625607:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.625932:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175175040 00000100:00100000:3.0:1746144893.625936:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175175040 00002000:00100000:3.0:1746144893.625975:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924dad80 x1830965175175040/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.625983:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924dad80 with x1830965175175040 ext(0->4095) 00002000:00010000:3.0:1746144893.625987:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924dad80 00000100:00100000:3.0:1746144893.626303:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4052 00000100:00100000:3.0:1746144893.626310:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175175040:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144893.626445:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175175040:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 135us (838us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.626451:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4052 00002000:00100000:3.0:1746144893.626456:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924dad80 x1830965175175040/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.626462:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924dad80 with x1830965175175040 ext(0->4095) 00002000:00010000:3.0:1746144893.626464:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924dad80 00000100:00100000:0.0:1746144893.629334:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.629434:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175175168 00000100:00100000:2.0:1746144893.629442:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175175168 00000100:00100000:2.0:1746144893.629490:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5514 00000100:00100000:2.0:1746144893.629497:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175175168:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.629510:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.629524:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a91 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.629547:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515026 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a8a expref: 17 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.629557:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.629558:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.629561:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a91 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.629584:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515026 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a8a expref: 17 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.629594:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515026 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a8a expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.629604:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172448896:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.630179:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.634781:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.635194:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172448896:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.635221:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a91 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.635235:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1ae00, rc 0) 00000100:00100000:2.0:1746144893.635273:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175175168:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5776us (5944us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.635280:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5514 00000100:00100000:3.0:1746144893.635358:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175175296 00000100:00100000:3.0:1746144893.635364:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175175296 00010000:00010000:3.0:1746144893.635385:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515026 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a8a expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.635418:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10930 00000100:00100000:3.0:1746144893.635423:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5139c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175175296:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.635434:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.635451:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515026 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a8a expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.635461:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515026 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a8a expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.635479:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515026 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a8a expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.635492:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.635494:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.635500:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a91 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.635507:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a91 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.635534:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a91 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.635545:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172449024:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.635594:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.638740:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.639013:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175175424 00000100:00100000:2.0:1746144893.639020:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175175424 00000100:00100000:2.0:1746144893.639150:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5515 00000100:00100000:2.0:1746144893.639157:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175175424:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.639174:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.639187:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a98 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.639209:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a91 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.639215:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.639216:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.639219:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a98 expref: 19 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.639241:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a91 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.639250:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a91 expref: 5 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.639259:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172449152:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.639322:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.639452:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.639613:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175175680 00000100:00100000:3.0:1746144893.639617:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175175680 00002000:00100000:3.0:1746144893.639637:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013619aa00 x1830965175175680/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.639645:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013619aa00 with x1830965175175680 ext(0->4095) 00010000:00010000:3.0:1746144893.639649:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a91 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.639657:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a91 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.639662:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013619aa00 00000100:00100000:3.0:1746144893.639672:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2055 00000100:00100000:3.0:1746144893.639676:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013619aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175175680:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144893.639811:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013619aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175175680:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 133us (358us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.639816:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2055 00002000:00100000:3.0:1746144893.639821:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013619aa00 x1830965175175680/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.639827:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013619aa00 with x1830965175175680 ext(0->4095) 00010000:00010000:3.0:1746144893.639831:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a91 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.639839:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a91 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.639848:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013619aa00 00000100:00100000:2.0:1746144893.640391:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172449024:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.640403:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.640882:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5139c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175175296:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5456us (6106us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.640889:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10930 00000100:00100000:2.0:1746144893.643740:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172449152:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.643795:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a98 expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.643810:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b600, rc 0) 00000100:00100000:2.0:1746144893.644602:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175175424:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5444us (5866us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.644609:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5515 00000100:00100000:0.0:1746144893.645051:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.645172:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175175808 00000100:00100000:2.0:1746144893.645178:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175175808 00000100:00100000:2.0:1746144893.645216:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5516 00000100:00100000:2.0:1746144893.645222:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013619b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31579:x1830965175175808:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.645235:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.645247:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751503b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94a9f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.645263:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.645267:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a98 expref: 19 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.645272:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.645275:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751503b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a9f expref: 19 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.645298:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a98 expref: 19 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.645307:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751503b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a9f expref: 19 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.645318:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1aa00, rc 0) 00000100:00100000:2.0:1746144893.645338:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013619b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31579:x1830965175175808:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 117us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.645343:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5516 00000100:00100000:0.0:1746144893.646748:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.646924:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175175936 00000100:00100000:2.0:1746144893.646929:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175175936 00010000:00010000:2.0:1746144893.646979:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a91 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.647002:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10931 00000100:00100000:2.0:1746144893.647008:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175175936:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.647018:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.647034:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a91 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.647043:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a91 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.647058:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751502d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a91 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.647073:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.647075:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.647080:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a98 expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.647091:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a98 expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.647112:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a98 expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.647121:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a98 expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.647131:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172449408:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.647193:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.649990:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172449408:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.650010:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.650044:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175175936:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3036us (3299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.650053:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10931 00000100:00100000:0.0:1746144893.651275:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.651426:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175176192 00000100:00100000:2.0:1746144893.651432:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175176192 00002000:00100000:2.0:1746144893.651465:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea9500 x1830965175176192/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.651473:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea9500 with x1830965175176192 ext(0->4095) 00010000:00010000:2.0:1746144893.651480:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a98 expref: 19 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.651491:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a98 expref: 19 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.651497:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea9500 00000100:00100000:2.0:1746144893.651554:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2056 00000100:00100000:2.0:1746144893.651560:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175176192:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.651686:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175176192:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 126us (415us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.651691:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2056 00002000:00100000:2.0:1746144893.651695:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea9500 x1830965175176192/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.651702:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea9500 with x1830965175176192 ext(0->4095) 00010000:00010000:2.0:1746144893.651706:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a98 expref: 19 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.651713:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a98 expref: 19 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.651718:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea9500 00000100:00100000:0.0:1746144893.654050:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.654239:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175176320 00000100:00100000:2.0:1746144893.654246:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175176320 00010000:00010000:2.0:1746144893.654276:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a98 expref: 19 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.654308:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10932 00000100:00100000:2.0:1746144893.654314:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1983:x1830965175176320:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.654323:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.654341:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a98 expref: 19 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.654350:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a98 expref: 19 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.654367:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515034 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a98 expref: 19 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.654388:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.654390:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.654395:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751503b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a9f expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.654401:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751503b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a9f expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.654426:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751503b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a9f expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.654436:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172449536:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.654499:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.657475:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172449536:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.657497:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.657532:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1983:x1830965175176320:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3218us (3488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.657540:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10932 00000100:00100000:0.0:1746144893.657855:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.657977:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175176576 00000100:00100000:3.0:1746144893.657983:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175176576 00002000:00100000:3.0:1746144893.658017:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167d500 x1830965175176576/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.658024:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167d500 with x1830965175176576 ext(0->4095) 00002000:00010000:3.0:1746144893.658029:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167d500 00000100:00100000:3.0:1746144893.658041:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4053 00000100:00100000:3.0:1746144893.658047:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175176576:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144893.658186:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175176576:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 138us (331us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.658192:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4053 00002000:00100000:3.0:1746144893.658196:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167d500 x1830965175176576/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.658203:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167d500 with x1830965175176576 ext(0->4095) 00002000:00010000:3.0:1746144893.658206:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167d500 00000100:00100000:0.0:1746144893.661445:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.661528:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175176704 00000100:00100000:3.0:1746144893.661535:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175176704 00000100:00100000:3.0:1746144893.661573:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5517 00000100:00100000:3.0:1746144893.661580:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175176704:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.661592:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.661606:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cec5600/0x4076af6727515042 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94aa6 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.661630:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751503b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a9f expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.661637:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.661638:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.661641:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cec5600/0x4076af6727515042 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aa6 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.661664:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751503b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a9f expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.661674:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751503b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a9f expref: 17 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.661685:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172449664:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.662145:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.664685:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172449664:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.664709:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cec5600/0x4076af6727515042 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aa6 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.664723:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cec5600, rc 0) 00000100:00100000:3.0:1746144893.664756:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175176704:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3177us (3317us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.664784:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5517 00000100:00100000:0.0:1746144893.665316:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.665433:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175176832 00000100:00100000:2.0:1746144893.665439:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175176832 00010000:00010000:2.0:1746144893.665465:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751503b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a9f expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.665498:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10933 00000100:00100000:2.0:1746144893.665505:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175176832:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.665516:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.665535:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751503b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a9f expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.665544:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751503b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a9f expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.665562:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751503b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94a9f expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.665586:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.665588:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.665594:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cec5600/0x4076af6727515042 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aa6 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.665601:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cec5600/0x4076af6727515042 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aa6 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.665627:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cec5600/0x4076af6727515042 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aa6 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.665640:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172449792:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.665688:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.668708:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.668749:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.668894:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175177216 00000100:00100000:2.0:1746144893.668901:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175177216 00002000:00100000:2.0:1746144893.668950:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e80e00 x1830965175177216/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.668959:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e80e00 with x1830965175177216 ext(0->4095) 00002000:00010000:2.0:1746144893.668964:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e80e00 00000100:00100000:2.0:1746144893.668981:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4054 00000100:00100000:2.0:1746144893.668987:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175177216:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.669119:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175177216:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 132us (368us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.669124:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4054 00002000:00100000:2.0:1746144893.669130:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e80e00 x1830965175177216/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.669136:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e80e00 with x1830965175177216 ext(0->4095) 00002000:00010000:2.0:1746144893.669139:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e80e00 00000100:00100000:2.0:1746144893.669172:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172449792:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.669186:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.669248:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175176960 00000100:00100000:3.0:1746144893.669252:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175176960 00000100:00100000:3.0:1746144893.669273:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5518 00000100:00100000:3.0:1746144893.669278:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175176960:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.669286:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.669297:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94aad expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.669318:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cec5600/0x4076af6727515042 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aa6 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.669324:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.669326:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.669329:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aad expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.669351:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cec5600/0x4076af6727515042 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aa6 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.669361:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cec5600/0x4076af6727515042 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aa6 expref: 5 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.669371:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172449920:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.670167:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175176832:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4661us (4850us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.670174:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10933 00000100:00100000:3.0:1746144893.670241:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.673306:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172449920:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.673332:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aad expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.673352:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:3.0:1746144893.673535:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175176960:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4254us (4831us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.673543:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5518 00000100:00100000:0.0:1746144893.673687:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.674186:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175177344 00000100:00100000:3.0:1746144893.674192:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175177344 00000100:00100000:3.0:1746144893.674260:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5519 00000100:00100000:3.0:1746144893.674267:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31579:x1830965175177344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.674504:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.674519:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515050 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ab4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.674538:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.674542:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aad expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.674548:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.674550:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515050 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ab4 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.674574:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aad expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.674583:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515050 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ab4 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.674594:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:3.0:1746144893.674629:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31579:x1830965175177344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 362us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.674634:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5519 00000100:00100000:0.0:1746144893.676537:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.677265:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175177472 00000100:00100000:2.0:1746144893.677273:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175177472 00010000:00010000:2.0:1746144893.677304:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cec5600/0x4076af6727515042 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aa6 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.677402:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10934 00000100:00100000:2.0:1746144893.677410:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175177472:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.677420:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.677438:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cec5600/0x4076af6727515042 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aa6 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.677449:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cec5600/0x4076af6727515042 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aa6 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.677466:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cec5600/0x4076af6727515042 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aa6 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.677622:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.677624:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.677631:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aad expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.677638:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aad expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.677665:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aad expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.677681:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aad expref: 18 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.677691:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172450176:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.678242:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.682809:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172450176:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.682832:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.682874:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175177472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5464us (6343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.682884:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10934 00000100:00100000:0.0:1746144893.683417:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.684060:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175177728 00000100:00100000:3.0:1746144893.684067:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175177728 00002000:00100000:3.0:1746144893.684098:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e83100 x1830965175177728/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.684107:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83100 with x1830965175177728 ext(0->4095) 00010000:00010000:3.0:1746144893.684114:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aad expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.684126:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aad expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.684132:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e83100 00000100:00100000:3.0:1746144893.684158:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2057 00000100:00100000:3.0:1746144893.684164:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175177728:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144893.684302:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175177728:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 138us (885us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.684308:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2057 00002000:00100000:3.0:1746144893.684313:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e83100 x1830965175177728/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.684326:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83100 with x1830965175177728 ext(0->4095) 00010000:00010000:3.0:1746144893.684330:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aad expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.684339:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aad expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.684344:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e83100 00000100:00100000:0.0:1746144893.687112:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.687292:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175177856 00000100:00100000:2.0:1746144893.687299:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175177856 00010000:00010000:2.0:1746144893.687329:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aad expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.687362:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10935 00000100:00100000:2.0:1746144893.687369:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1983:x1830965175177856:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.687381:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.687400:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aad expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.687410:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aad expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.687427:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515049 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aad expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.687454:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.687456:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.687462:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515050 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ab4 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.687469:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515050 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ab4 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.687495:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515050 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ab4 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.687505:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172450304:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.687565:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.690278:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.690350:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175178112 00000100:00100000:3.0:1746144893.690357:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175178112 00002000:00100000:3.0:1746144893.690388:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230c380 x1830965175178112/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.690396:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230c380 with x1830965175178112 ext(0->4095) 00002000:00010000:3.0:1746144893.690400:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230c380 00000100:00100000:3.0:1746144893.690638:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4055 00000100:00100000:3.0:1746144893.690645:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175178112:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144893.690872:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172450304:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.690888:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.690907:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1983:x1830965175177856:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3539us (3802us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.690913:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10935 00000100:00100000:3.0:1746144893.691501:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175178112:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 854us (1226us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.691507:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4055 00002000:00100000:3.0:1746144893.691512:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230c380 x1830965175178112/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.691519:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230c380 with x1830965175178112 ext(0->4095) 00002000:00010000:3.0:1746144893.691522:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230c380 00000100:00100000:0.0:1746144893.694118:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.694187:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175178240 00000100:00100000:3.0:1746144893.694193:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175178240 00000100:00100000:3.0:1746144893.694230:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5520 00000100:00100000:3.0:1746144893.694235:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175178240:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.694248:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.694261:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515057 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94abb expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.694281:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515050 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ab4 expref: 17 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.694287:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.694289:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.694291:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515057 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94abb expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.694313:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515050 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ab4 expref: 17 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.694322:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515050 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ab4 expref: 17 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.694332:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172450432:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.694398:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.696708:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172450432:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.696731:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515057 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94abb expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.696748:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:3.0:1746144893.696819:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175178240:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2583us (2705us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.696826:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5520 00000100:00100000:0.0:1746144893.697384:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.697460:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175178368 00000100:00100000:2.0:1746144893.697465:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175178368 00010000:00010000:2.0:1746144893.697488:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515050 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ab4 expref: 18 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.697517:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10936 00000100:00100000:2.0:1746144893.697522:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175178368:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.697534:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.697551:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515050 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ab4 expref: 18 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.697560:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515050 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ab4 expref: 18 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.697577:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515050 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ab4 expref: 18 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.697598:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.697600:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.697605:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515057 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94abb expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.697611:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515057 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94abb expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.697633:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515057 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94abb expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.697642:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172450560:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.697696:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.699847:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172450560:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.699865:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.699903:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1984:x1830965175178368:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2380us (2519us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.699914:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10936 00000100:00100000:0.0:1746144893.700183:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.700250:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175178624 00000100:00100000:3.0:1746144893.700255:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175178624 00002000:00100000:3.0:1746144893.700286:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230fb80 x1830965175178624/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.700295:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230fb80 with x1830965175178624 ext(0->4095) 00002000:00010000:3.0:1746144893.700298:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230fb80 00000100:00100000:3.0:1746144893.700316:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4056 00000100:00100000:3.0:1746144893.700321:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175178624:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144893.700573:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175178624:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 250us (389us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.700579:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4056 00002000:00100000:3.0:1746144893.700584:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230fb80 x1830965175178624/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.700591:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230fb80 with x1830965175178624 ext(0->4095) 00002000:00010000:3.0:1746144893.700593:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230fb80 00000100:00100000:0.0:1746144893.701682:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.701722:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175178752 00000100:00100000:3.0:1746144893.701726:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175178752 00000100:00100000:3.0:1746144893.701759:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5521 00000100:00100000:3.0:1746144893.701797:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+17:31565:x1830965175178752:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.701806:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.701818:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ac2 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.701838:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515057 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94abb expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.701845:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.701847:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.701850:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac2 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.701872:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515057 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94abb expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.701882:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515057 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94abb expref: 5 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.701891:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172450688:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.701936:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.706807:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.707075:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172450688:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.707100:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac2 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.707114:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:3.0:1746144893.707252:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175178752:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5454us (5571us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.707263:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5521 00000100:00100000:3.0:1746144893.707285:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175178880 00000100:00100000:3.0:1746144893.707290:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175178880 00000100:00100000:3.0:1746144893.707324:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5522 00000100:00100000:3.0:1746144893.707330:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31579:x1830965175178880:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.707342:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.707353:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515065 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ac9 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.707370:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.707374:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac2 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.707379:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.707382:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515065 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac9 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.707404:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac2 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.707412:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515065 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac9 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.707419:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:3.0:1746144893.707436:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31579:x1830965175178880:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 107us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.707441:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5522 00000100:00100000:0.0:1746144893.708240:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.708287:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175179008 00000100:00100000:2.0:1746144893.708291:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175179008 00010000:00010000:2.0:1746144893.708312:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515057 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94abb expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.708341:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10937 00000100:00100000:2.0:1746144893.708346:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5139850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175179008:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.708354:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.708370:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515057 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94abb expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.708379:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515057 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94abb expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.708394:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515057 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94abb expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.708414:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.708416:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.708421:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac2 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.708427:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac2 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.708446:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac2 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.708456:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac2 expref: 18 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.708466:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172450944:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.708531:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.711102:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.711534:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172450944:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.711554:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.711599:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5139850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175179008:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3252us (3360us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.711607:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10937 00000100:00100000:3.0:1746144893.711716:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175179264 00000100:00100000:3.0:1746144893.711721:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175179264 00002000:00100000:3.0:1746144893.711752:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2df80 x1830965175179264/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.711760:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2df80 with x1830965175179264 ext(0->4095) 00010000:00010000:3.0:1746144893.711791:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac2 expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.711801:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac2 expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.711807:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2df80 00000100:00100000:3.0:1746144893.711820:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2058 00000100:00100000:3.0:1746144893.711826:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175179264:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144893.712391:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175179264:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 563us (1294us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.712396:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2058 00002000:00100000:3.0:1746144893.712402:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2df80 x1830965175179264/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.712408:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2df80 with x1830965175179264 ext(0->4095) 00010000:00010000:3.0:1746144893.712413:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac2 expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.712422:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac2 expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.712431:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2df80 00000100:00100000:0.0:1746144893.717887:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.718457:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175179392 00000100:00100000:2.0:1746144893.718465:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175179392 00010000:00010000:2.0:1746144893.718504:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac2 expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.718540:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10938 00000100:00100000:2.0:1746144893.718547:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175179392:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.718558:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.718573:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac2 expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.718583:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac2 expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.718599:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751505e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac2 expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.718624:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.718625:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.718631:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515065 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac9 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.718637:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515065 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac9 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.718661:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515065 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac9 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.718670:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172451072:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.720143:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.722106:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.722176:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175179648 00000100:00100000:3.0:1746144893.722183:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175179648 00002000:00100000:3.0:1746144893.722215:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ea00 x1830965175179648/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.722222:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ea00 with x1830965175179648 ext(0->4095) 00002000:00010000:3.0:1746144893.722226:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ea00 00000100:00100000:3.0:1746144893.722239:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4057 00000100:00100000:3.0:1746144893.722244:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175179648:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.722456:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172451072:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.722474:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.722976:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175179648:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 730us (875us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.722983:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4057 00002000:00100000:3.0:1746144893.722988:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ea00 x1830965175179648/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.722995:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ea00 with x1830965175179648 ext(0->4095) 00000100:00100000:2.0:1746144893.723055:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175179392:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4508us (5175us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.723063:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10938 00002000:00010000:3.0:1746144893.723261:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ea00 00000100:00100000:0.0:1746144893.725520:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.725607:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175179776 00000100:00100000:2.0:1746144893.725614:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175179776 00000100:00100000:2.0:1746144893.725662:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5523 00000100:00100000:2.0:1746144893.725670:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175179776:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.725684:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.725698:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751506c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ad0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.725728:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515065 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac9 expref: 17 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.725735:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.725737:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.725740:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751506c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad0 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.725796:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515065 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac9 expref: 17 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.725806:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515065 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac9 expref: 17 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.725818:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172451200:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.725892:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.729993:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172451200:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.730021:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751506c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad0 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.730036:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1ac00, rc 0) 00000100:00100000:2.0:1746144893.730204:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175179776:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4533us (4688us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.730212:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5523 00000100:00100000:0.0:1746144893.730499:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.730660:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175179904 00000100:00100000:2.0:1746144893.730666:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175179904 00010000:00010000:2.0:1746144893.730685:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515065 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac9 expref: 18 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.730713:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10939 00000100:00100000:2.0:1746144893.730719:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175179904:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.730729:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.731137:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515065 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac9 expref: 18 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.731147:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515065 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac9 expref: 18 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.731166:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515065 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ac9 expref: 18 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.731189:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.731191:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.731196:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751506c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad0 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.731203:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751506c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad0 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.731229:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751506c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad0 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.731239:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172451328:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.731295:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.732888:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172451328:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.732905:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.733063:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1984:x1830965175179904:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2334us (2554us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.733075:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10939 00000100:00100000:0.0:1746144893.733541:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.733604:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.733657:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175180032 00000100:00100000:3.0:1746144893.733660:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175180288 00000100:00100000:2.0:1746144893.733662:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175180032 00000100:00100000:3.0:1746144893.733665:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175180288 00002000:00100000:3.0:1746144893.733691:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5df80 x1830965175180288/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.733700:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5df80 with x1830965175180288 ext(0->4095) 00000100:00100000:2.0:1746144893.733700:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5524 00002000:00010000:3.0:1746144893.733704:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5df80 00000100:00100000:2.0:1746144893.733706:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+17:31565:x1830965175180032:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.733717:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.733729:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ad7 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.733755:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751506c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad0 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.733790:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.733791:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.733795:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad7 expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.733822:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751506c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad0 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.733832:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751506c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad0 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.733846:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172451456:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.733898:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.733922:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2059 00000100:00100000:3.0:1746144893.733929:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175180288:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144893.734637:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175180288:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 707us (1030us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.734643:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2059 00002000:00100000:3.0:1746144893.734649:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5df80 x1830965175180288/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.734656:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5df80 with x1830965175180288 ext(0->4095) 00010000:00010000:3.0:1746144893.734661:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751506c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad0 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.734673:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751506c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad0 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.734678:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5df80 00000100:00100000:2.0:1746144893.735727:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172451456:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.735748:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad7 expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.735779:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1a000, rc 0) 00000100:00100000:2.0:1746144893.735811:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175180032:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2106us (2272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.735818:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5524 00000100:00100000:0.0:1746144893.738057:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.738513:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175180416 00000100:00100000:2.0:1746144893.738521:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175180416 00000100:00100000:2.0:1746144893.738567:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5525 00000100:00100000:2.0:1746144893.738574:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31579:x1830965175180416:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.738590:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.738603:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751507a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ade expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.738625:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.738629:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad7 expref: 19 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.738634:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.738637:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751507a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ade expref: 19 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.738669:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad7 expref: 19 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.738678:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751507a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ade expref: 19 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.738686:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1ae00, rc 0) 00000100:00100000:2.0:1746144893.738727:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31579:x1830965175180416:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 153us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.738732:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5525 00000100:00100000:0.0:1746144893.738999:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.740235:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175180544 00000100:00100000:2.0:1746144893.740242:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175180544 00010000:00010000:2.0:1746144893.740268:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751506c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad0 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.740302:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10940 00000100:00100000:2.0:1746144893.740309:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175180544:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.740319:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.740335:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751506c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad0 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.740345:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751506c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad0 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.740360:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751506c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad0 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.740387:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.740389:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.740395:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad7 expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.740402:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad7 expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.740426:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad7 expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.740436:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad7 expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.740445:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172451712:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.740516:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.743287:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.743330:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172451712:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.743351:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.743395:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175180544:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3086us (4396us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.743404:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10940 00000100:00100000:3.0:1746144893.743488:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175180800 00000100:00100000:3.0:1746144893.743494:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175180800 00002000:00100000:3.0:1746144893.743523:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093254380 x1830965175180800/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.743532:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254380 with x1830965175180800 ext(0->4095) 00010000:00010000:3.0:1746144893.743539:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad7 expref: 19 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.743550:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad7 expref: 19 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.743556:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093254380 00000100:00100000:3.0:1746144893.743858:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2060 00000100:00100000:3.0:1746144893.743864:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1983:x1830965175180800:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:3.0:1746144893.744014:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1983:x1830965175180800:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 149us (733us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.744020:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2060 00002000:00100000:3.0:1746144893.744025:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093254380 x1830965175180800/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.744032:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254380 with x1830965175180800 ext(0->4095) 00010000:00010000:3.0:1746144893.744037:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad7 expref: 19 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.744045:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad7 expref: 19 pid: 8430 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.744050:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093254380 00000100:00100000:0.0:1746144893.746104:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.746186:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175180928 00000100:00100000:2.0:1746144893.746192:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175180928 00010000:00010000:2.0:1746144893.746283:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad7 expref: 19 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.746321:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10941 00000100:00100000:2.0:1746144893.746328:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175180928:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.746342:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.746359:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad7 expref: 19 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.746369:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad7 expref: 19 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.746388:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515073 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ad7 expref: 19 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.746399:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.746401:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.746407:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751507a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ade expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.746413:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751507a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ade expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.746437:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751507a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ade expref: 18 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.746447:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172451840:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.746596:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.748300:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172451840:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.748325:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.748357:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175180928:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2030us (2259us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.748364:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10941 00000100:00100000:0.0:1746144893.749150:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.749278:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175181184 00000100:00100000:3.0:1746144893.749285:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175181184 00002000:00100000:3.0:1746144893.749319:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093256680 x1830965175181184/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.749326:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256680 with x1830965175181184 ext(0->4095) 00002000:00010000:3.0:1746144893.749330:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093256680 00000100:00100000:3.0:1746144893.749352:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4059 00000100:00100000:3.0:1746144893.749358:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175181184:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144893.749487:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175181184:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 129us (339us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.749493:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4059 00002000:00100000:3.0:1746144893.749497:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093256680 x1830965175181184/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.749503:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256680 with x1830965175181184 ext(0->4095) 00002000:00010000:3.0:1746144893.749506:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093256680 00000100:00100000:0.0:1746144893.752101:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.752258:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175181312 00000100:00100000:2.0:1746144893.752265:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175181312 00000100:00100000:2.0:1746144893.752319:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5526 00000100:00100000:2.0:1746144893.752326:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175181312:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.752341:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.752354:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515081 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ae5 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.752377:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751507a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ade expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.752384:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.752386:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.752389:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515081 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ae5 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.752411:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751507a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ade expref: 17 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.752421:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751507a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ade expref: 17 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.752431:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172451968:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.752508:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.754846:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.754968:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175181440 00000100:00100000:3.0:1746144893.754975:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175181440 00010000:00010000:3.0:1746144893.755007:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751507a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ade expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.755028:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10942 00000100:00100000:3.0:1746144893.755034:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175181440:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.755046:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.755063:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751507a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ade expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.755073:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751507a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ade expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.755093:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.755095:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.755101:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515081 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ae5 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.755108:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515081 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ae5 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.755139:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515081 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ae5 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.755149:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172452096:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.755270:0:8430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751507a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ade expref: 18 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.755290:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172451968:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.755312:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515081 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ae5 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.755319:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1aa00, rc 0) 00000100:00100000:2.0:1746144893.755985:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175181312:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3657us (3888us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.755992:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5526 00000100:00100000:3.0:1746144893.756151:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.758489:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.759004:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175181696 00000100:00100000:1.0:1746144893.759012:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175181696 00002000:00100000:1.0:1746144893.759048:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417fb80 x1830965175181696/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.759058:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417fb80 with x1830965175181696 ext(0->4095) 00002000:00010000:1.0:1746144893.759062:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417fb80 00000100:00100000:1.0:1746144893.759090:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4060 00000100:00100000:1.0:1746144893.759096:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175181696:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144893.759248:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175181696:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 152us (766us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.759256:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4060 00002000:00100000:1.0:1746144893.759261:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417fb80 x1830965175181696/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.759267:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417fb80 with x1830965175181696 ext(0->4095) 00002000:00010000:1.0:1746144893.759269:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417fb80 00000100:00100000:3.0:1746144893.759347:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172452096:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.759361:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.759382:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1984:x1830965175181440:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4349us (4542us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.759388:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10942 00000100:00100000:0.0:1746144893.761600:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.762501:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.762523:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175181824 00000100:00100000:0.0:1746144893.762530:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175181824 00000100:00100000:0.0:1746144893.762559:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175181952 00000100:00100000:0.0:1746144893.762561:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175181952 00000100:00100000:0.0:1746144893.762572:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5527 00000100:00100000:0.0:1746144893.762578:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175181824:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144893.762593:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144893.762606:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94aec expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144893.762629:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515081 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ae5 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144893.762637:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144893.762638:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144893.762641:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aec expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144893.762664:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515081 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ae5 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144893.762674:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515081 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ae5 expref: 5 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:0.0:1746144893.762684:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801391d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172452224:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144893.762872:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5528 00000100:00100000:1.0:1746144893.762879:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31579:x1830965175181952:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.762886:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.762896:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af672751508f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94af3 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.762906:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.762910:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aec expref: 20 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.762914:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.762917:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af672751508f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94af3 expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.762936:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aec expref: 20 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.762955:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af672751508f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94af3 expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.762964:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939000, rc 0) 00000100:00100000:1.0:1746144893.763892:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31579:x1830965175181952:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1010us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.763898:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5528 00000100:00100000:0.0:1746144893.764078:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.765684:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801391d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172452224:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.765707:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aec expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.765720:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b3000, rc 0) 00000100:00100000:2.0:1746144893.765925:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31565:x1830965175181824:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3345us (4329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.765932:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5527 00000100:00100000:0.0:1746144893.766324:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.766640:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175182080 00000100:00100000:3.0:1746144893.766645:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175182080 00010000:00010000:3.0:1746144893.766666:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515081 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ae5 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.766748:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10943 00000100:00100000:3.0:1746144893.766753:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175182080:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.766777:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.766792:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515081 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ae5 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.766801:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515081 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ae5 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.766817:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515081 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ae5 expref: 6 pid: 8430 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.766935:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.766944:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.766950:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aec expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.766957:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aec expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.766981:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aec expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.766989:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aec expref: 18 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.766998:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172452480:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.767230:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.769888:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172452480:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.769904:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.769946:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175182080:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3183us (3613us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.769955:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10943 00000100:00100000:0.0:1746144893.770298:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.770443:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175182336 00000100:00100000:2.0:1746144893.770449:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175182336 00002000:00100000:2.0:1746144893.770485:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801391d0e00 x1830965175182336/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.770493:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d0e00 with x1830965175182336 ext(0->4095) 00010000:00010000:2.0:1746144893.770501:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aec expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.770511:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aec expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.770517:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801391d0e00 00000100:00100000:2.0:1746144893.770532:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2061 00000100:00100000:2.0:1746144893.770537:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175182336:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144893.770664:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175182336:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 126us (903us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.770669:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2061 00002000:00100000:2.0:1746144893.770674:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801391d0e00 x1830965175182336/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.770681:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d0e00 with x1830965175182336 ext(0->4095) 00010000:00010000:2.0:1746144893.770684:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aec expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.770693:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aec expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.770697:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801391d0e00 00000100:00100000:0.0:1746144893.773621:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.773697:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175182464 00000100:00100000:3.0:1746144893.773704:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175182464 00010000:00010000:3.0:1746144893.773731:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aec expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.773786:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10944 00000100:00100000:3.0:1746144893.773793:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5139450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1983:x1830965175182464:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.773804:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.773822:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aec expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.773831:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aec expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.773850:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515088 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94aec expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.773864:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.773866:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.773872:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af672751508f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94af3 expref: 18 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.773879:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af672751508f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94af3 expref: 18 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.773905:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af672751508f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94af3 expref: 18 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.773915:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172452608:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.773989:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7da80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.777252:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172452608:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.777271:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.777316:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5139450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1983:x1830965175182464:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3522us (3699us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.777325:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10944 00000100:00100000:0.0:1746144893.777988:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.778079:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175182720 00000100:00100000:1.0:1746144893.778085:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175182720 00002000:00100000:1.0:1746144893.778116:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801391d3480 x1830965175182720/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.778124:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d3480 with x1830965175182720 ext(0->4095) 00002000:00010000:1.0:1746144893.778128:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801391d3480 00000100:00100000:1.0:1746144893.778152:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4061 00000100:00100000:1.0:1746144893.778158:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175182720:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144893.778300:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175182720:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 141us (312us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.778306:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4061 00002000:00100000:1.0:1746144893.778311:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801391d3480 x1830965175182720/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.778317:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d3480 with x1830965175182720 ext(0->4095) 00002000:00010000:1.0:1746144893.778320:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801391d3480 00000100:00100000:0.0:1746144893.780597:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.780785:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175182848 00000100:00100000:2.0:1746144893.780791:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175182848 00000100:00100000:2.0:1746144893.780827:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5529 00000100:00100000:2.0:1746144893.780832:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175182848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.780845:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.780857:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94afa expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.780881:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af672751508f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94af3 expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.780888:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.780890:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.780893:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94afa expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.780916:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af672751508f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94af3 expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.780926:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af672751508f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94af3 expref: 17 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.780936:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172452736:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.781811:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.783726:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172452736:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.783750:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94afa expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.783778:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b000, rc 0) 00000100:00100000:2.0:1746144893.783810:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175182848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2978us (3218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.783820:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5529 00000100:00100000:0.0:1746144893.784191:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.784582:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175182976 00000100:00100000:3.0:1746144893.784587:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175182976 00010000:00010000:3.0:1746144893.784607:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af672751508f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94af3 expref: 18 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.784956:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10945 00000100:00100000:3.0:1746144893.784963:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175182976:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.784973:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.784988:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af672751508f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94af3 expref: 18 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.784997:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af672751508f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94af3 expref: 18 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.785012:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af672751508f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94af3 expref: 18 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.785027:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.785029:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.785034:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94afa expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.785040:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94afa expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.785063:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94afa expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.785072:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172452864:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.785121:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.787934:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.788154:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175183104 00000100:00100000:2.0:1746144893.788162:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175183104 00000100:00100000:2.0:1746144893.788580:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5530 00000100:00100000:2.0:1746144893.788588:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175183104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.788604:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.788619:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b01 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.788642:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94afa expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.788649:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.788650:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.788653:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b01 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.788677:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94afa expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.788686:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94afa expref: 5 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.788696:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172452992:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.788779:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.789229:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.789501:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175183360 00000100:00100000:2.0:1746144893.789505:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175183360 00002000:00100000:2.0:1746144893.789530:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093442d80 x1830965175183360/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.789538:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093442d80 with x1830965175183360 ext(0->4095) 00010000:00010000:2.0:1746144893.789543:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94afa expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.789552:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94afa expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.789557:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093442d80 00000100:00100000:2.0:1746144893.790035:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2062 00000100:00100000:2.0:1746144893.790042:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175183360:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.790172:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175183360:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 130us (942us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.790178:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2062 00002000:00100000:2.0:1746144893.790183:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093442d80 x1830965175183360/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.790189:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093442d80 with x1830965175183360 ext(0->4095) 00010000:00010000:2.0:1746144893.790194:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94afa expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.790202:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94afa expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:2.0:1746144893.790207:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093442d80 00000100:00100000:2.0:1746144893.790240:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172452864:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.790252:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.790271:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175182976:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5309us (6081us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.790277:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10945 00000100:00100000:0.0:1746144893.792655:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.792719:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175183488 00000100:00100000:1.0:1746144893.792725:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175183488 00000100:00100000:1.0:1746144893.792754:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5531 00000100:00100000:1.0:1746144893.792759:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31579:x1830965175183488:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.792788:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.792800:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b08 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.792819:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.792823:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b01 expref: 20 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.792828:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.792831:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150a4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b08 expref: 20 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.792854:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b01 expref: 20 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.792862:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150a4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b08 expref: 20 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.792869:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939000, rc 0) 00000100:00100000:1.0:1746144893.792895:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31579:x1830965175183488:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 136us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.792899:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5531 00000100:00100000:2.0:1746144893.793050:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172452992:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.793066:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b01 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.793073:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1a000, rc 0) 00000100:00100000:2.0:1746144893.793086:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31565:x1830965175183104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4500us (5160us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.793090:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5530 00000100:00100000:0.0:1746144893.795911:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.796029:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175183616 00000100:00100000:2.0:1746144893.796036:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175183616 00010000:00010000:2.0:1746144893.796066:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94afa expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.796275:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10946 00000100:00100000:2.0:1746144893.796283:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175183616:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.796293:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.796308:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94afa expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.796318:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94afa expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.796341:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515096 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94afa expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.796514:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.796516:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.796522:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b01 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.796529:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b01 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.796556:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b01 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.796566:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b01 expref: 18 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.796576:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172453248:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.796960:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.799519:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172453248:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144893.799539:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144893.799584:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175183616:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3301us (3678us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144893.799593:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10946 00000100:00100000:1.0:1746144893.799713:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.799818:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175183872 00000100:00100000:0.0:1746144893.799823:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175183872 00002000:00100000:0.0:1746144893.799850:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932a8a80 x1830965175183872/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144893.799858:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a8a80 with x1830965175183872 ext(0->4095) 00010000:00010000:0.0:1746144893.799864:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b01 expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:0.0:1746144893.799875:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b01 expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:0.0:1746144893.799881:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932a8a80 00000100:00100000:0.0:1746144893.799903:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2063 00000100:00100000:0.0:1746144893.799909:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175183872:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144893.800050:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175183872:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 140us (336us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144893.800056:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2063 00002000:00100000:0.0:1746144893.800061:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932a8a80 x1830965175183872/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144893.800069:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a8a80 with x1830965175183872 ext(0->4095) 00010000:00010000:0.0:1746144893.800074:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b01 expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:0.0:1746144893.800083:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b01 expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:0.0:1746144893.800087:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932a8a80 00000100:00100000:0.0:1746144893.803499:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.803910:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175184000 00000100:00100000:2.0:1746144893.803918:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175184000 00010000:00010000:2.0:1746144893.803960:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b01 expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.804342:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10947 00000100:00100000:2.0:1746144893.804351:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093442300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1982:x1830965175184000:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.804364:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.804382:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b01 expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.804393:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b01 expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.804411:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751509d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b01 expref: 19 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.804463:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.804465:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.804471:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b08 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.804478:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b08 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.804506:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b08 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.804516:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172453376:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.805969:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.808682:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.809025:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172453376:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.809045:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.809091:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093442300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1982:x1830965175184000:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4740us (5597us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.809103:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10947 00000100:00100000:3.0:1746144893.809564:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175184256 00000100:00100000:3.0:1746144893.809571:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175184256 00002000:00100000:3.0:1746144893.809603:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880099e84700 x1830965175184256/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.809611:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e84700 with x1830965175184256 ext(0->4095) 00002000:00010000:3.0:1746144893.809615:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e84700 00000100:00100000:3.0:1746144893.809630:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4062 00000100:00100000:3.0:1746144893.809636:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1983:x1830965175184256:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:3.0:1746144893.809786:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1983:x1830965175184256:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 150us (1110us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.809792:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4062 00002000:00100000:3.0:1746144893.809797:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880099e84700 x1830965175184256/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.809803:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e84700 with x1830965175184256 ext(0->4095) 00002000:00010000:3.0:1746144893.809806:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e84700 00000100:00100000:0.0:1746144893.812530:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.812632:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175184384 00000100:00100000:2.0:1746144893.812639:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175184384 00000100:00100000:2.0:1746144893.812672:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5532 00000100:00100000:2.0:1746144893.812678:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175184384:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.812693:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.812706:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b0f expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.812728:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b08 expref: 17 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.812734:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.812735:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.812738:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150ab lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b0f expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.812783:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b08 expref: 17 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.812793:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b08 expref: 17 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.812803:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172453504:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.813346:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.815168:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172453504:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144893.815191:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150ab lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b0f expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144893.815204:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b600, rc 0) 00000100:00100000:0.0:1746144893.815241:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175184384:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2562us (2717us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144893.815247:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5532 00000100:00100000:0.0:1746144893.816664:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.816789:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175184512 00000100:00100000:2.0:1746144893.816795:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175184512 00010000:00010000:2.0:1746144893.816822:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b08 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.817043:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10948 00000100:00100000:2.0:1746144893.817051:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175184512:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.817062:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.817080:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b08 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.817090:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b08 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.817109:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b08 expref: 18 pid: 20722 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.817132:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.817134:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.817140:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b0f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.817147:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b0f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.817174:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b0f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.817185:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172453632:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.817249:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.819512:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.819673:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175184768 00000100:00100000:1.0:1746144893.819679:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175184768 00002000:00100000:1.0:1746144893.819715:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181f100 x1830965175184768/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.819723:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181f100 with x1830965175184768 ext(0->4095) 00002000:00010000:1.0:1746144893.819727:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009181f100 00000100:00100000:1.0:1746144893.819754:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4063 00000100:00100000:1.0:1746144893.819760:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175184768:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144893.819920:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175184768:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 160us (413us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.819926:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4063 00002000:00100000:1.0:1746144893.819931:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181f100 x1830965175184768/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.819945:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181f100 with x1830965175184768 ext(0->4095) 00002000:00010000:1.0:1746144893.819948:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009181f100 00000100:00100000:2.0:1746144893.820154:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172453632:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.820170:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.820469:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1985:x1830965175184512:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3417us (3807us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.820476:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10948 00000100:00100000:0.0:1746144893.820607:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.820624:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175184896 00000100:00100000:0.0:1746144893.820627:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175184896 00000100:00100000:0.0:1746144893.820644:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5533 00000100:00100000:0.0:1746144893.820648:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+17:31565:x1830965175184896:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144893.820657:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144893.820669:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b16 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144893.820689:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150ab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b0f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144893.820695:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144893.820697:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144893.820700:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b16 expref: 18 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144893.820721:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b0f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144893.820730:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b0f expref: 5 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:0.0:1746144893.820739:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009181fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172453760:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144893.820795:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3480 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.823316:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009181fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172453760:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.823341:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b16 expref: 18 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.823354:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b2000, rc 0) 00000100:00100000:2.0:1746144893.823383:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175184896:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2733us (2775us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.823390:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5533 00000100:00100000:0.0:1746144893.824484:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.825227:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175185024 00000100:00100000:2.0:1746144893.825234:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175185024 00000100:00100000:2.0:1746144893.825283:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5534 00000100:00100000:2.0:1746144893.825289:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31579:x1830965175185024:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.825302:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.825315:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275150b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b1d expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.825335:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.825340:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b16 expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.825349:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.825352:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275150b9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b1d expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.825380:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b16 expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.825389:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275150b9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b1d expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.825397:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1a000, rc 0) 00000100:00100000:2.0:1746144893.825435:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31579:x1830965175185024:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 146us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.825441:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5534 00000100:00100000:0.0:1746144893.826381:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.826722:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175185152 00000100:00100000:2.0:1746144893.826727:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175185152 00010000:00010000:2.0:1746144893.826744:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b0f expref: 6 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:1.0:1746144893.826845:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10949 00000100:00100000:1.0:1746144893.826853:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175185152:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144893.826862:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144893.826878:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b0f expref: 6 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.826888:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b0f expref: 6 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.826903:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b0f expref: 6 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.826926:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.826928:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.826933:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b16 expref: 18 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.826947:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b16 expref: 18 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.826967:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b16 expref: 18 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.826976:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b16 expref: 18 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:1.0:1746144893.826986:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172454016:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144893.827037:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.828840:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.828952:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172454016:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144893.828965:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144893.828993:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175185152:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2141us (2614us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.829001:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10949 00000100:00100000:3.0:1746144893.829665:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175185408 00000100:00100000:3.0:1746144893.829671:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175185408 00002000:00100000:3.0:1746144893.829700:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181c700 x1830965175185408/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.829709:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181c700 with x1830965175185408 ext(0->4095) 00010000:00010000:3.0:1746144893.829716:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b16 expref: 19 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.829726:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b16 expref: 19 pid: 10401 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.829732:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181c700 00000100:00100000:3.0:1746144893.829757:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2064 00000100:00100000:3.0:1746144893.829792:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175185408:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144893.829932:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175185408:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 169us (1097us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.829947:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2064 00002000:00100000:3.0:1746144893.829951:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009181c700 x1830965175185408/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.829957:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181c700 with x1830965175185408 ext(0->4095) 00010000:00010000:3.0:1746144893.829961:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b16 expref: 19 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.829969:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b16 expref: 19 pid: 10401 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.829974:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009181c700 00000100:00100000:0.0:1746144893.832313:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.833022:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175185536 00000100:00100000:1.0:1746144893.833030:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175185536 00010000:00010000:1.0:1746144893.833059:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b16 expref: 19 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:1.0:1746144893.833117:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10950 00000100:00100000:1.0:1746144893.833124:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1983:x1830965175185536:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144893.833135:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144893.833150:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b16 expref: 19 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.833165:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b16 expref: 19 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.833183:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2000/0x4076af67275150b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b16 expref: 19 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:1.0:1746144893.833390:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.833392:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.833398:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275150b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b1d expref: 18 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.833406:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275150b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b1d expref: 18 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.833431:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275150b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b1d expref: 18 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144893.833442:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172454144:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144893.833803:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.837239:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.837339:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175185792 00000100:00100000:2.0:1746144893.837345:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175185792 00002000:00100000:2.0:1746144893.837383:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093855880 x1830965175185792/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.837391:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093855880 with x1830965175185792 ext(0->4095) 00002000:00010000:2.0:1746144893.837396:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093855880 00000100:00100000:2.0:1746144893.837422:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4064 00000100:00100000:2.0:1746144893.837430:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175185792:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144893.837559:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175185792:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 129us (326us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.837565:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4064 00002000:00100000:2.0:1746144893.837570:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093855880 x1830965175185792/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.837577:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093855880 with x1830965175185792 ext(0->4095) 00002000:00010000:2.0:1746144893.837579:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093855880 00000100:00100000:1.0:1746144893.838043:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172454144:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144893.838058:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144893.838393:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1983:x1830965175185536:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5268us (6085us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.838400:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10950 00000100:00100000:0.0:1746144893.840474:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.840574:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175185920 00000100:00100000:2.0:1746144893.840581:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175185920 00000100:00100000:2.0:1746144893.841188:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5535 00000100:00100000:2.0:1746144893.841196:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175185920:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.841210:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.841223:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b24 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.841246:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275150b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b1d expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.841252:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.841254:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.841257:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b24 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.841280:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275150b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b1d expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.841295:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275150b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b1d expref: 17 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.841306:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172454272:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.841420:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.843928:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172454272:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.843967:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b24 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.843981:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b600, rc 0) 00000100:00100000:2.0:1746144893.844016:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175185920:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2821us (3546us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.844024:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5535 00000100:00100000:0.0:1746144893.844189:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.844415:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175186048 00000100:00100000:2.0:1746144893.844421:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175186048 00010000:00010000:2.0:1746144893.844442:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275150b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b1d expref: 18 pid: 10401 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.844461:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10951 00000100:00100000:2.0:1746144893.844466:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5139050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175186048:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.844476:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.844498:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275150b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b1d expref: 18 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.844509:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275150b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b1d expref: 18 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.844525:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275150b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b1d expref: 18 pid: 10401 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.844752:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.844754:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.844760:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b24 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.844784:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b24 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.844809:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b24 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.844818:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172454400:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.845236:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.847260:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.847336:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.847450:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172454400:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.847469:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.847510:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5139050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1985:x1830965175186048:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3043us (3321us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.847518:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10951 00000100:00100000:3.0:1746144893.847615:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175186304 00000100:00100000:3.0:1746144893.847620:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175186304 00000100:00100000:3.0:1746144893.847647:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5536 00000100:00100000:3.0:1746144893.847652:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+17:31565:x1830965175186304:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.847666:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.847681:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b2b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.847701:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b24 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.847707:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.847709:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.847712:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b2b expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.847734:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b24 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.847745:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b24 expref: 5 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:3.0:1746144893.847755:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172454528:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.847825:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.847838:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175186432 00000100:00100000:3.0:1746144893.847841:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175186432 00002000:00100000:3.0:1746144893.847861:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093857b80 x1830965175186432/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.847868:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093857b80 with x1830965175186432 ext(0->4095) 00010000:00010000:3.0:1746144893.847872:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b24 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.847880:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b24 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.847884:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093857b80 00000100:00100000:3.0:1746144893.847896:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2065 00000100:00100000:3.0:1746144893.847900:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175186432:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144893.848044:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175186432:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 143us (709us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.848049:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2065 00002000:00100000:3.0:1746144893.848054:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093857b80 x1830965175186432/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.848060:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093857b80 with x1830965175186432 ext(0->4095) 00010000:00010000:3.0:1746144893.848064:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b24 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:3.0:1746144893.848072:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b24 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00002000:00010000:3.0:1746144893.848077:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093857b80 00000100:00100000:0.0:1746144893.851067:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.851457:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175186560 00000100:00100000:2.0:1746144893.851465:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175186560 00000100:00100000:2.0:1746144893.851510:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5537 00000100:00100000:2.0:1746144893.851517:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31579:x1830965175186560:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.851532:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.851546:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275150ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b32 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.851568:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.851573:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b2b expref: 20 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.851579:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.851582:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275150ce lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b32 expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.851609:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b2b expref: 20 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.851620:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275150ce lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b32 expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.851628:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1aa00, rc 0) 00000100:00100000:2.0:1746144893.851659:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31579:x1830965175186560:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 143us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.851664:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5537 00000100:00100000:3.0:1746144893.852062:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172454528:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.852077:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b2b expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.852088:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:3.0:1746144893.852105:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31565:x1830965175186304:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4453us (4852us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.852110:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5536 00000100:00100000:0.0:1746144893.852424:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.852893:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175186688 00000100:00100000:2.0:1746144893.852898:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175186688 00010000:00010000:2.0:1746144893.852917:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b24 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00000100:00100000:2.0:1746144893.853364:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10952 00000100:00100000:2.0:1746144893.853371:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175186688:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.853381:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.853396:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b24 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.853406:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b24 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.853423:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275150c0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b24 expref: 6 pid: 8432 timeout: 587 lvb_type: 0 00010000:00010000:2.0:1746144893.853433:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.853435:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.853440:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b2b expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.853446:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b2b expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.853466:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b2b expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.853476:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b2b expref: 18 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144893.853490:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172454784:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.853546:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.856074:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172454784:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.856092:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.856677:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175186688:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3304us (4250us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.856686:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10952 00000100:00100000:3.0:1746144893.856957:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.857047:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175186944 00000100:00100000:2.0:1746144893.857053:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175186944 00002000:00100000:2.0:1746144893.857081:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38ce00 x1830965175186944/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.857088:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38ce00 with x1830965175186944 ext(0->4095) 00010000:00010000:2.0:1746144893.857095:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b2b expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.857106:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b2b expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144893.857112:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f38ce00 00000100:00100000:2.0:1746144893.857135:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2066 00000100:00100000:2.0:1746144893.857141:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175186944:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.857267:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175186944:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 126us (310us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.857276:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2066 00002000:00100000:2.0:1746144893.857280:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38ce00 x1830965175186944/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.857286:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38ce00 with x1830965175186944 ext(0->4095) 00010000:00010000:2.0:1746144893.857290:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b2b expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.857298:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b2b expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144893.857303:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f38ce00 00000100:00100000:0.0:1746144893.860903:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.861047:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175187072 00000100:00100000:2.0:1746144893.861056:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175187072 00010000:00010000:2.0:1746144893.861085:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b2b expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144893.861200:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10953 00000100:00100000:2.0:1746144893.861206:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1982:x1830965175187072:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.861216:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.861231:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b2b expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.861240:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b2b expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.861257:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b2b expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.861268:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.861270:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.861275:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275150ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b32 expref: 18 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.861282:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275150ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b32 expref: 18 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.861306:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275150ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b32 expref: 18 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.861314:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172454912:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.861377:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.863534:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.863608:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175187328 00000100:00100000:3.0:1746144893.863613:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175187328 00002000:00100000:3.0:1746144893.863645:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a4f0a680 x1830965175187328/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.863653:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f0a680 with x1830965175187328 ext(0->4095) 00002000:00010000:3.0:1746144893.863657:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4f0a680 00000100:00100000:3.0:1746144893.863674:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4065 00000100:00100000:3.0:1746144893.863679:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175187328:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.863981:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172454912:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.863999:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.864550:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175187328:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 868us (1020us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.864556:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4065 00002000:00100000:3.0:1746144893.864562:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a4f0a680 x1830965175187328/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.864569:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f0a680 with x1830965175187328 ext(0->4095) 00002000:00010000:3.0:1746144893.864572:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4f0a680 00000100:00100000:2.0:1746144893.864617:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1982:x1830965175187072:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3410us (3720us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.864624:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10953 00000100:00100000:0.0:1746144893.867467:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.868103:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175187456 00000100:00100000:3.0:1746144893.868111:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175187456 00000100:00100000:3.0:1746144893.868154:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5538 00000100:00100000:3.0:1746144893.868161:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175187456:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.868175:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.868188:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b39 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.868212:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275150ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b32 expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.868219:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.868220:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.868223:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b39 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.868248:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275150ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b32 expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.868259:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275150ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b32 expref: 17 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144893.868269:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172455040:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.869051:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4178b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.870275:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172455040:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.870295:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b39 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.870309:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:3.0:1746144893.870338:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175187456:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2177us (2877us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.870346:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5538 00000100:00100000:0.0:1746144893.871721:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.871837:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175187584 00000100:00100000:2.0:1746144893.871843:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175187584 00010000:00010000:2.0:1746144893.871869:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275150ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b32 expref: 18 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144893.871896:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10954 00000100:00100000:2.0:1746144893.871903:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175187584:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.871916:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.871933:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275150ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b32 expref: 18 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.871955:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275150ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b32 expref: 18 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.871972:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af67275150ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b32 expref: 18 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.871993:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.871994:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.871999:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b39 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.872007:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b39 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.872030:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b39 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.872040:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172455168:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.872096:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.873594:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172455168:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.873610:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.873646:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1984:x1830965175187584:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1742us (1927us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.873910:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10954 00000100:00100000:0.0:1746144893.874052:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.874331:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175187840 00000100:00100000:3.0:1746144893.874336:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175187840 00000100:00100000:3.0:1746144893.874541:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5539 00000100:00100000:3.0:1746144893.874548:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+17:31565:x1830965175187840:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.874560:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.874572:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b40 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.874593:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b39 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.874599:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.874600:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.874603:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b40 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.874622:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b39 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.874632:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b39 expref: 5 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144893.874641:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172455296:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144893.874687:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4178b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.875330:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.875621:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175187968 00000100:00100000:3.0:1746144893.875625:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175187968 00002000:00100000:3.0:1746144893.875652:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918edf80 x1830965175187968/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.875660:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918edf80 with x1830965175187968 ext(0->4095) 00010000:00010000:3.0:1746144893.875665:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b39 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.875675:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b39 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144893.875681:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918edf80 00000100:00100000:3.0:1746144893.876038:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2067 00000100:00100000:3.0:1746144893.876044:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175187968:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144893.877283:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175187968:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 1235us (1950us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.877291:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2067 00002000:00100000:3.0:1746144893.877297:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918edf80 x1830965175187968/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.877305:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918edf80 with x1830965175187968 ext(0->4095) 00010000:00010000:3.0:1746144893.877312:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b39 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.877322:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b39 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144893.877328:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918edf80 00000100:00100000:3.0:1746144893.877827:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172455296:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144893.877845:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b40 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.877857:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:3.0:1746144893.877889:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175187840:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3342us (3838us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.877896:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5539 00000100:00100000:0.0:1746144893.882600:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.882698:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175188096 00000100:00100000:3.0:1746144893.882705:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175188096 00000100:00100000:3.0:1746144893.882744:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5540 00000100:00100000:3.0:1746144893.882750:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31579:x1830965175188096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.882786:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.882799:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275150e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b47 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.882819:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.882823:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b40 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.882828:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.882831:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275150e3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b47 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.882860:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b40 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.882871:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275150e3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b47 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.882879:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:3.0:1746144893.882919:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31579:x1830965175188096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 169us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.882924:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5540 00000100:00100000:0.0:1746144893.885526:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.885669:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175188224 00000100:00100000:2.0:1746144893.885676:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175188224 00010000:00010000:2.0:1746144893.885706:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b39 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144893.886044:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10955 00000100:00100000:2.0:1746144893.886052:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175188224:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.886063:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.886079:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b39 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.886089:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b39 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.886106:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275150d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b39 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.886127:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.886128:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.886134:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b40 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.886140:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b40 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.886164:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b40 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.886173:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b40 expref: 18 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144893.886183:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172455552:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.888681:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.891650:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.891731:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172455552:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.891751:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.891812:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175188224:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5760us (6291us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.891820:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10955 00000100:00100000:3.0:1746144893.891883:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175188480 00000100:00100000:3.0:1746144893.891890:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175188480 00002000:00100000:3.0:1746144893.891920:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4a300 x1830965175188480/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.891927:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4a300 with x1830965175188480 ext(0->4095) 00010000:00010000:3.0:1746144893.891934:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b40 expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.891953:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b40 expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144893.891959:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb4a300 00000100:00100000:3.0:1746144893.892714:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2068 00000100:00100000:3.0:1746144893.892721:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175188480:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144893.892887:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175188480:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 165us (1242us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.892892:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2068 00002000:00100000:3.0:1746144893.892898:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb4a300 x1830965175188480/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.892910:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4a300 with x1830965175188480 ext(0->4095) 00010000:00010000:3.0:1746144893.892915:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b40 expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.892924:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b40 expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144893.892930:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bb4a300 00000100:00100000:0.0:1746144893.897232:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.897320:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175188608 00000100:00100000:2.0:1746144893.897327:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175188608 00010000:00010000:2.0:1746144893.897361:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b40 expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144893.897683:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10956 00000100:00100000:2.0:1746144893.897691:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175188608:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.897703:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.897720:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b40 expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.897730:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b40 expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.897747:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275150dc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b40 expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.897793:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.897796:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.897802:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275150e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b47 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.897809:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275150e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b47 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.897836:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275150e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b47 expref: 18 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144893.897847:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172455680:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.897915:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.900384:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.900461:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172455680:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.900478:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.900509:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175188608:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2819us (3283us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.900517:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10956 00000100:00100000:1.0:1746144893.901356:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175188864 00000100:00100000:1.0:1746144893.901363:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175188864 00002000:00100000:1.0:1746144893.901395:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee69500 x1830965175188864/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.901403:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee69500 with x1830965175188864 ext(0->4095) 00002000:00010000:1.0:1746144893.901406:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee69500 00000100:00100000:1.0:1746144893.901429:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4066 00000100:00100000:1.0:1746144893.901435:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175188864:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144893.901573:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175188864:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 137us (1193us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.901578:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4066 00002000:00100000:1.0:1746144893.901583:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee69500 x1830965175188864/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.901590:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee69500 with x1830965175188864 ext(0->4095) 00002000:00010000:1.0:1746144893.901593:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee69500 00000100:00100000:0.0:1746144893.904653:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.905092:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175188992 00000100:00100000:1.0:1746144893.905099:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175188992 00000100:00100000:1.0:1746144893.905144:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5541 00000100:00100000:1.0:1746144893.905150:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175188992:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.905164:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.905177:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b4e expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.905201:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275150e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b47 expref: 17 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.905210:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.905212:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.905215:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b4e expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.905237:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275150e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b47 expref: 17 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.905245:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275150e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b47 expref: 17 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144893.905255:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172455808:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144893.905329:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144893.907662:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172455808:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144893.907686:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b4e expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.907699:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939000, rc 0) 00000100:00100000:1.0:1746144893.907730:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175188992:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2580us (3084us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.907737:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5541 00000100:00100000:0.0:1746144893.908333:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.908629:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175189120 00000100:00100000:3.0:1746144893.908634:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175189120 00010000:00010000:3.0:1746144893.908656:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275150e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b47 expref: 18 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144893.908681:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10957 00000100:00100000:3.0:1746144893.908686:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175189120:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.908696:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.908712:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275150e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b47 expref: 18 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.908720:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275150e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b47 expref: 18 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.908735:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275150e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b47 expref: 18 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.908755:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.908757:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.908782:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b4e expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.908789:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b4e expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.908813:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b4e expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.908823:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172455936:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.908874:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4178b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.911427:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.912557:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175189248 00000100:00100000:1.0:1746144893.912564:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175189248 00000100:00100000:1.0:1746144893.912607:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5542 00000100:00100000:1.0:1746144893.912614:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175189248:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.912631:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.912645:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b55 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.912667:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b4e expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.912672:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.912673:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.912676:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b55 expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.912700:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b4e expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.912711:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b4e expref: 5 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144893.912721:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172456064:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144893.912791:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.913109:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172455936:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.913123:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.913154:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175189120:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4467us (4820us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.913161:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10957 00000100:00100000:0.0:1746144893.913545:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.913706:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175189504 00000100:00100000:3.0:1746144893.913710:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175189504 00002000:00100000:3.0:1746144893.913732:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa3b80 x1830965175189504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.913739:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa3b80 with x1830965175189504 ext(0->4095) 00010000:00010000:3.0:1746144893.913745:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b4e expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.913755:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b4e expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144893.913787:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa3b80 00000100:00100000:3.0:1746144893.913801:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2069 00000100:00100000:3.0:1746144893.913806:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175189504:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144893.913922:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175189504:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 115us (377us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144893.913928:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2069 00002000:00100000:3.0:1746144893.913933:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa3b80 x1830965175189504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144893.913950:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa3b80 with x1830965175189504 ext(0->4095) 00010000:00010000:3.0:1746144893.913955:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b4e expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.913963:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b4e expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144893.913968:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa3b80 00000100:00100000:0.0:1746144893.917906:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.918820:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172456064:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144893.918843:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b55 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.918856:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939c00, rc 0) 00000100:00100000:1.0:1746144893.918902:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175189248:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6289us (7482us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.918912:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5542 00000100:00100000:1.0:1746144893.918933:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175189632 00000100:00100000:1.0:1746144893.918946:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175189632 00000100:00100000:0.0:1746144893.919624:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.920215:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175189760 00000100:00100000:3.0:1746144893.920222:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175189760 00010000:00010000:3.0:1746144893.920244:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b4e expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144893.920264:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10958 00000100:00100000:3.0:1746144893.920270:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5138c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175189760:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.920281:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.920299:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b4e expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.920309:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b4e expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.920327:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275150ea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b4e expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.920340:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.920342:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.920348:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b55 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.920354:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b55 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.920382:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b55 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.920391:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172456192:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.920437:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4178d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144893.920865:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5543 00000100:00100000:1.0:1746144893.920872:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31579:x1830965175189632:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.920883:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.920891:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b5c expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.920906:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b55 expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.920911:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.920912:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.920915:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b5c expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.920928:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b55 expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.920947:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b55 expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144893.920954:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172456320:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144893.920989:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.924805:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.924969:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175190016 00000100:00100000:1.0:1746144893.924976:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175190016 00002000:00100000:1.0:1746144893.925011:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa2300 x1830965175190016/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.925019:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa2300 with x1830965175190016 ext(0->4095) 00010000:00010000:1.0:1746144893.925026:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b55 expref: 20 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144893.925036:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b55 expref: 20 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144893.925042:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa2300 00000100:00100000:1.0:1746144893.925068:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2070 00000100:00100000:1.0:1746144893.925074:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1985:x1830965175190016:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144893.925221:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1985:x1830965175190016:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 146us (421us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.925227:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2070 00002000:00100000:1.0:1746144893.925232:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa2300 x1830965175190016/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.925239:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa2300 with x1830965175190016 ext(0->4095) 00010000:00010000:1.0:1746144893.925243:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b55 expref: 20 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144893.925251:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b55 expref: 20 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144893.925255:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa2300 00000100:00100000:3.0:1746144893.925332:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172456192:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.925346:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.925365:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5138c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175189760:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5095us (5743us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.925371:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10958 00000100:00100000:1.0:1746144893.926245:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172456320:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144893.926261:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b5c expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.926273:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0cb200, rc 0) 00000100:00100000:1.0:1746144893.926307:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31579:x1830965175189632:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5435us (8407us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.926312:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5543 00000100:00100000:0.0:1746144893.929049:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.929525:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.929607:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175190272 00000100:00100000:3.0:1746144893.929615:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175190272 00010000:00010000:3.0:1746144893.929641:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b55 expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144893.930212:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175190144 00000100:00100000:1.0:1746144893.930216:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175190144 00000100:00100000:1.0:1746144893.930251:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5544 00000100:00100000:1.0:1746144893.930257:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31565:x1830965175190144:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.930270:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.930282:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af67275150ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b63 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.930303:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.930307:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b5c expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.930312:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144893.930315:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af67275150ff lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b63 expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.930343:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b5c expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.930353:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af67275150ff lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b63 expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.930361:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0caa00, rc 0) 00000100:00100000:1.0:1746144893.930396:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+21:31565:x1830965175190144:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 139us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.930401:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5544 00000100:00100000:3.0:1746144893.930591:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10959 00000100:00100000:3.0:1746144893.930597:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1985:x1830965175190272:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.930604:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.930622:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b55 expref: 20 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.930631:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b55 expref: 20 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.930644:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a939c00/0x4076af67275150f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b55 expref: 20 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.930657:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.930659:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.930664:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b5c expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.930670:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b5c expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.930687:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b5c expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.930700:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b5c expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144893.930711:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172456576:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.930755:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4178840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.933392:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172456576:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.933407:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.933875:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175190272:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3277us (4348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.933883:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10959 00000100:00100000:2.0:1746144893.934177:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.934278:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175190528 00000100:00100000:0.0:1746144893.934284:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175190528 00002000:00100000:0.0:1746144893.934315:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e831880 x1830965175190528/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144893.934329:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e831880 with x1830965175190528 ext(0->4095) 00010000:00010000:0.0:1746144893.934336:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b5c expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1746144893.934347:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b5c expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:0.0:1746144893.934352:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e831880 00000100:00100000:0.0:1746144893.934631:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2071 00000100:00100000:0.0:1746144893.934638:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175190528:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144893.934797:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175190528:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 159us (619us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144893.934802:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2071 00002000:00100000:0.0:1746144893.934807:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e831880 x1830965175190528/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144893.934813:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e831880 with x1830965175190528 ext(0->4095) 00010000:00010000:0.0:1746144893.934818:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b5c expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1746144893.934826:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b5c expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:0.0:1746144893.934831:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e831880 00000100:00100000:0.0:1746144893.938600:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.939391:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175190656 00000100:00100000:2.0:1746144893.939399:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175190656 00000100:00100000:0.0:1746144893.939644:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.939707:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5545 00000100:00100000:2.0:1746144893.939717:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175190656:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.939732:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.939745:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515106 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b6a expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.939785:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.939790:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af67275150ff lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b63 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.939796:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144893.939799:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515106 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b6a expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.939829:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af67275150ff lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b63 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.939841:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515106 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b6a expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.939849:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1aa00, rc 0) 00000100:00100000:2.0:1746144893.939882:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175190656:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 168us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.939888:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5545 00000100:00100000:3.0:1746144893.939991:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175190784 00000100:00100000:3.0:1746144893.939994:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175190784 00010000:00010000:3.0:1746144893.940008:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b5c expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144893.940022:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10960 00000100:00100000:3.0:1746144893.940026:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175190784:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.940033:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.940047:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b5c expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.940055:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b5c expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.940069:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275150f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b5c expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.940843:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.940846:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.940852:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af67275150ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b63 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.940859:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af67275150ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b63 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.940881:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af67275150ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b63 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.940890:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af67275150ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b63 expref: 18 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144893.940900:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172456832:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.940966:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4178840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.943128:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172456832:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.943145:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.943176:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175190784:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3149us (3532us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.943185:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10960 00000100:00100000:0.0:1746144893.944063:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.944515:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175190912 00000100:00100000:3.0:1746144893.944520:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175190912 00010000:00010000:3.0:1746144893.944544:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af67275150ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b63 expref: 18 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144893.944602:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10961 00000100:00100000:3.0:1746144893.944609:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1982:x1830965175190912:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.944620:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.944638:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af67275150ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b63 expref: 18 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.944648:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af67275150ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b63 expref: 18 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.944666:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af67275150ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b63 expref: 18 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.944678:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.944680:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.944685:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515106 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b6a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.944693:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515106 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b6a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.944718:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515106 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b6a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.944728:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172456960:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.945447:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4178840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.948449:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.948622:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175191168 00000100:00100000:1.0:1746144893.948630:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175191168 00002000:00100000:1.0:1746144893.948664:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092586300 x1830965175191168/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.948672:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092586300 with x1830965175191168 ext(0->4095) 00002000:00010000:1.0:1746144893.948676:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092586300 00000100:00100000:1.0:1746144893.948692:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4067 00000100:00100000:1.0:1746144893.948698:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175191168:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144893.948866:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092586300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175191168:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 167us (424us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.948873:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4067 00002000:00100000:1.0:1746144893.948879:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092586300 x1830965175191168/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.948886:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092586300 with x1830965175191168 ext(0->4095) 00002000:00010000:1.0:1746144893.948888:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092586300 00000100:00100000:3.0:1746144893.948998:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172456960:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.949015:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.949037:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1982:x1830965175190912:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4429us (4975us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.949044:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10961 00000100:00100000:0.0:1746144893.951167:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.951373:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175191296 00000100:00100000:1.0:1746144893.951379:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175191296 00000100:00100000:1.0:1746144893.951647:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5546 00000100:00100000:1.0:1746144893.951654:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+17:31579:x1830965175191296:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.951667:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.951681:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b71 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.951705:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515106 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b6a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.951711:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.951713:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.951715:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b71 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.951738:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515106 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b6a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.951748:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515106 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b6a expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144893.951758:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172457088:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144893.951839:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144893.955589:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.955802:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172457088:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144893.955824:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b71 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.955837:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea47e00, rc 0) 00000100:00100000:1.0:1746144893.955868:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31579:x1830965175191296:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4216us (4706us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.955878:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5546 00000100:00100000:1.0:1746144893.955897:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175191424 00000100:00100000:1.0:1746144893.955900:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175191424 00000100:00100000:1.0:1746144893.955924:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5547 00000100:00100000:1.0:1746144893.955930:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175191424:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144893.955948:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144893.955958:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b78 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.955975:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144893.955978:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b71 expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.955983:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144893.955986:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b78 expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.956008:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b71 expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.956016:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b78 expref: 19 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144893.956022:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939800, rc 0) 00000100:00100000:1.0:1746144893.956037:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31565:x1830965175191424:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 108us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144893.956042:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5547 00000100:00100000:0.0:1746144893.956560:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.956857:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175191552 00000100:00100000:3.0:1746144893.956861:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175191552 00010000:00010000:3.0:1746144893.956878:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515106 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b6a expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144893.956895:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10962 00000100:00100000:3.0:1746144893.956899:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175191552:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.956907:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.956922:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515106 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b6a expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.956932:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515106 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b6a expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.956957:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515106 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b6a expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.956970:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.956971:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.956977:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b71 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.956983:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b71 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.957003:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b71 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.957013:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b71 expref: 18 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144893.957024:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172457344:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.957932:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4178840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.960633:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172457344:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.960653:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.960934:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175191552:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4032us (4372us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.960952:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10962 00000100:00100000:0.0:1746144893.962629:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.962798:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175191808 00000100:00100000:2.0:1746144893.962805:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175191808 00002000:00100000:2.0:1746144893.962839:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f72d80 x1830965175191808/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.962847:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f72d80 with x1830965175191808 ext(0->4095) 00010000:00010000:2.0:1746144893.962855:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b71 expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.962870:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b71 expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144893.962876:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f72d80 00000100:00100000:2.0:1746144893.962900:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2072 00000100:00100000:2.0:1746144893.962906:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175191808:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.963066:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175191808:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 159us (439us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.963072:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2072 00002000:00100000:2.0:1746144893.963077:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f72d80 x1830965175191808/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.963084:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f72d80 with x1830965175191808 ext(0->4095) 00010000:00010000:2.0:1746144893.963089:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b71 expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.963096:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b71 expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144893.963101:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f72d80 00000100:00100000:0.0:1746144893.967703:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.967923:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175191936 00000100:00100000:3.0:1746144893.967931:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175191936 00000100:00100000:3.0:1746144893.968312:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5548 00000100:00100000:3.0:1746144893.968320:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175191936:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144893.968337:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144893.968351:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b7f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.968375:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144893.968380:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b78 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.968391:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144893.968395:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b7f expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.968423:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b78 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.968434:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b7f expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.968443:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:3.0:1746144893.968475:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175191936:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 157us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.968481:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5548 00000100:00100000:0.0:1746144893.968642:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.968730:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175192064 00000100:00100000:2.0:1746144893.968733:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175192064 00010000:00010000:2.0:1746144893.968750:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b71 expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144893.968785:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10963 00000100:00100000:2.0:1746144893.968790:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1982:x1830965175192064:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144893.968796:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144893.968812:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b71 expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.968820:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b71 expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.968833:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea47e00/0x4076af672751510d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b71 expref: 19 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.969163:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.969165:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.969170:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b78 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.969177:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b78 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.969195:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b78 expref: 18 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.969204:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b78 expref: 18 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144893.969213:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172457600:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144893.969968:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.973755:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172457600:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144893.973798:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144893.973847:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1982:x1830965175192064:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5055us (5204us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.973856:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10963 00000100:00100000:0.0:1746144893.975264:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.975513:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175192320 00000100:00100000:1.0:1746144893.975519:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175192320 00002000:00100000:1.0:1746144893.975550:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70e00 x1830965175192320/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.975558:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70e00 with x1830965175192320 ext(0->4095) 00010000:00010000:1.0:1746144893.975565:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b78 expref: 18 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144893.975575:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b78 expref: 18 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144893.975580:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f70e00 00000100:00100000:1.0:1746144893.975674:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2073 00000100:00100000:1.0:1746144893.975680:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175192320:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144893.975851:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175192320:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 169us (590us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.975856:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2073 00002000:00100000:1.0:1746144893.975861:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70e00 x1830965175192320/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.975868:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70e00 with x1830965175192320 ext(0->4095) 00010000:00010000:1.0:1746144893.975872:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b78 expref: 18 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144893.975880:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b78 expref: 18 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144893.975890:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f70e00 00000100:00100000:0.0:1746144893.977624:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144893.978137:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.978449:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175192576 00000100:00100000:3.0:1746144893.978455:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175192576 00010000:00010000:3.0:1746144893.978482:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b78 expref: 18 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144893.978502:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10964 00000100:00100000:3.0:1746144893.978508:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175192576:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.978519:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.978535:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b78 expref: 18 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.978545:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b78 expref: 18 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.978564:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af6727515114 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b78 expref: 18 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.978580:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.978582:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.978587:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b7f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.978594:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b7f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.978620:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b7f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.978630:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172457728:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.978682:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4178840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.978982:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175192448 00000100:00100000:2.0:1746144893.978986:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175192448 00000100:00100000:2.0:1746144893.979019:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5549 00000100:00100000:2.0:1746144893.979025:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175192448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.979035:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.979044:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515122 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b86 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.979058:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b7f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.979064:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.979065:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144893.979068:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515122 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b86 expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.979082:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b7f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.979091:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b7f expref: 5 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144893.979099:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172457856:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.979147:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.982747:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.982857:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172457728:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.982875:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.982906:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175192576:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4398us (4770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.982914:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10964 00000100:00100000:0.0:1746144893.982991:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172457856:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144893.983012:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515122 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b86 expref: 18 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144893.983024:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b600, rc 0) 00000100:00100000:0.0:1746144893.983041:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099699050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175192448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4017us (5422us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144893.983046:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5549 00000100:00100000:2.0:1746144893.983623:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175192832 00000100:00100000:2.0:1746144893.983629:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175192832 00002000:00100000:2.0:1746144893.983658:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e830a80 x1830965175192832/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.983665:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e830a80 with x1830965175192832 ext(0->4095) 00010000:00010000:2.0:1746144893.983670:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b7f expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.983680:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b7f expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144893.983686:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e830a80 00000100:00100000:2.0:1746144893.984287:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2074 00000100:00100000:2.0:1746144893.984296:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175192832:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144893.984424:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175192832:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 131us (1683us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144893.984430:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2074 00002000:00100000:2.0:1746144893.984435:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008e830a80 x1830965175192832/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144893.984441:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e830a80 with x1830965175192832 ext(0->4095) 00010000:00010000:2.0:1746144893.984445:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b7f expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144893.984458:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b7f expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144893.984463:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e830a80 00000100:00100000:0.0:1746144893.987413:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.987507:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175192960 00000100:00100000:3.0:1746144893.987515:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175192960 00010000:00010000:3.0:1746144893.987539:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b7f expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144893.987738:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10965 00000100:00100000:3.0:1746144893.987745:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5138850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175192960:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.987758:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.987794:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b7f expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.987804:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b7f expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.987824:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751511b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b7f expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.988063:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.988065:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.988072:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515122 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b86 expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.988078:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515122 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b86 expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.988103:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515122 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b86 expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.988112:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172457984:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.988380:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4178840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144893.991225:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172457984:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144893.991242:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144893.991275:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5138850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175192960:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3530us (3868us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144893.991283:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10965 00000100:00100000:0.0:1746144893.992595:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144893.992661:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175193216 00000100:00100000:1.0:1746144893.992666:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175193216 00002000:00100000:1.0:1746144893.992696:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70700 x1830965175193216/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/0 e 0 to 0 dl 1746144904 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.992703:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70700 with x1830965175193216 ext(0->4095) 00002000:00010000:1.0:1746144893.992707:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f70700 00000100:00100000:1.0:1746144893.992865:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4068 00000100:00100000:1.0:1746144893.992872:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175193216:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144893.993014:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175193216:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 143us (421us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144893.993020:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4068 00002000:00100000:1.0:1746144893.993024:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70700 x1830965175193216/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:534/0 lens 488/4536 e 0 to 0 dl 1746144904 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144893.993030:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70700 with x1830965175193216 ext(0->4095) 00002000:00010000:1.0:1746144893.993033:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f70700 00000100:00100000:0.0:1746144893.994529:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144893.995213:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175193344 00000100:00100000:2.0:1746144893.995219:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175193344 00000100:00100000:2.0:1746144893.995262:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5550 00000100:00100000:2.0:1746144893.995269:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175193344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144893.995281:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144893.995294:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b8d expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.995316:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515122 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b86 expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.995322:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.995324:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144893.995327:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b8d expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.995351:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515122 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b86 expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.995361:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515122 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b86 expref: 17 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144893.995371:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172458112:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144893.995444:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144893.998844:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172458112:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144893.998871:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b8d expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144893.998885:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b000, rc 0) 00000100:00100000:2.0:1746144893.998918:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175193344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3650us (4392us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144893.998925:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5550 00000100:00100000:0.0:1746144893.999240:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144893.999374:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175193472 00000100:00100000:3.0:1746144893.999380:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175193472 00010000:00010000:3.0:1746144893.999401:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515122 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b86 expref: 18 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144893.999419:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10966 00000100:00100000:3.0:1746144893.999425:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175193472:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144893.999434:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144893.999451:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515122 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b86 expref: 18 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.999460:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515122 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b86 expref: 18 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.999477:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515122 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b86 expref: 18 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144893.999502:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.999505:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144893.999510:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b8d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.999517:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b8d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144893.999540:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b8d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144893.999550:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172458240:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144893.999602:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.002929:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.003044:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175193600 00000100:00100000:2.0:1746144894.003050:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175193600 00000100:00100000:2.0:1746144894.003095:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5551 00000100:00100000:2.0:1746144894.003102:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175193600:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.003117:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.003130:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b94 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.003153:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b8d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.003160:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.003162:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.003165:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b94 expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.003189:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b8d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.003204:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b8d expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.003214:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172458368:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.003281:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.004645:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172458240:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.004659:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.004696:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175193472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5270us (5455us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.004703:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10966 00000100:00100000:0.0:1746144894.005067:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.005171:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172458368:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.005188:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b94 expref: 18 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.005199:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1ac00, rc 0) 00000100:00100000:2.0:1746144894.005219:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+18:31565:x1830965175193600:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2118us (2296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.005224:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5551 00000100:00100000:3.0:1746144894.005472:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175193856 00000100:00100000:3.0:1746144894.005477:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175193856 00002000:00100000:3.0:1746144894.005500:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880136198700 x1830965175193856/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.005508:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136198700 with x1830965175193856 ext(0->4095) 00010000:00010000:3.0:1746144894.005513:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b8d expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.005523:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b8d expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.005530:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136198700 00000100:00100000:3.0:1746144894.005970:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2075 00000100:00100000:3.0:1746144894.005976:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175193856:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144894.006102:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175193856:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 125us (1034us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.006107:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2075 00002000:00100000:3.0:1746144894.006111:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880136198700 x1830965175193856/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.006118:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136198700 with x1830965175193856 ext(0->4095) 00010000:00010000:3.0:1746144894.006122:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b8d expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.006129:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b8d expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.006134:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136198700 00000100:00100000:0.0:1746144894.010230:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.010324:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175193984 00000100:00100000:3.0:1746144894.010333:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175193984 00010000:00010000:3.0:1746144894.010364:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b8d expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.010988:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10967 00000100:00100000:3.0:1746144894.010997:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013619b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175193984:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.011009:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.011028:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b8d expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.011038:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b8d expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.011056:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515129 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b8d expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.011084:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.011086:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.011092:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b94 expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.011100:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b94 expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.011127:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b94 expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.011138:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172458496:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.011206:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.014901:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172458496:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.014918:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.015115:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013619b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175193984:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4118us (4891us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.015125:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10967 00000100:00100000:0.0:1746144894.015573:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.015875:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175194240 00000100:00100000:1.0:1746144894.015881:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175194240 00002000:00100000:1.0:1746144894.015908:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167dc00 x1830965175194240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.015917:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167dc00 with x1830965175194240 ext(0->4095) 00002000:00010000:1.0:1746144894.015921:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167dc00 00000100:00100000:1.0:1746144894.015951:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4069 00000100:00100000:1.0:1746144894.015958:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175194240:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144894.016091:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175194240:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 133us (518us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144894.016096:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4069 00002000:00100000:1.0:1746144894.016101:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009167dc00 x1830965175194240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.016107:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167dc00 with x1830965175194240 ext(0->4095) 00002000:00010000:1.0:1746144894.016110:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167dc00 00000100:00100000:0.0:1746144894.024278:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.024423:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175194368 00000100:00100000:2.0:1746144894.024431:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175194368 00000100:00100000:2.0:1746144894.024475:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5552 00000100:00100000:2.0:1746144894.024481:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175194368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.024495:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.024508:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94b9b expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.024530:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b94 expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.024540:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.024541:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.024544:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b9b expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.024568:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b94 expref: 17 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.024579:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b94 expref: 17 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.024589:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172458624:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.024656:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.029544:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172458624:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.029573:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b9b expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.029586:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1aa00, rc 0) 00000100:00100000:2.0:1746144894.029619:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175194368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5138us (5348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.029627:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5552 00000100:00100000:0.0:1746144894.030492:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.030561:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175194496 00000100:00100000:3.0:1746144894.030566:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175194496 00002000:00100000:3.0:1746144894.030596:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880093857100 x1830965175194496/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.030609:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093857100 with x1830965175194496 ext(0->7) 00010000:00010000:3.0:1746144894.030614:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b94 expref: 18 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.030624:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b94 expref: 18 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.030629:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093857100 00000100:00100000:1.0:1746144894.031003:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2076 00000100:00100000:1.0:1746144894.031011:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175194496:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144894.032190:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1985:x1830965175194496:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 1176us (1695us total) trans 4294968016 rc 0/0 00000100:00100000:1.0:1746144894.032197:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2076 00002000:00100000:1.0:1746144894.032204:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880093857100 x1830965175194496/t4294968016(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/448 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.032211:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093857100 with x1830965175194496 ext(0->7) 00010000:00010000:1.0:1746144894.032217:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b94 expref: 20 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.032226:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b94 expref: 20 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144894.032232:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093857100 00000100:00100000:0.0:1746144894.037046:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.037099:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.037127:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175194752 00000100:00100000:2.0:1746144894.037135:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175194752 00000100:00100000:2.0:1746144894.037187:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5553 00000100:00100000:2.0:1746144894.037194:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31565:x1830965175194752:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.037214:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.037228:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ba2 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.037241:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175194624 00000100:00100000:3.0:1746144894.037245:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175194624 00010000:00010000:2.0:1746144894.037252:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.037257:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b9b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.037259:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b94 expref: 22 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.037262:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144894.037265:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba2 expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.037274:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10968 00000100:00100000:3.0:1746144894.037278:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1982:x1830965175194624:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.037285:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.037296:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b9b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746144894.037298:0:7098:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 1746144893 -> 1746144894 00002000:00010000:3.0:1746144894.037301:0:7098:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 1746144893 -> 1746144894 00010000:00010000:3.0:1746144894.037305:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b94 expref: 22 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.037307:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba2 expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.037315:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b94 expref: 22 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.037442:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.037444:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.037449:0:10401:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b9b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.037456:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b9b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.037473:0:10401:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b9b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.037487:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b9b expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.037496:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172458880:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.037508:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515130 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b94 expref: 22 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.037535:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.037678:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1982:x1830965175194624:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 398us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.037684:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10968 00000100:00100000:2.0:1746144894.037976:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.039249:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172458880:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.039264:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1ae00, rc 0) 00000100:00100000:2.0:1746144894.039289:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31565:x1830965175194752:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2096us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.039294:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5553 00000100:00100000:0.0:1746144894.040138:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.040177:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175195008 00000100:00100000:1.0:1746144894.040185:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175195008 00002000:00100000:1.0:1746144894.040220:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa2d80 x1830965175195008/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.040228:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa2d80 with x1830965175195008 ext(0->4095) 00010000:00010000:1.0:1746144894.040234:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b9b expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.040246:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b9b expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144894.040252:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa2d80 00000100:00100000:1.0:1746144894.040265:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2077 00000100:00100000:1.0:1746144894.040270:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175195008:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144894.040479:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175195008:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 208us (341us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144894.040484:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2077 00002000:00100000:1.0:1746144894.040489:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093fa2d80 x1830965175195008/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.040495:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa2d80 with x1830965175195008 ext(0->4095) 00010000:00010000:1.0:1746144894.040499:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b9b expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.040508:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b9b expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144894.040513:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093fa2d80 00000100:00100000:0.0:1746144894.042055:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.042104:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175195264 00000100:00100000:2.0:1746144894.042109:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175195264 00000100:00100000:2.0:1746144894.042150:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5554 00000100:00100000:2.0:1746144894.042156:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175195264:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.042167:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.042179:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ba9 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.042196:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.042201:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba2 expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.042206:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.042209:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba9 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.042242:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba2 expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.042253:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba9 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.042267:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b000, rc 0) 00000100:00100000:2.0:1746144894.042295:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:31579:x1830965175195264:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 139us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.042301:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5554 00000100:00100000:0.0:1746144894.042381:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.042457:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175195136 00000100:00100000:3.0:1746144894.042460:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175195136 00010000:00010000:3.0:1746144894.042474:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b9b expref: 7 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.042501:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10969 00000100:00100000:3.0:1746144894.042506:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1984:x1830965175195136:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.042514:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.042530:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b9b expref: 7 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.042538:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b9b expref: 7 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.042553:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515137 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94b9b expref: 7 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.042575:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.042577:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.042582:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba2 expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.042593:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba2 expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.042611:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba2 expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.042620:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba2 expref: 19 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.042630:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172459136:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.042675:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.044109:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172459136:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.044122:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.044146:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175195136:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1640us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.044153:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10969 00000100:00100000:0.0:1746144894.044737:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.044862:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175195520 00000100:00100000:1.0:1746144894.044867:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175195520 00002000:00100000:1.0:1746144894.044895:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093f46300 x1830965175195520/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.044904:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f46300 with x1830965175195520 ext(0->4095) 00010000:00010000:1.0:1746144894.044910:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba2 expref: 20 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.044920:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba2 expref: 20 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144894.044926:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f46300 00000100:00100000:1.0:1746144894.044954:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2078 00000100:00100000:1.0:1746144894.044960:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1984:x1830965175195520:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144894.045079:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1984:x1830965175195520:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 119us (344us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144894.045085:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2078 00002000:00100000:1.0:1746144894.045090:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093f46300 x1830965175195520/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.045097:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f46300 with x1830965175195520 ext(0->4095) 00010000:00010000:1.0:1746144894.045101:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba2 expref: 20 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.045109:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba2 expref: 20 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144894.045119:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f46300 00000100:00100000:0.0:1746144894.046714:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.046839:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175195648 00000100:00100000:1.0:1746144894.046844:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175195648 00000100:00100000:1.0:1746144894.046880:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5555 00000100:00100000:1.0:1746144894.046886:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31565:x1830965175195648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.046897:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.046910:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751514c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94bb0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.046933:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.046947:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba9 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.046953:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144894.046956:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751514c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb0 expref: 21 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.046984:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba9 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.046993:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751514c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb0 expref: 21 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.047001:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939800, rc 0) 00000100:00100000:1.0:1746144894.047036:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+21:31565:x1830965175195648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 149us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.047044:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5555 00000100:00100000:0.0:1746144894.047245:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.047565:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175195776 00000100:00100000:3.0:1746144894.047569:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175195776 00010000:00010000:3.0:1746144894.047583:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba2 expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.047599:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10970 00000100:00100000:3.0:1746144894.047605:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1982:x1830965175195776:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.047612:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.047629:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba2 expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.047637:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba2 expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.047652:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751513e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba2 expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.047676:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.047678:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.047683:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba9 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.047689:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba9 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.047706:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba9 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.047715:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba9 expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.047725:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172459392:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.047802:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.049493:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172459392:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.049507:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.049538:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1982:x1830965175195776:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1933us (2292us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.049546:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10970 00000100:00100000:0.0:1746144894.050866:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.050960:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175196032 00000100:00100000:3.0:1746144894.050966:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175196032 00002000:00100000:3.0:1746144894.051001:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093f44000 x1830965175196032/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.051010:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f44000 with x1830965175196032 ext(0->4095) 00010000:00010000:3.0:1746144894.051017:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba9 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.051027:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba9 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.051032:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f44000 00000100:00100000:3.0:1746144894.051057:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2079 00000100:00100000:3.0:1746144894.051063:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175196032:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144894.051182:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175196032:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 119us (318us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.051188:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2079 00002000:00100000:3.0:1746144894.051192:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093f44000 x1830965175196032/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.051199:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f44000 with x1830965175196032 ext(0->4095) 00010000:00010000:3.0:1746144894.051203:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba9 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.051215:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba9 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.051220:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f44000 00000100:00100000:0.0:1746144894.053335:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.053558:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175196160 00000100:00100000:3.0:1746144894.053564:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175196160 00010000:00010000:3.0:1746144894.053588:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba9 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.053622:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10971 00000100:00100000:3.0:1746144894.053629:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175196160:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.053638:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.053655:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba9 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.053666:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba9 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.053684:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515145 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ba9 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.053697:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.053699:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.053705:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751514c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb0 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.053716:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751514c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb0 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.053744:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751514c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb0 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.053754:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172459520:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.053850:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4178b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.057100:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172459520:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.057119:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.057676:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175196160:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4045us (4344us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.057685:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10971 00000100:00100000:0.0:1746144894.058132:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.058297:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175196416 00000100:00100000:1.0:1746144894.058303:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175196416 00002000:00100000:1.0:1746144894.058335:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092584e00 x1830965175196416/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.058343:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092584e00 with x1830965175196416 ext(0->4095) 00002000:00010000:1.0:1746144894.058347:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092584e00 00000100:00100000:1.0:1746144894.058622:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4070 00000100:00100000:1.0:1746144894.058631:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1984:x1830965175196416:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144894.058797:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1984:x1830965175196416:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 167us (665us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144894.058803:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4070 00002000:00100000:1.0:1746144894.058808:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092584e00 x1830965175196416/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.058814:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092584e00 with x1830965175196416 ext(0->4095) 00002000:00010000:1.0:1746144894.058817:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092584e00 00000100:00100000:0.0:1746144894.060524:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.060607:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175196544 00000100:00100000:2.0:1746144894.060615:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175196544 00000100:00100000:2.0:1746144894.060659:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5556 00000100:00100000:2.0:1746144894.060666:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175196544:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.060679:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.060692:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515153 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94bb7 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.060715:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751514c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb0 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.060721:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.060723:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.060726:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515153 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb7 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.060753:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751514c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb0 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.060786:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751514c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb0 expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.060796:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172459648:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.060861:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.063044:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172459648:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.063070:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515153 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb7 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.063083:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b000, rc 0) 00000100:00100000:2.0:1746144894.063129:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175196544:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2463us (2610us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.063137:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5556 00000100:00100000:0.0:1746144894.063448:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.063740:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175196672 00000100:00100000:3.0:1746144894.063745:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175196672 00010000:00010000:3.0:1746144894.063779:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751514c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb0 expref: 20 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.063803:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10972 00000100:00100000:3.0:1746144894.063808:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5138450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1984:x1830965175196672:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.063818:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.063833:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751514c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb0 expref: 20 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.063841:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751514c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb0 expref: 20 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.063858:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751514c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb0 expref: 20 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.064323:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.064325:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.064331:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515153 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb7 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.064338:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515153 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb7 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.064366:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515153 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb7 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.064376:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172459776:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.064437:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4178b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.067859:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172459776:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.067875:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.067921:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5138450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175196672:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4112us (4473us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.067930:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10972 00000100:00100000:0.0:1746144894.068106:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.068137:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.068345:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175197056 00000100:00100000:2.0:1746144894.068352:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175197056 00000100:00100000:3.0:1746144894.068448:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175196928 00000100:00100000:3.0:1746144894.068452:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175196928 00002000:00100000:3.0:1746144894.068476:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b030700 x1830965175196928/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.068490:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b030700 with x1830965175196928 ext(0->4095) 00002000:00010000:3.0:1746144894.068494:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b030700 00000100:00100000:3.0:1746144894.068517:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4071 00000100:00100000:3.0:1746144894.068524:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175196928:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144894.068651:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175196928:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 128us (897us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.068657:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4071 00002000:00100000:3.0:1746144894.068662:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b030700 x1830965175196928/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.068667:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b030700 with x1830965175196928 ext(0->4095) 00002000:00010000:3.0:1746144894.068670:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b030700 00000100:00100000:2.0:1746144894.068711:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5557 00000100:00100000:2.0:1746144894.068717:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31565:x1830965175197056:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.068726:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.068737:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94bbe expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.068756:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515153 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb7 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.068779:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.068781:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.068784:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bbe expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.068808:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515153 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb7 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.068818:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515153 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb7 expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.068828:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172459904:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.069394:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.072170:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.072865:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175197184 00000100:00100000:1.0:1746144894.072873:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175197184 00000100:00100000:1.0:1746144894.072922:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5558 00000100:00100000:1.0:1746144894.072929:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+21:31579:x1830965175197184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.072956:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.072969:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727515161 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94bc5 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.072995:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.073000:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bbe expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.073005:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.073008:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727515161 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bc5 expref: 22 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.073036:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bbe expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.073046:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727515161 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bc5 expref: 22 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.073054:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939000, rc 0) 00000100:00100000:1.0:1746144894.073095:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+22:31579:x1830965175197184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 165us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.073101:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5558 00000100:00100000:2.0:1746144894.074793:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172459904:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.074816:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bbe expref: 21 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.074827:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1a000, rc 0) 00000100:00100000:2.0:1746144894.074860:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+21:31565:x1830965175197056:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6143us (6722us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.074865:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5557 00000100:00100000:0.0:1746144894.075858:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.076074:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175197312 00000100:00100000:3.0:1746144894.076080:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175197312 00010000:00010000:3.0:1746144894.076101:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515153 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb7 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.076148:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10973 00000100:00100000:3.0:1746144894.076153:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b032a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175197312:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.076162:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.076179:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515153 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb7 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.076187:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515153 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb7 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.076204:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515153 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bb7 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.076499:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.076502:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.076508:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bbe expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.076515:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bbe expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.076541:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bbe expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.076551:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bbe expref: 20 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.076560:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172460160:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.076924:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.079216:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172460160:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.079233:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.079660:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b032a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175197312:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3505us (3802us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.079669:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10973 00000100:00100000:0.0:1746144894.080263:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.080396:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175197568 00000100:00100000:2.0:1746144894.080402:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175197568 00002000:00100000:2.0:1746144894.080439:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b033100 x1830965175197568/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.080451:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033100 with x1830965175197568 ext(0->4095) 00010000:00010000:2.0:1746144894.080458:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bbe expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.080468:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bbe expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.080473:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b033100 00000100:00100000:2.0:1746144894.080499:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2080 00000100:00100000:2.0:1746144894.080506:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1984:x1830965175197568:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144894.080653:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1984:x1830965175197568:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 146us (390us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.080658:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2080 00002000:00100000:2.0:1746144894.080663:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b033100 x1830965175197568/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.080669:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033100 with x1830965175197568 ext(0->4095) 00010000:00010000:2.0:1746144894.080673:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bbe expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.080682:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bbe expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.080687:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b033100 00000100:00100000:0.0:1746144894.082822:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.082916:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175197696 00000100:00100000:3.0:1746144894.082922:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175197696 00010000:00010000:3.0:1746144894.082956:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bbe expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.082985:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10974 00000100:00100000:3.0:1746144894.082991:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1984:x1830965175197696:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.083000:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.083017:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bbe expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.083027:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bbe expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.083046:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af672751515a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bbe expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.083061:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.083063:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.083068:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727515161 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bc5 expref: 20 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.083075:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727515161 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bc5 expref: 20 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.083100:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727515161 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bc5 expref: 20 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.083110:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172460288:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.083176:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.085410:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.085533:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172460288:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.085547:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.085921:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175197952 00000100:00100000:2.0:1746144894.085927:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175197952 00002000:00100000:2.0:1746144894.085974:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b031880 x1830965175197952/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.085982:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031880 with x1830965175197952 ext(0->4095) 00002000:00010000:2.0:1746144894.085986:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b031880 00000100:00100000:2.0:1746144894.086003:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4072 00000100:00100000:2.0:1746144894.086010:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1983:x1830965175197952:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:3.0:1746144894.086168:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1984:x1830965175197696:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3176us (3350us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.086176:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10974 00000100:00100000:2.0:1746144894.086790:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1983:x1830965175197952:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 780us (1384us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.086796:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4072 00002000:00100000:2.0:1746144894.086801:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b031880 x1830965175197952/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.086807:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031880 with x1830965175197952 ext(0->4095) 00002000:00010000:2.0:1746144894.086810:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b031880 00000100:00100000:0.0:1746144894.088713:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.088864:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175198080 00000100:00100000:2.0:1746144894.088871:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175198080 00000100:00100000:2.0:1746144894.088912:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5559 00000100:00100000:2.0:1746144894.088920:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175198080:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.088931:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.088952:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515168 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94bcc expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.088976:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727515161 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bc5 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.088986:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.088988:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.088991:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515168 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bcc expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.089013:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727515161 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bc5 expref: 19 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.089022:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727515161 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bc5 expref: 19 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.089033:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172460416:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.089106:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.090312:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172460416:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.090328:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515168 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bcc expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.090338:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1a000, rc 0) 00000100:00100000:2.0:1746144894.090368:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175198080:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1449us (1659us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.090373:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5559 00000100:00100000:0.0:1746144894.091749:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.092181:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175198208 00000100:00100000:3.0:1746144894.092187:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175198208 00010000:00010000:3.0:1746144894.092212:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727515161 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bc5 expref: 20 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.092243:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10975 00000100:00100000:3.0:1746144894.092249:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1984:x1830965175198208:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.092258:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.092275:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727515161 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bc5 expref: 20 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.092285:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727515161 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bc5 expref: 20 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.092302:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af6727515161 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bc5 expref: 20 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.092320:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.092322:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.092328:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515168 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bcc expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.092339:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bcc expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.092364:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bcc expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.092374:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172460544:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.092433:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.094190:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172460544:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.094204:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.094234:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175198208:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1986us (2488us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.094242:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10975 00000100:00100000:0.0:1746144894.094663:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.094901:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175198464 00000100:00100000:3.0:1746144894.094907:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175198464 00002000:00100000:3.0:1746144894.094933:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925ab480 x1830965175198464/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.094951:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab480 with x1830965175198464 ext(0->4095) 00002000:00010000:3.0:1746144894.094955:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925ab480 00000100:00100000:3.0:1746144894.095471:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4073 00000100:00100000:3.0:1746144894.095479:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175198464:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.095631:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175198464:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 151us (967us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.095640:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4073 00002000:00100000:3.0:1746144894.095644:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925ab480 x1830965175198464/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.095651:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab480 with x1830965175198464 ext(0->4095) 00002000:00010000:3.0:1746144894.095654:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925ab480 00000100:00100000:0.0:1746144894.096562:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.096606:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175198592 00000100:00100000:2.0:1746144894.096610:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175198592 00000100:00100000:2.0:1746144894.096650:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5560 00000100:00100000:2.0:1746144894.096656:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+19:31565:x1830965175198592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.096667:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.096680:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94bd3 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.096704:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515168 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bcc expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.096710:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.096711:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.096715:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bd3 expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.096747:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bcc expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.096757:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bcc expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.096785:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172460672:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.096857:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.099749:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172460672:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.099787:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bd3 expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.099799:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1ac00, rc 0) 00000100:00100000:2.0:1746144894.099838:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31565:x1830965175198592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3182us (3278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.099848:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5560 00000100:00100000:0.0:1746144894.100879:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.100913:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.100969:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175198720 00000100:00100000:2.0:1746144894.100974:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175198720 00000100:00100000:2.0:1746144894.100998:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5561 00000100:00100000:2.0:1746144894.101004:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31579:x1830965175198720:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.101015:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.101025:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515176 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94bda expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.101040:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.101044:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bd3 expref: 21 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.101049:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.101051:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515176 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bda expref: 21 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.101072:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bd3 expref: 21 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.101079:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515176 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bda expref: 21 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.101086:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1aa00, rc 0) 00000100:00100000:3.0:1746144894.101161:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175198848 00000100:00100000:3.0:1746144894.101164:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175198848 00010000:00010000:3.0:1746144894.101179:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bcc expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.101197:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10976 00000100:00100000:3.0:1746144894.101202:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175198848:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.101208:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.101222:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515168 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bcc expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.101230:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515168 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bcc expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.101243:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515168 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bcc expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.101861:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+21:31579:x1830965175198720:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 855us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.101867:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5561 00010000:00010000:3.0:1746144894.101962:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.101964:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.101970:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bd3 expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.101982:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bd3 expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.102002:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bd3 expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.102012:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bd3 expref: 20 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.102022:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172460928:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.102075:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.104607:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.105028:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172460928:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.105045:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.105075:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175198848:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3872us (4160us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.105084:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10976 00000100:00100000:2.0:1746144894.105386:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175199104 00000100:00100000:2.0:1746144894.105392:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175199104 00002000:00100000:2.0:1746144894.105425:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925ab100 x1830965175199104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.105433:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab100 with x1830965175199104 ext(0->4095) 00010000:00010000:2.0:1746144894.105440:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bd3 expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.105452:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bd3 expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.105458:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925ab100 00000100:00100000:2.0:1746144894.105480:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2081 00000100:00100000:2.0:1746144894.105486:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1985:x1830965175199104:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144894.105629:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1985:x1830965175199104:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 143us (1028us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.105634:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2081 00002000:00100000:2.0:1746144894.105639:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925ab100 x1830965175199104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.105645:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab100 with x1830965175199104 ext(0->4095) 00010000:00010000:2.0:1746144894.105649:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bd3 expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.105657:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bd3 expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.105667:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925ab100 00000100:00100000:0.0:1746144894.107509:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.107559:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175199232 00000100:00100000:3.0:1746144894.107565:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175199232 00010000:00010000:3.0:1746144894.107583:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bd3 expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.107612:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10977 00000100:00100000:3.0:1746144894.107617:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1985:x1830965175199232:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.107626:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.107645:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bd3 expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.107654:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bd3 expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.107672:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af672751516f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bd3 expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.107683:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.107684:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.107690:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515176 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bda expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.107696:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515176 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bda expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.107720:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515176 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bda expref: 20 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.107731:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172461056:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.108005:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.109421:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172461056:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.109433:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.109468:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1985:x1830965175199232:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1850us (1962us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.109475:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10977 00000100:00100000:0.0:1746144894.110876:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.110990:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175199488 00000100:00100000:3.0:1746144894.110995:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175199488 00002000:00100000:3.0:1746144894.111024:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b461500 x1830965175199488/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.111031:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b461500 with x1830965175199488 ext(0->4095) 00002000:00010000:3.0:1746144894.111035:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b461500 00000100:00100000:3.0:1746144894.111165:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4074 00000100:00100000:3.0:1746144894.111171:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1985:x1830965175199488:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144894.111295:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1985:x1830965175199488:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 124us (422us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.111300:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4074 00002000:00100000:3.0:1746144894.111305:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b461500 x1830965175199488/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.111311:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b461500 with x1830965175199488 ext(0->4095) 00002000:00010000:3.0:1746144894.111314:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b461500 00000100:00100000:0.0:1746144894.117104:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.117206:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175199616 00000100:00100000:2.0:1746144894.117214:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175199616 00000100:00100000:2.0:1746144894.117252:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5562 00000100:00100000:2.0:1746144894.117259:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175199616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.117275:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.117289:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94be1 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.117315:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515176 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bda expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.117322:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.117323:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.117326:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be1 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.117349:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515176 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bda expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.117359:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515176 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bda expref: 19 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.117369:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172461184:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.118419:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.120227:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172461184:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.120254:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be1 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.120267:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b600, rc 0) 00000100:00100000:2.0:1746144894.120329:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175199616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3069us (3231us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.120336:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5562 00000100:00100000:0.0:1746144894.121532:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.121595:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.121741:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175199744 00000100:00100000:2.0:1746144894.121747:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175199744 00000100:00100000:2.0:1746144894.121800:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5563 00000100:00100000:2.0:1746144894.121806:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31565:x1830965175199744:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.121820:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.121831:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94be8 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.121850:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.121855:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be1 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.121859:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144894.121862:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be8 expref: 21 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.121887:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be1 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.121897:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be8 expref: 21 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.121910:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1ac00, rc 0) 00000100:00100000:2.0:1746144894.121951:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+21:31565:x1830965175199744:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 145us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.121957:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5563 00000100:00100000:3.0:1746144894.122536:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175199872 00000100:00100000:3.0:1746144894.122540:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175199872 00010000:00010000:3.0:1746144894.122560:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515176 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bda expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.122578:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10978 00000100:00100000:3.0:1746144894.122582:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1984:x1830965175199872:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.122589:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.122606:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515176 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bda expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.122625:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515176 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bda expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.122640:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af6727515176 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bda expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.122652:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.122653:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.122658:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be1 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.122664:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be1 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.122682:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be1 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.122691:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be1 expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.122701:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172461440:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.122752:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.127299:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.127430:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172461440:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.127448:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.127591:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1984:x1830965175199872:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5005us (5993us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.127608:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10978 00000100:00100000:2.0:1746144894.127676:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175200128 00000100:00100000:2.0:1746144894.127681:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175200128 00002000:00100000:2.0:1746144894.127715:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc7100 x1830965175200128/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.127723:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc7100 with x1830965175200128 ext(0->4095) 00010000:00010000:2.0:1746144894.127729:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be1 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.127740:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be1 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.127745:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bbc7100 00000100:00100000:2.0:1746144894.127783:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2082 00000100:00100000:2.0:1746144894.127790:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175200128:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144894.127910:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175200128:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 121us (619us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.127915:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2082 00002000:00100000:2.0:1746144894.127920:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc7100 x1830965175200128/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.127932:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc7100 with x1830965175200128 ext(0->4095) 00010000:00010000:2.0:1746144894.127945:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be1 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.127953:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be1 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.127958:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bbc7100 00000100:00100000:2.0:1746144894.132152:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.132252:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175200256 00000100:00100000:3.0:1746144894.132260:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175200256 00010000:00010000:3.0:1746144894.132288:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be1 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.132320:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10979 00000100:00100000:3.0:1746144894.132327:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5138050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175200256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.132339:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.132357:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be1 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.132367:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be1 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.132390:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af672751517d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be1 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.132413:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.132415:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.132421:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be8 expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.132429:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be8 expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.132457:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be8 expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.132468:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172461568:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.132537:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a41783c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.135925:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172461568:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.135952:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.135999:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5138050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175200256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3671us (3853us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.136011:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10979 00000100:00100000:0.0:1746144894.136548:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.137269:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175200512 00000100:00100000:3.0:1746144894.137274:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175200512 00002000:00100000:3.0:1746144894.137305:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc4380 x1830965175200512/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.137313:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4380 with x1830965175200512 ext(0->4095) 00002000:00010000:3.0:1746144894.137317:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc4380 00000100:00100000:3.0:1746144894.137344:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4075 00000100:00100000:3.0:1746144894.137350:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1983:x1830965175200512:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:3.0:1746144894.137966:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1983:x1830965175200512:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 615us (1418us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.137973:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4075 00002000:00100000:3.0:1746144894.137978:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc4380 x1830965175200512/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.137985:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4380 with x1830965175200512 ext(0->4095) 00002000:00010000:3.0:1746144894.137988:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc4380 00000100:00100000:0.0:1746144894.144351:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.144439:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175200640 00000100:00100000:2.0:1746144894.144447:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175200640 00000100:00100000:2.0:1746144894.144487:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5564 00000100:00100000:2.0:1746144894.144494:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175200640:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.144510:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.144524:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94bef expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.144549:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be8 expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.144556:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.144557:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.144560:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bef expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.144586:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be8 expref: 19 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.144600:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be8 expref: 19 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.144611:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172461696:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.144690:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.153258:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172461696:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.153286:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bef expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.153301:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1ae00, rc 0) 00000100:00100000:2.0:1746144894.153336:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175200640:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 8842us (8993us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.153344:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5564 00000100:00100000:0.0:1746144894.159202:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.159252:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.159334:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175200896 00000100:00100000:2.0:1746144894.159342:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175200896 00000100:00100000:2.0:1746144894.159384:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5565 00000100:00100000:2.0:1746144894.159391:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+20:31565:x1830965175200896:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.159406:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.159420:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515192 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94bf6 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.159441:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.159446:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bef expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.159455:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144894.159458:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515192 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bf6 expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.159487:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bef expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.159498:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515192 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bf6 expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.159505:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b600, rc 0) 00000100:00100000:2.0:1746144894.159605:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+21:31565:x1830965175200896:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 214us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.159610:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5565 00000100:00100000:3.0:1746144894.159662:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175200768 00000100:00100000:3.0:1746144894.159665:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175200768 00002000:00100000:3.0:1746144894.159686:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009b4fa680 x1830965175200768/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.159695:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4fa680 with x1830965175200768 ext(0->7) 00010000:00010000:3.0:1746144894.159700:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be8 expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.160068:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be8 expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.160074:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b4fa680 00000100:00100000:3.0:1746144894.160086:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2083 00000100:00100000:3.0:1746144894.160091:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1985:x1830965175200768:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144894.160755:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1985:x1830965175200768:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 663us (1564us total) trans 4294968017 rc 0/0 00000100:00100000:3.0:1746144894.160773:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2083 00002000:00100000:3.0:1746144894.160779:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009b4fa680 x1830965175200768/t4294968017(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/448 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.160786:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4fa680 with x1830965175200768 ext(0->7) 00010000:00010000:3.0:1746144894.160790:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be8 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.160799:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be8 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.160808:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b4fa680 00000100:00100000:0.0:1746144894.162461:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.163906:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175201024 00000100:00100000:3.0:1746144894.163914:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175201024 00010000:00010000:3.0:1746144894.163948:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be8 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.163976:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10980 00000100:00100000:3.0:1746144894.163983:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1982:x1830965175201024:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.163991:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.164007:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be8 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.164016:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be8 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.164033:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515184 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94be8 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.164047:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.164049:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.164054:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bef expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.164061:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bef expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.164091:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bef expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.164101:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bef expref: 5 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.164110:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172461952:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.164826:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.167862:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172461952:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.167881:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.168843:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1982:x1830965175201024:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4856us (6382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.168853:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10980 00000100:00100000:1.0:1746144894.169168:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.169374:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175201280 00000100:00100000:3.0:1746144894.169379:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175201280 00002000:00100000:3.0:1746144894.169408:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932a9c00 x1830965175201280/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.169417:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a9c00 with x1830965175201280 ext(0->4095) 00010000:00010000:3.0:1746144894.169424:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bef expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.169434:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bef expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.169439:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932a9c00 00000100:00100000:3.0:1746144894.169460:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2084 00000100:00100000:3.0:1746144894.169465:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175201280:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.169599:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175201280:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 133us (431us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.169605:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2084 00002000:00100000:3.0:1746144894.169609:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932a9c00 x1830965175201280/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.169615:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a9c00 with x1830965175201280 ext(0->4095) 00010000:00010000:3.0:1746144894.169619:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bef expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.169626:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bef expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.169631:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932a9c00 00000100:00100000:0.0:1746144894.173285:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.174022:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175201408 00000100:00100000:3.0:1746144894.174034:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175201408 00010000:00010000:3.0:1746144894.174065:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bef expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.174102:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10981 00000100:00100000:3.0:1746144894.174109:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175201408:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.174122:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.174144:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bef expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.174158:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bef expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.174177:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751518b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bef expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.174201:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.174203:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.174209:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515192 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bf6 expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.174215:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515192 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bf6 expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.174244:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515192 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bf6 expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.174254:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172462080:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.174332:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.177823:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172462080:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.177840:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.177890:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175201408:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3780us (4610us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.177898:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10981 00000100:00100000:0.0:1746144894.178112:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.178476:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175201664 00000100:00100000:2.0:1746144894.178482:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175201664 00002000:00100000:2.0:1746144894.178519:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258e300 x1830965175201664/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.178527:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258e300 with x1830965175201664 ext(0->4095) 00002000:00010000:2.0:1746144894.178531:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258e300 00000100:00100000:2.0:1746144894.178545:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4076 00000100:00100000:2.0:1746144894.178551:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1984:x1830965175201664:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144894.179170:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1984:x1830965175201664:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 617us (1056us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.179180:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4076 00002000:00100000:2.0:1746144894.179185:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258e300 x1830965175201664/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.179192:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258e300 with x1830965175201664 ext(0->4095) 00002000:00010000:2.0:1746144894.179195:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258e300 00000100:00100000:0.0:1746144894.181278:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.181399:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175201792 00000100:00100000:2.0:1746144894.181405:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175201792 00000100:00100000:2.0:1746144894.181498:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5566 00000100:00100000:2.0:1746144894.181507:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175201792:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.181521:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.181534:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94bfd expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.181556:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515192 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bf6 expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.181562:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.181563:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.181566:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bfd expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.181590:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515192 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bf6 expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.181600:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515192 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bf6 expref: 21 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.181615:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172462208:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.182322:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.182928:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172462208:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.182957:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bfd expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.182968:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1a000, rc 0) 00000100:00100000:2.0:1746144894.182993:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175201792:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1488us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.182999:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5566 00000100:00100000:0.0:1746144894.184779:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.184868:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175201920 00000100:00100000:3.0:1746144894.184873:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175201920 00010000:00010000:3.0:1746144894.184893:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515192 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bf6 expref: 22 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.184919:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10982 00000100:00100000:3.0:1746144894.184925:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1985:x1830965175201920:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.184941:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.184958:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515192 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bf6 expref: 22 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.184967:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515192 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bf6 expref: 22 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.184983:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515192 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bf6 expref: 22 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.185047:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.185049:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.185055:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bfd expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.185062:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bfd expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.185086:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bfd expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.185094:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172462336:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.185497:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.188051:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.188171:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172462336:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.188185:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.188526:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1985:x1830965175201920:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3600us (3763us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.188534:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10982 00000100:00100000:2.0:1746144894.188600:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175202048 00000100:00100000:2.0:1746144894.188606:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175202048 00000100:00100000:2.0:1746144894.188639:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5567 00000100:00100000:2.0:1746144894.188644:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+21:31565:x1830965175202048:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.188657:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.188670:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c04 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.188690:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bfd expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.188698:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.188699:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.188702:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c04 expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.188730:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bfd expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.188741:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bfd expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.188750:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172462464:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144894.188926:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.189113:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175202304 00000100:00100000:3.0:1746144894.189116:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175202304 00002000:00100000:3.0:1746144894.189137:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135eaad80 x1830965175202304/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.189394:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135eaad80 with x1830965175202304 ext(0->4095) 00010000:00010000:3.0:1746144894.189400:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bfd expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.189409:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bfd expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.189414:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135eaad80 00000100:00100000:3.0:1746144894.189425:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2085 00000100:00100000:3.0:1746144894.189430:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175202304:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.189549:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175202304:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 118us (623us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.189555:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2085 00002000:00100000:3.0:1746144894.189560:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135eaad80 x1830965175202304/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.189572:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135eaad80 with x1830965175202304 ext(0->4095) 00010000:00010000:3.0:1746144894.189577:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bfd expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.189586:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bfd expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.189591:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135eaad80 00000100:00100000:2.0:1746144894.189904:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.192264:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.192295:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172462464:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144894.192322:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c04 expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.192336:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1ae00, rc 0) 00000100:00100000:3.0:1746144894.192368:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+22:31565:x1830965175202048:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3724us (4323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.192375:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5567 00000100:00100000:3.0:1746144894.192395:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175202432 00000100:00100000:3.0:1746144894.192398:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175202432 00000100:00100000:3.0:1746144894.192454:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5568 00000100:00100000:3.0:1746144894.192459:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+22:31579:x1830965175202432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144894.192470:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144894.192484:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275151a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c0b expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.192500:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.192504:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c04 expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.192509:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144894.192512:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275151a7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c0b expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.192531:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c04 expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.192537:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275151a7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c0b expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.192542:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:3.0:1746144894.192554:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+23:31579:x1830965175202432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 95us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.192559:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5568 00000100:00100000:0.0:1746144894.193835:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.194020:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175202560 00000100:00100000:3.0:1746144894.194025:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175202560 00010000:00010000:3.0:1746144894.194048:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bfd expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.194995:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10983 00000100:00100000:3.0:1746144894.195004:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175202560:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.195021:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.195040:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bfd expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.195060:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bfd expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.195078:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515199 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94bfd expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.195100:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.195102:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.195117:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c04 expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.195125:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c04 expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.195152:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c04 expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.195162:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c04 expref: 22 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.195172:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172462720:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.195247:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.197889:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172462720:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.197902:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144894.197925:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.197946:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175202560:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2943us (4112us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.197955:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10983 00000100:00100000:0.0:1746144894.198171:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175202816 00000100:00100000:0.0:1746144894.198176:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175202816 00002000:00100000:0.0:1746144894.198207:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e81180 x1830965175202816/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144894.198216:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e81180 with x1830965175202816 ext(0->4095) 00010000:00010000:0.0:1746144894.198222:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c04 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1746144894.198233:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c04 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:0.0:1746144894.198239:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e81180 00000100:00100000:0.0:1746144894.198263:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2086 00000100:00100000:0.0:1746144894.198269:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1985:x1830965175202816:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144894.198401:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1985:x1830965175202816:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 131us (476us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144894.198407:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2086 00002000:00100000:0.0:1746144894.198412:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e81180 x1830965175202816/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144894.198418:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e81180 with x1830965175202816 ext(0->4095) 00010000:00010000:0.0:1746144894.198423:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c04 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1746144894.198431:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c04 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:0.0:1746144894.198437:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e81180 00000100:00100000:0.0:1746144894.200681:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.201069:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175202944 00000100:00100000:3.0:1746144894.201077:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175202944 00010000:00010000:3.0:1746144894.201104:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c04 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.201194:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10984 00000100:00100000:3.0:1746144894.201201:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1983:x1830965175202944:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.201212:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.201230:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c04 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.201239:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c04 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.201258:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c04 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.201490:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.201492:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.201498:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275151a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c0b expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.201505:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275151a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c0b expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.201532:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275151a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c0b expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.201543:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172462848:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.202045:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.205281:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.205361:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172462848:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.205378:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.205412:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1983:x1830965175202944:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4211us (4737us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.205420:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10984 00000100:00100000:2.0:1746144894.205490:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175203200 00000100:00100000:2.0:1746144894.205495:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175203200 00002000:00100000:2.0:1746144894.205529:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e80700 x1830965175203200/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.205538:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e80700 with x1830965175203200 ext(0->4095) 00002000:00010000:2.0:1746144894.205542:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e80700 00000100:00100000:2.0:1746144894.205566:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4077 00000100:00100000:2.0:1746144894.205573:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1984:x1830965175203200:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144894.205699:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1984:x1830965175203200:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 126us (424us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.205705:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4077 00002000:00100000:2.0:1746144894.205709:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e80700 x1830965175203200/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.205715:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e80700 with x1830965175203200 ext(0->4095) 00002000:00010000:2.0:1746144894.205717:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e80700 00000100:00100000:0.0:1746144894.208163:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.208262:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175203328 00000100:00100000:1.0:1746144894.208268:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175203328 00000100:00100000:1.0:1746144894.208845:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5569 00000100:00100000:1.0:1746144894.208853:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175203328:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.208867:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.208880:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c12 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.208907:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275151a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c0b expref: 21 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.208913:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.208914:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.208917:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c12 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.208947:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275151a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c0b expref: 21 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.208956:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275151a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c0b expref: 21 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144894.208965:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172462976:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.209286:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144894.210568:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172462976:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.210589:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c12 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.210601:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939000, rc 0) 00000100:00100000:1.0:1746144894.210629:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175203328:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1777us (2471us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.210635:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5569 00000100:00100000:0.0:1746144894.211913:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.212262:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175203456 00000100:00100000:3.0:1746144894.212268:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175203456 00010000:00010000:3.0:1746144894.212289:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275151a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c0b expref: 22 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.212338:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10985 00000100:00100000:3.0:1746144894.212344:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1984:x1830965175203456:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.212354:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.212370:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275151a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c0b expref: 22 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.212379:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275151a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c0b expref: 22 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.212396:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275151a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c0b expref: 22 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.212419:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.212421:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.212426:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c12 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.212432:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c12 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.212456:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c12 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.212465:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172463104:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.212990:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.215594:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.215676:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.215711:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175203840 00000100:00100000:0.0:1746144894.215717:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175203840 00000100:00100000:0.0:1746144894.215786:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5570 00000100:00100000:0.0:1746144894.215794:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+22:31565:x1830965175203840:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144894.215809:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144894.215822:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c19 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.215844:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c12 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.215849:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144894.215851:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144894.215854:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c19 expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.215874:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c12 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.215883:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c12 expref: 5 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:0.0:1746144894.215892:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bae1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172463232:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144894.215954:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.216065:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172463104:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.216079:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.216100:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965175203456:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3756us (4190us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.216107:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10985 00000100:00100000:1.0:1746144894.216171:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175203712 00000100:00100000:1.0:1746144894.216174:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175203712 00002000:00100000:1.0:1746144894.216193:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230f800 x1830965175203712/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.216201:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230f800 with x1830965175203712 ext(0->4095) 00010000:00010000:1.0:1746144894.216206:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c12 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.216214:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c12 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144894.216220:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230f800 00000100:00100000:1.0:1746144894.216230:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2087 00000100:00100000:1.0:1746144894.216234:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175203712:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144894.216347:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175203712:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 112us (760us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144894.216352:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2087 00002000:00100000:1.0:1746144894.216356:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230f800 x1830965175203712/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.216363:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230f800 with x1830965175203712 ext(0->4095) 00010000:00010000:1.0:1746144894.216366:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c12 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.216374:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c12 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144894.216379:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230f800 00000100:00100000:1.0:1746144894.220146:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.220148:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bae1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172463232:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144894.220231:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c19 expref: 22 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.220245:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b3000, rc 0) 00000100:00100000:0.0:1746144894.220278:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+22:31565:x1830965175203840:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4486us (4602us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144894.220286:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5570 00000100:00100000:0.0:1746144894.220567:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175203968 00000100:00100000:0.0:1746144894.220572:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175203968 00000100:00100000:0.0:1746144894.220607:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5571 00000100:00100000:0.0:1746144894.220613:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+22:31579:x1830965175203968:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144894.220625:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144894.220637:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af67275151bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c20 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.220652:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144894.220656:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c19 expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.220661:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144894.220664:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af67275151bc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c20 expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.220687:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c19 expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.220695:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af67275151bc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c20 expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.220707:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b2600, rc 0) 00000100:00100000:0.0:1746144894.220726:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+23:31579:x1830965175203968:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 114us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144894.220731:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5571 00000100:00100000:0.0:1746144894.222272:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.222318:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175204096 00000100:00100000:3.0:1746144894.222323:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175204096 00010000:00010000:3.0:1746144894.222343:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c12 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.222374:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10986 00000100:00100000:3.0:1746144894.222379:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175204096:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.222388:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.222403:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c12 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.222416:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c12 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.222432:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a939000/0x4076af67275151ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c12 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.222455:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.222456:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.222462:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c19 expref: 22 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.222469:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c19 expref: 22 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.222491:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c19 expref: 22 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.222499:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c19 expref: 22 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.222509:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172463488:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.222575:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a7db40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.224885:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172463488:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.224901:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.224932:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175204096:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2552us (2662us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.224955:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10986 00000100:00100000:0.0:1746144894.227064:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.227264:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175204352 00000100:00100000:3.0:1746144894.227272:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175204352 00002000:00100000:3.0:1746144894.227310:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bae1f80 x1830965175204352/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.227319:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae1f80 with x1830965175204352 ext(0->4095) 00010000:00010000:3.0:1746144894.227327:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c19 expref: 23 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.227338:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c19 expref: 23 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.227344:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bae1f80 00000100:00100000:3.0:1746144894.227370:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2088 00000100:00100000:3.0:1746144894.227376:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1985:x1830965175204352:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144894.227509:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1985:x1830965175204352:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 133us (451us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.227514:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2088 00002000:00100000:3.0:1746144894.227519:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bae1f80 x1830965175204352/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.227526:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae1f80 with x1830965175204352 ext(0->4095) 00010000:00010000:3.0:1746144894.227530:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c19 expref: 23 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.227542:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c19 expref: 23 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.227547:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bae1f80 00000100:00100000:0.0:1746144894.230015:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.230268:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175204480 00000100:00100000:3.0:1746144894.230277:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175204480 00010000:00010000:3.0:1746144894.230304:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c19 expref: 23 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.230340:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10987 00000100:00100000:3.0:1746144894.230347:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965175204480:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.230359:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.230377:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c19 expref: 23 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.230387:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c19 expref: 23 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.230404:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275151b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c19 expref: 23 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.230431:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.230433:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.230439:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af67275151bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c20 expref: 22 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.230449:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af67275151bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c20 expref: 22 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.230477:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af67275151bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c20 expref: 22 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.230488:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172463616:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.230546:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.232834:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.233044:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175204736 00000100:00100000:1.0:1746144894.233050:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175204736 00002000:00100000:1.0:1746144894.233083:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bae0a80 x1830965175204736/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.233090:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae0a80 with x1830965175204736 ext(0->4095) 00002000:00010000:1.0:1746144894.233094:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae0a80 00000100:00100000:3.0:1746144894.233251:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172463616:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.233265:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.233298:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965175204480:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2951us (3288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.233305:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10987 00000100:00100000:1.0:1746144894.233434:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4078 00000100:00100000:1.0:1746144894.233441:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1984:x1830965175204736:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144894.233571:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1984:x1830965175204736:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 130us (743us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144894.233576:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4078 00002000:00100000:1.0:1746144894.233581:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bae0a80 x1830965175204736/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.233587:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae0a80 with x1830965175204736 ext(0->4095) 00002000:00010000:1.0:1746144894.233589:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae0a80 00000100:00100000:0.0:1746144894.236923:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.237326:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175204864 00000100:00100000:2.0:1746144894.237333:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175204864 00000100:00100000:2.0:1746144894.237376:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5572 00000100:00100000:2.0:1746144894.237383:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175204864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.237397:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.237409:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275151c3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c27 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.237431:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af67275151bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c20 expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.237438:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.237439:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.237443:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275151c3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c27 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.237466:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af67275151bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c20 expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.237476:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af67275151bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c20 expref: 21 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.237485:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172463744:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.237557:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.239560:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e830700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172463744:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.239590:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275151c3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c27 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.239607:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b600, rc 0) 00000100:00100000:2.0:1746144894.239641:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175204864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2258us (2724us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.239648:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5572 00000100:00100000:0.0:1746144894.240637:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.241127:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175204992 00000100:00100000:3.0:1746144894.241133:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175204992 00010000:00010000:3.0:1746144894.241157:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af67275151bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c20 expref: 22 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.241184:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10988 00000100:00100000:3.0:1746144894.241189:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1985:x1830965175204992:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.241198:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.241213:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af67275151bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c20 expref: 22 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.241226:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af67275151bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c20 expref: 22 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.241242:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af67275151bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c20 expref: 22 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.241261:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.241263:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.241268:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275151c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c27 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.241274:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275151c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c27 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.241295:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275151c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c27 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.241308:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172463872:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.241371:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb540 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.243654:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172463872:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.243671:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144894.243683:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.243754:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1985:x1830965175204992:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2564us (3118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.243788:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10988 00000100:00100000:2.0:1746144894.244049:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175205248 00000100:00100000:2.0:1746144894.244055:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175205248 00002000:00100000:2.0:1746144894.244088:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924d8380 x1830965175205248/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.244097:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d8380 with x1830965175205248 ext(0->4095) 00002000:00010000:2.0:1746144894.244100:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d8380 00000100:00100000:2.0:1746144894.244123:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4079 00000100:00100000:2.0:1746144894.244130:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175205248:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144894.244151:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.244266:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175205248:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 136us (582us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.244272:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4079 00002000:00100000:2.0:1746144894.244277:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924d8380 x1830965175205248/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.244284:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d8380 with x1830965175205248 ext(0->4095) 00002000:00010000:2.0:1746144894.244286:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d8380 00000100:00100000:3.0:1746144894.244374:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175205376 00000100:00100000:3.0:1746144894.244379:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175205376 00000100:00100000:3.0:1746144894.244397:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5573 00000100:00100000:3.0:1746144894.244402:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+21:31565:x1830965175205376:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144894.244410:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144894.244421:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c2e expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.244440:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275151c3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c27 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.244446:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.244448:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.244451:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c2e expref: 22 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.244472:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275151c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c27 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.244482:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275151c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c27 expref: 5 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.244492:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172464000:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144894.244529:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.247560:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.247737:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175205504 00000100:00100000:1.0:1746144894.247743:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175205504 00000100:00100000:1.0:1746144894.247799:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5574 00000100:00100000:1.0:1746144894.247806:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+23:31579:x1830965175205504:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.247820:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.247831:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275151d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c35 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.247850:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.247856:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c2e expref: 24 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.247861:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.247864:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275151d1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c35 expref: 24 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.247892:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c2e expref: 24 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.247903:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275151d1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c35 expref: 24 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.247912:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0cb200, rc 0) 00000100:00100000:1.0:1746144894.247961:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+24:31579:x1830965175205504:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 155us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.247967:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5574 00000100:00100000:3.0:1746144894.248184:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172464000:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144894.248198:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c2e expref: 23 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.248209:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:3.0:1746144894.248228:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+23:31565:x1830965175205376:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3826us (4077us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.248233:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5573 00000100:00100000:0.0:1746144894.248356:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.248830:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175205632 00000100:00100000:3.0:1746144894.248833:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175205632 00010000:00010000:3.0:1746144894.248846:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275151c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c27 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.248870:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10989 00000100:00100000:3.0:1746144894.248875:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175205632:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.248883:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.248898:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275151c3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c27 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.248908:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275151c3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c27 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.248923:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af67275151c3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c27 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.248942:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.248944:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.248948:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c2e expref: 22 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.248959:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c2e expref: 22 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.248975:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c2e expref: 22 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.248984:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c2e expref: 22 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.248993:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172464256:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.249037:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb540 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.252008:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172464256:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.252024:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.252065:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175205632:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3189us (3709us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.252073:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10989 00000100:00100000:0.0:1746144894.253841:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.253879:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175205888 00000100:00100000:1.0:1746144894.253885:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175205888 00002000:00100000:1.0:1746144894.253917:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924da680 x1830965175205888/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.253926:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924da680 with x1830965175205888 ext(0->4095) 00010000:00010000:1.0:1746144894.253963:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c2e expref: 23 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.253975:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c2e expref: 23 pid: 8432 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144894.253985:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924da680 00000100:00100000:1.0:1746144894.254011:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2089 00000100:00100000:1.0:1746144894.254018:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1985:x1830965175205888:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144894.254418:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1985:x1830965175205888:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 400us (582us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144894.254424:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2089 00002000:00100000:1.0:1746144894.254429:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924da680 x1830965175205888/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.254435:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924da680 with x1830965175205888 ext(0->4095) 00010000:00010000:1.0:1746144894.254440:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c2e expref: 23 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.254448:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c2e expref: 23 pid: 8432 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144894.254453:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800924da680 00000100:00100000:0.0:1746144894.256733:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.257014:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175206016 00000100:00100000:3.0:1746144894.257021:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175206016 00010000:00010000:3.0:1746144894.257047:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c2e expref: 23 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.257091:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10990 00000100:00100000:3.0:1746144894.257098:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1982:x1830965175206016:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.257109:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.257126:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c2e expref: 23 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.257136:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c2e expref: 23 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.257153:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275151ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c2e expref: 23 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.257181:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.257183:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.257188:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275151d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c35 expref: 22 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.257195:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275151d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c35 expref: 22 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.257221:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275151d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c35 expref: 22 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.257231:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172464384:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.257300:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.260310:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.260501:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175206272 00000100:00100000:1.0:1746144894.260508:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175206272 00002000:00100000:1.0:1746144894.260541:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924d9f80 x1830965175206272/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.260549:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d9f80 with x1830965175206272 ext(0->4095) 00002000:00010000:1.0:1746144894.260553:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d9f80 00000100:00100000:1.0:1746144894.260580:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4080 00000100:00100000:1.0:1746144894.260587:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965175206272:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.260705:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172464384:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.260719:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.260746:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1982:x1830965175206016:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3649us (4020us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.260752:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10990 00000100:00100000:1.0:1746144894.261283:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1984:x1830965175206272:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 695us (979us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144894.261289:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4080 00002000:00100000:1.0:1746144894.261294:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800924d9f80 x1830965175206272/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.261301:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d9f80 with x1830965175206272 ext(0->4095) 00002000:00010000:1.0:1746144894.261304:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800924d9f80 00000100:00100000:0.0:1746144894.263576:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.263674:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175206400 00000100:00100000:3.0:1746144894.263681:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175206400 00000100:00100000:2.0:1746144894.263875:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5575 00000100:00100000:2.0:1746144894.263887:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175206400:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.263904:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.263919:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151d8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c3c expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.263950:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275151d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c35 expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.263957:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.263959:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.263961:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151d8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c3c expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.263986:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275151d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c35 expref: 21 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.263995:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275151d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c35 expref: 21 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.264005:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172464512:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.264071:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.266525:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172464512:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.266550:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151d8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c3c expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.266563:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b000, rc 0) 00000100:00100000:2.0:1746144894.266595:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175206400:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2713us (3025us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.266605:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5575 00000100:00100000:0.0:1746144894.268870:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.268964:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175206528 00000100:00100000:3.0:1746144894.268971:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175206528 00010000:00010000:3.0:1746144894.268999:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275151d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c35 expref: 22 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.269035:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10991 00000100:00100000:3.0:1746144894.269042:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1985:x1830965175206528:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.269053:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.269071:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275151d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c35 expref: 22 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.269081:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275151d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c35 expref: 22 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.269100:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275151d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c35 expref: 22 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.269116:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.269117:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.269123:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c3c expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.269130:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c3c expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.269157:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c3c expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.269168:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172464640:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.269704:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.271721:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.272396:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.272421:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175206912 00000100:00100000:0.0:1746144894.272427:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175206912 00002000:00100000:0.0:1746144894.272465:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b0a80 x1830965175206912/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144894.272473:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b0a80 with x1830965175206912 ext(0->4095) 00002000:00010000:0.0:1746144894.272478:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012a2b0a80 00000100:00100000:0.0:1746144894.272493:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4081 00000100:00100000:0.0:1746144894.272499:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175206912:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144894.272635:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175206912:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 135us (239us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144894.272641:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4081 00002000:00100000:0.0:1746144894.272646:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b0a80 x1830965175206912/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144894.272652:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b0a80 with x1830965175206912 ext(0->4095) 00002000:00010000:0.0:1746144894.272655:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012a2b0a80 00000100:00100000:3.0:1746144894.272906:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172464640:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.272920:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.272948:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1985:x1830965175206528:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3907us (4084us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.272954:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10991 00000100:00100000:2.0:1746144894.273436:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175206656 00000100:00100000:2.0:1746144894.273442:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175206656 00000100:00100000:2.0:1746144894.273478:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5576 00000100:00100000:2.0:1746144894.273484:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+21:31565:x1830965175206656:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.273493:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.273505:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c43 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.273524:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151d8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c3c expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.273530:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.273531:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.273534:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c43 expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.273557:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c3c expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.273567:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c3c expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.273577:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172464768:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.273624:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.275492:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.275709:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175207040 00000100:00100000:3.0:1746144894.275714:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175207040 00000100:00100000:0.0:1746144894.276113:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.276168:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5577 00000100:00100000:3.0:1746144894.276175:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+23:31579:x1830965175207040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144894.276188:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144894.276200:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c4a expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.276219:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.276224:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c43 expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.276229:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144894.276232:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c4a expref: 24 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.276258:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c43 expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.276273:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c4a expref: 24 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.276281:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:3.0:1746144894.276313:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+24:31579:x1830965175207040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 138us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.276318:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5577 00000100:00100000:3.0:1746144894.276335:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175207168 00000100:00100000:3.0:1746144894.276338:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175207168 00010000:00010000:3.0:1746144894.276349:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151d8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c3c expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.276720:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172464768:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.276739:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c43 expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.276746:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1ae00, rc 0) 00000100:00100000:2.0:1746144894.276777:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+23:31565:x1830965175206656:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3293us (5062us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.276782:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5576 00000100:00100000:2.0:1746144894.277455:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10992 00000100:00100000:2.0:1746144894.277464:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175207168:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.277474:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.277492:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151d8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c3c expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.277502:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151d8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c3c expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.277516:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151d8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c3c expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.277541:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.277542:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.277547:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c43 expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.277553:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c43 expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.277577:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c43 expref: 22 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.277587:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c43 expref: 22 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.277598:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172465024:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.277646:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.279277:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172465024:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.279296:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.279333:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175207168:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1870us (3219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.279340:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10992 00000100:00100000:0.0:1746144894.279995:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.280069:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175207424 00000100:00100000:3.0:1746144894.280076:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175207424 00002000:00100000:3.0:1746144894.280107:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b1500 x1830965175207424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.280115:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b1500 with x1830965175207424 ext(0->4095) 00010000:00010000:3.0:1746144894.280121:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c43 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.280132:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c43 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.280138:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012a2b1500 00000100:00100000:3.0:1746144894.280163:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2090 00000100:00100000:3.0:1746144894.280169:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965175207424:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.280307:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965175207424:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 138us (312us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.280323:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2090 00002000:00100000:3.0:1746144894.280328:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b1500 x1830965175207424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.280336:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b1500 with x1830965175207424 ext(0->4095) 00010000:00010000:3.0:1746144894.280344:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c43 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.280352:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c43 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.280358:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012a2b1500 00000100:00100000:0.0:1746144894.282483:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.282558:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175207552 00000100:00100000:2.0:1746144894.282564:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175207552 00010000:00010000:2.0:1746144894.282588:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c43 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.282675:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10993 00000100:00100000:2.0:1746144894.282683:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1985:x1830965175207552:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.282694:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.282711:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c43 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.282725:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c43 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.282743:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af67275151df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c43 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.283014:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.283016:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.283022:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c4a expref: 22 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.283030:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c4a expref: 22 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.283060:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c4a expref: 22 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.283070:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172465152:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.283510:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.285068:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172465152:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.285087:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.285416:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50df850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1985:x1830965175207552:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2733us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.285425:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10993 00000100:00100000:0.0:1746144894.285568:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.285588:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175207808 00000100:00100000:0.0:1746144894.285593:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175207808 00002000:00100000:0.0:1746144894.285621:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b1880 x1830965175207808/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144894.285628:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b1880 with x1830965175207808 ext(0->4095) 00002000:00010000:0.0:1746144894.285632:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012a2b1880 00000100:00100000:0.0:1746144894.285659:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4082 00000100:00100000:0.0:1746144894.285665:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1984:x1830965175207808:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144894.285810:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1984:x1830965175207808:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 145us (242us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144894.285817:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4082 00002000:00100000:0.0:1746144894.285821:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b1880 x1830965175207808/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144894.285828:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b1880 with x1830965175207808 ext(0->4095) 00002000:00010000:0.0:1746144894.285831:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012a2b1880 00000100:00100000:1.0:1746144894.289842:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.289900:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175207936 00000100:00100000:3.0:1746144894.289908:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175207936 00000100:00100000:3.0:1746144894.289965:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5578 00000100:00100000:3.0:1746144894.289972:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175207936:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144894.289988:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144894.290002:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c51 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.290025:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c4a expref: 21 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.290031:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144894.290033:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144894.290036:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c51 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.290605:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c4a expref: 21 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.290616:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c4a expref: 21 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.290628:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172465280:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144894.290806:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.293041:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172465280:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144894.293062:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c51 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.293076:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:3.0:1746144894.293188:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175207936:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3215us (3353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.293195:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5578 00000100:00100000:0.0:1746144894.294228:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.294285:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175208064 00000100:00100000:2.0:1746144894.294292:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175208064 00002000:00100000:2.0:1746144894.294333:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88012a2b0e00 x1830965175208064/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.294342:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b0e00 with x1830965175208064 ext(0->7) 00010000:00010000:2.0:1746144894.294348:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c4a expref: 22 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.294359:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c4a expref: 22 pid: 8432 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.294365:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012a2b0e00 00000100:00100000:2.0:1746144894.294391:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2091 00000100:00100000:2.0:1746144894.294398:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1985:x1830965175208064:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144894.294664:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1985:x1830965175208064:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 266us (437us total) trans 4294968018 rc 0/0 00000100:00100000:2.0:1746144894.294670:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2091 00002000:00100000:2.0:1746144894.294676:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88012a2b0e00 x1830965175208064/t4294968018(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/448 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.294682:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b0e00 with x1830965175208064 ext(0->7) 00010000:00010000:2.0:1746144894.294687:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c4a expref: 24 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.294695:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c4a expref: 24 pid: 8432 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.294700:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012a2b0e00 00000100:00100000:0.0:1746144894.315498:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.316032:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.316079:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175208320 00000100:00100000:2.0:1746144894.316088:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175208320 00000100:00100000:3.0:1746144894.316096:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175208192 00000100:00100000:3.0:1746144894.316099:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175208192 00010000:00010000:2.0:1746144894.316122:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c4a expref: 25 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.316143:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10994 00000100:00100000:2.0:1746144894.316151:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1984:x1830965175208320:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.316161:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.316177:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c4a expref: 25 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.316187:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c4a expref: 25 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.316204:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275151e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c4a expref: 25 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.316218:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.316220:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.316225:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c51 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.316232:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c51 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.316277:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c51 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.316294:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172465408:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.316349:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.316613:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5579 00000100:00100000:3.0:1746144894.316621:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+24:31565:x1830965175208192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144894.316634:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144894.316642:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275151f4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c58 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.316661:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c51 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.316666:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.316667:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.316669:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275151f4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c58 expref: 25 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.316683:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c51 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.316691:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c51 expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.316698:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172465536:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144894.316722:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.321267:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.321347:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172465408:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.321367:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144894.321375:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172465536:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144894.321391:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275151f4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c58 expref: 25 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.321404:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:2.0:1746144894.321567:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1984:x1830965175208320:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5416us (5534us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.321577:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10994 00000100:00100000:3.0:1746144894.321609:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175208576 00000100:00100000:3.0:1746144894.321614:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175208576 00002000:00100000:3.0:1746144894.321714:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368700 x1830965175208576/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.321723:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368700 with x1830965175208576 ext(0->4095) 00010000:00010000:3.0:1746144894.321728:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c51 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:0.0:1746144894.321747:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+24:31565:x1830965175208192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5127us (6256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144894.321753:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5579 00010000:00010000:3.0:1746144894.321834:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c51 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.321845:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093368700 00000100:00100000:3.0:1746144894.321861:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2092 00000100:00100000:3.0:1746144894.321867:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175208576:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144894.321994:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175208576:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 127us (734us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.321999:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2092 00002000:00100000:3.0:1746144894.322003:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368700 x1830965175208576/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.322010:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368700 with x1830965175208576 ext(0->4095) 00010000:00010000:3.0:1746144894.322014:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c51 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.322022:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c51 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.322027:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093368700 00000100:00100000:0.0:1746144894.324848:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.324892:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.324985:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175208832 00000100:00100000:2.0:1746144894.324993:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175208832 00000100:00100000:3.0:1746144894.325214:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175208704 00000100:00100000:3.0:1746144894.325218:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175208704 00010000:00010000:3.0:1746144894.325238:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c51 expref: 7 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.325259:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10995 00000100:00100000:3.0:1746144894.325264:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1984:x1830965175208704:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.325275:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.325293:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c51 expref: 7 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.325303:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c51 expref: 7 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.325322:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275151ed lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c51 expref: 7 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.325349:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.325351:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.325357:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275151f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c58 expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.325364:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275151f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c58 expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.325392:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275151f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c58 expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.325403:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172465664:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.325461:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.325481:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5580 00000100:00100000:2.0:1746144894.325619:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175208832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.325631:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.325641:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c5f expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.325659:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275151f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c58 expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.325664:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.325666:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.325669:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151fb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c5f expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.325684:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275151f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c58 expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.325697:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275151f4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c58 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.325705:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172465792:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.325724:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.328620:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172465664:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.328637:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.328707:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1984:x1830965175208704:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3441us (3813us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.328716:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10995 00000100:00100000:0.0:1746144894.329583:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.329666:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172465792:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.329688:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151fb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c5f expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.329701:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b000, rc 0) 00000100:00100000:2.0:1746144894.329730:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175208832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4243us (4889us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.329735:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5580 00000100:00100000:3.0:1746144894.329779:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175208960 00000100:00100000:3.0:1746144894.329784:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175208960 00010000:00010000:3.0:1746144894.329801:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275151f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c58 expref: 24 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.329826:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10996 00000100:00100000:3.0:1746144894.329831:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1984:x1830965175208960:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.329841:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.329858:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275151f4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c58 expref: 24 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.329867:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275151f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c58 expref: 24 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.329885:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275151f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c58 expref: 24 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.329897:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.329898:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.329903:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c5f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.329910:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c5f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.329944:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c5f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.329959:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172465920:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.330010:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.332052:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.332262:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175209216 00000100:00100000:2.0:1746144894.332268:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175209216 00002000:00100000:2.0:1746144894.332302:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ae40e00 x1830965175209216/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.332311:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae40e00 with x1830965175209216 ext(0->4095) 00002000:00010000:2.0:1746144894.332315:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae40e00 00000100:00100000:3.0:1746144894.332554:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172465920:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.332575:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.332650:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4083 00000100:00100000:2.0:1746144894.332659:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175209216:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:3.0:1746144894.332720:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965175208960:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2887us (3137us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.332727:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10996 00000100:00100000:2.0:1746144894.332870:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175209216:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 212us (823us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.332878:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4083 00002000:00100000:2.0:1746144894.332882:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ae40e00 x1830965175209216/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.332888:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae40e00 with x1830965175209216 ext(0->4095) 00002000:00010000:2.0:1746144894.332891:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae40e00 00000100:00100000:0.0:1746144894.335145:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.335261:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175209344 00000100:00100000:2.0:1746144894.335268:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175209344 00000100:00100000:2.0:1746144894.335316:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5581 00000100:00100000:2.0:1746144894.335323:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+23:31579:x1830965175209344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.335337:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.335349:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c66 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.335393:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c5f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.335400:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.335401:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.335405:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c66 expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.335429:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c5f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.335439:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c5f expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.335455:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172466048:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.335616:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.337577:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e833480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172466048:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.337603:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c66 expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.337617:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b600, rc 0) 00000100:00100000:2.0:1746144894.337648:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+24:31579:x1830965175209344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2325us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.337655:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5581 00000100:00100000:0.0:1746144894.338757:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.339109:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175209472 00000100:00100000:3.0:1746144894.339116:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175209472 00010000:00010000:3.0:1746144894.339141:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c5f expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.339174:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10997 00000100:00100000:3.0:1746144894.339180:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175209472:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.339191:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.339208:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c5f expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.339218:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c5f expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.339235:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275151fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c5f expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.339250:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.339252:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.339257:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c66 expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.339264:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c66 expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.339295:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c66 expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.339305:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172466176:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.339360:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.340107:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.340988:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175209600 00000100:00100000:3.0:1746144894.340994:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175209600 00000100:00100000:3.0:1746144894.341349:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5582 00000100:00100000:3.0:1746144894.341357:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+24:31565:x1830965175209600:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144894.341370:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144894.341382:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c6d expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.341403:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c66 expref: 25 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.341409:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144894.341411:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144894.341413:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c6d expref: 25 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.341434:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c66 expref: 25 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.341445:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c66 expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.341454:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172466304:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144894.342144:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.342855:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172466176:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.342868:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.343295:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175209472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4113us (4538us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.343302:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10997 00000100:00100000:0.0:1746144894.344120:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.344472:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172466304:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144894.344491:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c6d expref: 25 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.344505:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:2.0:1746144894.344620:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175209856 00000100:00100000:2.0:1746144894.344625:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175209856 00002000:00100000:2.0:1746144894.344657:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e38e00 x1830965175209856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.344665:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38e00 with x1830965175209856 ext(0->4095) 00010000:00010000:2.0:1746144894.344671:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c66 expref: 26 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.344682:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c66 expref: 26 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.344687:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e38e00 00000100:00100000:3.0:1746144894.344868:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+26:31565:x1830965175209600:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3512us (4762us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.344875:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5582 00000100:00100000:2.0:1746144894.345185:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2093 00000100:00100000:2.0:1746144894.345194:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1984:x1830965175209856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144894.345330:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1984:x1830965175209856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 137us (1211us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.345336:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2093 00002000:00100000:2.0:1746144894.345341:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e38e00 x1830965175209856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.345349:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38e00 with x1830965175209856 ext(0->4095) 00010000:00010000:2.0:1746144894.345353:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c66 expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.345362:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c66 expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.345368:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e38e00 00000100:00100000:0.0:1746144894.348572:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.348737:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175209984 00000100:00100000:3.0:1746144894.348745:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175209984 00000100:00100000:3.0:1746144894.349174:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5583 00000100:00100000:3.0:1746144894.349182:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175209984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144894.349197:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144894.349210:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c74 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.349231:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144894.349236:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c6d expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.349241:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144894.349244:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c74 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.349272:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c6d expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.349282:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c74 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.349290:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:3.0:1746144894.349325:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175209984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 144us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.349330:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5583 00000100:00100000:0.0:1746144894.349500:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.349825:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175210112 00000100:00100000:2.0:1746144894.349830:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175210112 00010000:00010000:2.0:1746144894.349852:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c66 expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.349869:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10998 00000100:00100000:2.0:1746144894.349875:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1984:x1830965175210112:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.349883:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.349900:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c66 expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.349914:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c66 expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.349930:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515202 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c66 expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.349955:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.349957:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.349962:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c6d expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.349968:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c6d expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.350596:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c6d expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.350607:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c6d expref: 24 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.350617:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172466560:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.350738:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.352438:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172466560:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.352457:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.352497:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1984:x1830965175210112:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2621us (2995us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.352508:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10998 00000100:00100000:0.0:1746144894.354415:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.355080:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175210368 00000100:00100000:1.0:1746144894.355088:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175210368 00002000:00100000:1.0:1746144894.355126:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e39180 x1830965175210368/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.355135:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e39180 with x1830965175210368 ext(0->4095) 00010000:00010000:1.0:1746144894.355142:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c6d expref: 24 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.355154:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c6d expref: 24 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144894.355160:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e39180 00000100:00100000:1.0:1746144894.355312:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2094 00000100:00100000:1.0:1746144894.355320:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1984:x1830965175210368:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144894.355859:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1984:x1830965175210368:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 538us (1447us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144894.355865:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2094 00002000:00100000:1.0:1746144894.355872:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e39180 x1830965175210368/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.355878:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e39180 with x1830965175210368 ext(0->4095) 00010000:00010000:1.0:1746144894.355883:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c6d expref: 24 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.355892:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c6d expref: 24 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144894.355897:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e39180 00000100:00100000:0.0:1746144894.358138:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.358210:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.358378:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175210496 00000100:00100000:1.0:1746144894.358384:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175210496 00000100:00100000:1.0:1746144894.358429:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5584 00000100:00100000:1.0:1746144894.358436:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+24:31565:x1830965175210496:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.358450:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.358465:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515217 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c7b expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.358486:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.358491:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c74 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.358496:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144894.358499:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515217 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c7b expref: 25 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.358536:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c74 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.358546:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515217 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c7b expref: 25 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.358555:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0cb200, rc 0) 00000100:00100000:1.0:1746144894.358587:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+25:31565:x1830965175210496:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 152us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.358592:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5584 00000100:00100000:2.0:1746144894.358654:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175210624 00000100:00100000:2.0:1746144894.358658:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175210624 00010000:00010000:2.0:1746144894.358677:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c6d expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.358693:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10999 00000100:00100000:2.0:1746144894.358698:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1985:x1830965175210624:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.358705:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.358722:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c6d expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.358731:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c6d expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.358746:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515209 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c6d expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.358758:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.358760:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.358789:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c74 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.358796:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c74 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.358814:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c74 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.358825:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c74 expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.358835:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172466816:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.358880:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.361722:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172466816:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.361741:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.361826:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1985:x1830965175210624:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3126us (3614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.361835:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10999 00000100:00100000:0.0:1746144894.361907:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.361975:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175210880 00000100:00100000:0.0:1746144894.361980:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175210880 00002000:00100000:0.0:1746144894.362011:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea7480 x1830965175210880/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144894.362019:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea7480 with x1830965175210880 ext(0->4095) 00010000:00010000:0.0:1746144894.362025:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c74 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1746144894.362036:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c74 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:0.0:1746144894.362041:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea7480 00000100:00100000:0.0:1746144894.362053:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2095 00000100:00100000:0.0:1746144894.362059:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175210880:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144894.362199:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175210880:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 140us (292us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144894.362204:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2095 00002000:00100000:0.0:1746144894.362208:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea7480 x1830965175210880/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144894.362215:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea7480 with x1830965175210880 ext(0->4095) 00010000:00010000:0.0:1746144894.362221:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c74 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1746144894.362229:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c74 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:0.0:1746144894.362234:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea7480 00000100:00100000:0.0:1746144894.365183:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.365614:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175211008 00000100:00100000:2.0:1746144894.365622:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175211008 00010000:00010000:2.0:1746144894.365652:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c74 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.366278:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11000 00000100:00100000:2.0:1746144894.366286:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175211008:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.366299:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.366317:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c74 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.366328:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c74 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.366347:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515210 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c74 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.366373:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.366376:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.366381:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515217 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c7b expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.366388:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515217 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c7b expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.366415:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515217 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c7b expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.366426:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172466944:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.367017:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a43f40c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.369234:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.369340:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172466944:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.369359:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.369405:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175211008:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3119us (4228us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.369414:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11000 00000100:00100000:3.0:1746144894.369512:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175211264 00000100:00100000:3.0:1746144894.369517:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175211264 00002000:00100000:3.0:1746144894.369547:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea5c00 x1830965175211264/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.369556:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5c00 with x1830965175211264 ext(0->4095) 00002000:00010000:3.0:1746144894.369560:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea5c00 00000100:00100000:3.0:1746144894.369585:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4084 00000100:00100000:3.0:1746144894.369593:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1985:x1830965175211264:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144894.369720:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1985:x1830965175211264:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 128us (492us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.369725:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4084 00002000:00100000:3.0:1746144894.369730:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea5c00 x1830965175211264/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.369737:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5c00 with x1830965175211264 ext(0->4095) 00002000:00010000:3.0:1746144894.369739:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea5c00 00000100:00100000:0.0:1746144894.371839:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.371907:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175211392 00000100:00100000:3.0:1746144894.371912:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175211392 00000100:00100000:3.0:1746144894.372029:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5585 00000100:00100000:3.0:1746144894.372037:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175211392:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144894.372050:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144894.372064:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751521e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c82 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.372085:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515217 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c7b expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.372419:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144894.372421:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144894.372425:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751521e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c82 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.372451:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515217 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c7b expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.372466:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515217 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c7b expref: 23 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.372477:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172467072:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144894.372552:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb540 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.375951:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172467072:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144894.375977:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751521e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c82 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.375992:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:3.0:1746144894.376038:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175211392:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4001us (4202us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.376045:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5585 00000100:00100000:0.0:1746144894.376259:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.376433:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175211520 00000100:00100000:3.0:1746144894.376438:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175211520 00010000:00010000:3.0:1746144894.376456:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515217 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c7b expref: 24 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.376489:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11001 00000100:00100000:3.0:1746144894.376496:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1984:x1830965175211520:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.376506:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.376524:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515217 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c7b expref: 24 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.376537:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515217 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c7b expref: 24 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.376555:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515217 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c7b expref: 24 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.376582:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.376584:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.376590:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751521e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c82 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.376597:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751521e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c82 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.376621:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751521e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c82 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.376631:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172467200:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.376693:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.381081:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.381122:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.381140:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175211776 00000100:00100000:1.0:1746144894.381151:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175211776 00002000:00100000:1.0:1746144894.381186:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea5880 x1830965175211776/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.381196:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5880 with x1830965175211776 ext(0->4095) 00002000:00010000:1.0:1746144894.381200:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea5880 00000100:00100000:1.0:1746144894.381215:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4085 00000100:00100000:1.0:1746144894.381221:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175211776:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.381413:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172467200:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.381427:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.381924:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175211904 00000100:00100000:2.0:1746144894.381928:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175211904 00000100:00100000:2.0:1746144894.381970:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5586 00000100:00100000:2.0:1746144894.381976:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+24:31565:x1830965175211904:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.381983:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.381994:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c89 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.382019:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751521e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c82 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.382025:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.382026:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.382029:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c89 expref: 25 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.382052:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751521e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c82 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.382062:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751521e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c82 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.382072:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172467328:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.382422:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175211776:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 1200us (1348us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.382425:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1984:x1830965175211520:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5930us (6167us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.382429:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4085 00000100:00100000:3.0:1746144894.382432:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11001 00002000:00100000:1.0:1746144894.382434:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea5880 x1830965175211776/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.382445:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5880 with x1830965175211776 ext(0->4095) 00010000:00010000:1.0:1746144894.382450:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751521e lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c82 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.382457:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751521e lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c82 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144894.382462:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea5880 00000100:00100000:2.0:1746144894.382815:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.385507:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.385818:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175212032 00000100:00100000:1.0:1746144894.385826:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175212032 00000100:00100000:1.0:1746144894.385904:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5587 00000100:00100000:1.0:1746144894.385912:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+25:31579:x1830965175212032:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.385927:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.385950:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af672751522c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c90 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.385971:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.385976:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c89 expref: 26 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.385980:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.385983:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af672751522c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c90 expref: 26 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.386010:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c89 expref: 26 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.386024:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af672751522c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c90 expref: 26 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.386032:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0cb200, rc 0) 00000100:00100000:2.0:1746144894.386129:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172467328:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.386146:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c89 expref: 26 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.386153:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1a000, rc 0) 00000100:00100000:1.0:1746144894.386642:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+26:31579:x1830965175212032:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 730us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.386648:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5587 00000100:00100000:2.0:1746144894.386863:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+25:31565:x1830965175211904:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4886us (5739us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.386869:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5586 00000100:00100000:0.0:1746144894.387000:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.387161:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175212160 00000100:00100000:2.0:1746144894.387165:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175212160 00010000:00010000:2.0:1746144894.387181:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751521e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c82 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.387296:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11002 00000100:00100000:2.0:1746144894.387303:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175212160:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.387312:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.387328:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751521e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c82 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.387337:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751521e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c82 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.387351:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751521e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c82 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.387374:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.387376:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.387381:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c89 expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.387388:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c89 expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.387406:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c89 expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.387414:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c89 expref: 24 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.387424:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172467584:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.387475:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.390561:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172467584:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.390579:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.390627:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175212160:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3324us (3626us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.390636:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11002 00000100:00100000:0.0:1746144894.391639:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.392170:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175212416 00000100:00100000:0.0:1746144894.392176:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175212416 00002000:00100000:0.0:1746144894.392211:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612ea00 x1830965175212416/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144894.392220:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ea00 with x1830965175212416 ext(0->4095) 00010000:00010000:0.0:1746144894.392227:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c89 expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1746144894.392240:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c89 expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:0.0:1746144894.392246:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612ea00 00000100:00100000:0.0:1746144894.392267:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2096 00000100:00100000:0.0:1746144894.392273:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1984:x1830965175212416:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144894.392469:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1984:x1830965175212416:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 196us (833us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144894.392475:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2096 00002000:00100000:0.0:1746144894.392480:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612ea00 x1830965175212416/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144894.392487:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ea00 with x1830965175212416 ext(0->4095) 00010000:00010000:0.0:1746144894.392492:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c89 expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1746144894.392500:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c89 expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:0.0:1746144894.392505:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612ea00 00000100:00100000:2.0:1746144894.395357:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.395502:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175212544 00000100:00100000:0.0:1746144894.395508:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175212544 00010000:00010000:0.0:1746144894.395540:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c89 expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:0.0:1746144894.395574:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11003 00000100:00100000:0.0:1746144894.395581:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1985:x1830965175212544:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144894.395593:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144894.395619:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c89 expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1746144894.395633:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c89 expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1746144894.395651:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af6727515225 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c89 expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1746144894.395666:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144894.395668:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144894.395673:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af672751522c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c90 expref: 24 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.395680:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af672751522c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c90 expref: 24 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.395706:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af672751522c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c90 expref: 24 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144894.395717:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d367b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172467712:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144894.395801:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.401390:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d367b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172467712:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.401412:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.401458:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1985:x1830965175212544:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5875us (6104us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.401466:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11003 00000100:00100000:0.0:1746144894.401573:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.401971:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175212800 00000100:00100000:2.0:1746144894.401977:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175212800 00002000:00100000:2.0:1746144894.402006:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d367100 x1830965175212800/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.402015:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d367100 with x1830965175212800 ext(0->4095) 00002000:00010000:2.0:1746144894.402019:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d367100 00000100:00100000:2.0:1746144894.402042:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4086 00000100:00100000:2.0:1746144894.402047:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1985:x1830965175212800:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144894.402166:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1985:x1830965175212800:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 119us (594us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.402174:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4086 00002000:00100000:2.0:1746144894.402179:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d367100 x1830965175212800/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.402185:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d367100 with x1830965175212800 ext(0->4095) 00002000:00010000:2.0:1746144894.402187:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d367100 00000100:00100000:0.0:1746144894.405507:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.405752:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175212928 00000100:00100000:2.0:1746144894.405812:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175212928 00000100:00100000:2.0:1746144894.405860:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5588 00000100:00100000:2.0:1746144894.405867:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175212928:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.405880:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.405892:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c97 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.405915:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af672751522c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c90 expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.405921:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.405923:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.405925:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c97 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.405962:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af672751522c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c90 expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.405972:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af672751522c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c90 expref: 23 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.405986:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172467840:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.406051:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.409012:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172467840:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.409043:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c97 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.409058:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b000, rc 0) 00000100:00100000:2.0:1746144894.409094:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175212928:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3227us (3594us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.409102:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5588 00000100:00100000:0.0:1746144894.409505:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.409902:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175213056 00000100:00100000:2.0:1746144894.409907:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175213056 00010000:00010000:2.0:1746144894.409928:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af672751522c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c90 expref: 24 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.409969:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11004 00000100:00100000:2.0:1746144894.409975:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1985:x1830965175213056:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.409988:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.410005:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af672751522c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c90 expref: 24 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.410013:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af672751522c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c90 expref: 24 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.410035:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af672751522c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c90 expref: 24 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.410450:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.410452:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.410459:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c97 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.410466:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c97 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.410492:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c97 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.410502:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e832d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172467968:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.410803:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.412730:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.413295:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175213184 00000100:00100000:2.0:1746144894.413303:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175213184 00000100:00100000:2.0:1746144894.413357:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5589 00000100:00100000:2.0:1746144894.413365:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+24:31565:x1830965175213184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.413381:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.413395:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94c9e expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.413419:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c97 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.413430:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.413432:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.413435:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c9e expref: 25 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.413461:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c97 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.413472:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c97 expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.413482:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009336aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172468096:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.413550:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.414263:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e832d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172467968:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.414278:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.414303:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1985:x1830965175213056:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4328us (4799us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.414311:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11004 00000100:00100000:1.0:1746144894.414391:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.414746:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175213440 00000100:00100000:2.0:1746144894.414749:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175213440 00002000:00100000:2.0:1746144894.414897:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932aa300 x1830965175213440/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.414906:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932aa300 with x1830965175213440 ext(0->4095) 00010000:00010000:2.0:1746144894.414912:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c97 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.414928:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c97 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.414945:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932aa300 00000100:00100000:2.0:1746144894.414969:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2097 00000100:00100000:2.0:1746144894.414976:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175213440:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144894.415854:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175213440:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 876us (1460us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.415861:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2097 00002000:00100000:2.0:1746144894.415867:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932aa300 x1830965175213440/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.415874:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932aa300 with x1830965175213440 ext(0->4095) 00010000:00010000:2.0:1746144894.415879:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c97 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.415889:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c97 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.415895:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932aa300 00000100:00100000:2.0:1746144894.416505:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009336aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172468096:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.416527:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c9e expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.416538:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1aa00, rc 0) 00000100:00100000:2.0:1746144894.416573:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+24:31565:x1830965175213184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3209us (3849us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.416579:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5589 00000100:00100000:0.0:1746144894.417926:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.418000:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175213568 00000100:00100000:2.0:1746144894.418005:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175213568 00000100:00100000:2.0:1746144894.418169:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5590 00000100:00100000:2.0:1746144894.418176:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+24:31579:x1830965175213568:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.418189:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.418200:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727515241 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ca5 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.418217:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.418221:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c9e expref: 25 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.418226:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.418229:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727515241 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ca5 expref: 25 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.418253:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c9e expref: 25 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.418261:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727515241 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ca5 expref: 25 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.418268:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094376600, rc 0) 00000100:00100000:2.0:1746144894.418288:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+25:31579:x1830965175213568:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 114us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.418296:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5590 00000100:00100000:0.0:1746144894.423276:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.423354:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175213696 00000100:00100000:2.0:1746144894.423361:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175213696 00010000:00010000:2.0:1746144894.423391:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c97 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.423422:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11005 00000100:00100000:2.0:1746144894.423428:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d367b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175213696:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.423438:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.423454:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c97 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.423464:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c97 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.423480:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515233 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c97 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.423494:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.423495:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.423501:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c9e expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.423507:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c9e expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.423530:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c9e expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.423539:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c9e expref: 24 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.423547:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009336aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172468352:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.423616:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.426332:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009336aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172468352:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.426358:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.426391:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d367b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175213696:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2962us (3120us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.426400:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11005 00000100:00100000:0.0:1746144894.426823:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.427540:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175213952 00000100:00100000:2.0:1746144894.427548:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175213952 00002000:00100000:2.0:1746144894.427583:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398d500 x1830965175213952/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.427592:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398d500 with x1830965175213952 ext(0->4095) 00010000:00010000:2.0:1746144894.427599:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c9e expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.427610:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c9e expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.427617:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398d500 00000100:00100000:2.0:1746144894.427633:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2098 00000100:00100000:2.0:1746144894.427639:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1984:x1830965175213952:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144894.427979:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1984:x1830965175213952:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 339us (1155us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.427985:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2098 00002000:00100000:2.0:1746144894.427990:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398d500 x1830965175213952/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.427996:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398d500 with x1830965175213952 ext(0->4095) 00010000:00010000:2.0:1746144894.428000:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c9e expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.428009:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c9e expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.428014:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398d500 00000100:00100000:0.0:1746144894.431137:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.431498:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175214080 00000100:00100000:2.0:1746144894.431505:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175214080 00010000:00010000:2.0:1746144894.431538:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c9e expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.431575:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11006 00000100:00100000:2.0:1746144894.431582:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1984:x1830965175214080:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.431595:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.431611:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c9e expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.431621:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c9e expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.431640:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1aa00/0x4076af672751523a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94c9e expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.431655:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.431657:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.431663:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727515241 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ca5 expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.431670:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727515241 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ca5 expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.431697:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727515241 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ca5 expref: 24 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.431708:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009336aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172468480:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.431802:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.433978:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009336aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172468480:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.433998:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.434026:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1984:x1830965175214080:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2445us (2896us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.434034:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11006 00000100:00100000:0.0:1746144894.437834:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.437972:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175214336 00000100:00100000:2.0:1746144894.437981:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175214336 00002000:00100000:2.0:1746144894.438021:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398f100 x1830965175214336/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.438036:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398f100 with x1830965175214336 ext(0->4095) 00002000:00010000:2.0:1746144894.438041:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398f100 00000100:00100000:2.0:1746144894.438067:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4087 00000100:00100000:2.0:1746144894.438074:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1982:x1830965175214336:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746144894.438220:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1982:x1830965175214336:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 145us (392us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.438226:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4087 00002000:00100000:2.0:1746144894.438232:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398f100 x1830965175214336/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.438239:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398f100 with x1830965175214336 ext(0->4095) 00002000:00010000:2.0:1746144894.438241:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398f100 00000100:00100000:0.0:1746144894.442039:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.442136:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175214464 00000100:00100000:1.0:1746144894.442144:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175214464 00000100:00100000:1.0:1746144894.442191:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5591 00000100:00100000:1.0:1746144894.442202:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175214464:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.442216:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.442229:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94cac expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.442252:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727515241 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ca5 expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.442258:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.442260:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.442263:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cac expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.442284:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727515241 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ca5 expref: 23 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.442297:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727515241 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ca5 expref: 23 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144894.442723:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172468608:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.443712:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144894.446660:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172468608:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.446687:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cac expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.446701:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0cb200, rc 0) 00000100:00100000:1.0:1746144894.446737:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175214464:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4535us (4704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.446744:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5591 00000100:00100000:0.0:1746144894.447144:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.447180:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.447255:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175214720 00000100:00100000:2.0:1746144894.447261:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175214720 00010000:00010000:2.0:1746144894.447288:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727515241 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ca5 expref: 24 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.447309:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11007 00000100:00100000:2.0:1746144894.447315:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1985:x1830965175214720:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.447325:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.447344:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727515241 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ca5 expref: 24 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.447354:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727515241 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ca5 expref: 24 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.447374:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af6727515241 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ca5 expref: 24 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.447387:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.447389:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.447395:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cac expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.447402:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cac expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.447428:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cac expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.447437:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009336aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172468736:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144894.449010:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175214592 00000100:00100000:1.0:1746144894.449017:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175214592 00000100:00100000:1.0:1746144894.449054:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5592 00000100:00100000:1.0:1746144894.449060:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013619b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+24:31565:x1830965175214592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.449072:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.449084:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94cb3 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.449101:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cac expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.449111:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.449113:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.449116:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cb3 expref: 25 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.449134:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cac expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.449143:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cac expref: 5 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144894.449151:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172468864:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.449611:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f309c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144894.449650:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.451802:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.451829:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175214976 00000100:00100000:3.0:1746144894.451838:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175214976 00002000:00100000:3.0:1746144894.451869:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f71180 x1830965175214976/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.451879:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f71180 with x1830965175214976 ext(0->4095) 00010000:00010000:3.0:1746144894.451885:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cac expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.451897:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cac expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.451902:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f71180 00000100:00100000:3.0:1746144894.451918:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2099 00000100:00100000:3.0:1746144894.451924:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175214976:12345-192.168.202.16@tcp:3:ldlm_bl.0 00000100:00100000:3.0:1746144894.452636:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175214976:12345-192.168.202.16@tcp:3:ldlm_bl.0 Request processed in 709us (838us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.452642:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2099 00002000:00100000:3.0:1746144894.452648:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f71180 x1830965175214976/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.452656:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f71180 with x1830965175214976 ext(0->4095) 00010000:00010000:3.0:1746144894.452661:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cac expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.452671:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cac expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.452676:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f71180 00000100:00100000:1.0:1746144894.453044:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172468864:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.453063:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cb3 expref: 25 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.453075:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939800, rc 0) 00000100:00100000:2.0:1746144894.453213:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009336aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172468736:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.453229:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144894.453258:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013619b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+25:31565:x1830965175214592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4198us (6114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.453263:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5592 00000100:00100000:2.0:1746144894.453635:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50df050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1985:x1830965175214720:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6318us (6452us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.453643:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11007 00000100:00100000:2.0:1746144894.456563:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.456755:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175215104 00000100:00100000:1.0:1746144894.456788:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175215104 00000100:00100000:2.0:1746144894.457746:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.457778:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175215232 00000100:00100000:2.0:1746144894.457781:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175215232 00010000:00010000:2.0:1746144894.457804:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cac expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.457824:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11008 00000100:00100000:2.0:1746144894.457829:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175215232:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.457840:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.457857:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cac expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.457867:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cac expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.457886:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515248 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cac expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.457900:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.457901:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.457907:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cb3 expref: 24 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.457915:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cb3 expref: 24 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.457955:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cb3 expref: 24 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.457965:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009336a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172468992:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.458019:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144894.458177:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5593 00000100:00100000:1.0:1746144894.458183:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+24:31579:x1830965175215104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.458195:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.458204:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727515256 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94cba expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.458217:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cb3 expref: 25 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.458222:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.458224:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.458226:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727515256 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cba expref: 25 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.458239:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cb3 expref: 25 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.458247:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cb3 expref: 25 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144894.458255:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172469120:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.458286:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.460488:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009336a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172468992:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.460511:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.460553:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175215232:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2723us (2809us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.460562:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11008 00000100:00100000:0.0:1746144894.461177:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.461398:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175215488 00000100:00100000:2.0:1746144894.461405:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175215488 00002000:00100000:2.0:1746144894.461438:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258b100 x1830965175215488/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.461446:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258b100 with x1830965175215488 ext(0->4095) 00010000:00010000:2.0:1746144894.461453:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cb3 expref: 26 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.461465:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cb3 expref: 26 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.461471:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258b100 00000100:00100000:2.0:1746144894.461487:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2100 00000100:00100000:2.0:1746144894.461493:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1984:x1830965175215488:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144894.461619:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172469120:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.461634:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727515256 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cba expref: 26 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.461645:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cdc00, rc 0) 00000100:00100000:1.0:1746144894.461668:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+26:31579:x1830965175215104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3486us (5113us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.461676:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5593 00000100:00100000:2.0:1746144894.461816:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1984:x1830965175215488:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 323us (645us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.461822:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2100 00002000:00100000:2.0:1746144894.461827:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258b100 x1830965175215488/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.461834:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258b100 with x1830965175215488 ext(0->4095) 00010000:00010000:2.0:1746144894.461839:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cb3 expref: 25 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.461847:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cb3 expref: 25 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.461852:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258b100 00000100:00100000:0.0:1746144894.466606:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.468036:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175215616 00000100:00100000:2.0:1746144894.468049:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175215616 00010000:00010000:2.0:1746144894.468088:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cb3 expref: 25 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.468121:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11009 00000100:00100000:2.0:1746144894.468129:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1983:x1830965175215616:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.468142:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.468161:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cb3 expref: 25 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.468173:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cb3 expref: 25 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.468191:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a939800/0x4076af672751524f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cb3 expref: 25 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.468227:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.468229:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.468236:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727515256 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cba expref: 24 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.468247:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727515256 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cba expref: 24 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.468278:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727515256 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cba expref: 24 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.468290:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009336a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172469248:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.468386:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.472220:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.472271:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009336a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172469248:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.472302:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.472354:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1983:x1830965175215616:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4226us (5758us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.472363:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11009 00000100:00100000:3.0:1746144894.472433:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175215872 00000100:00100000:3.0:1746144894.472439:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175215872 00002000:00100000:3.0:1746144894.472465:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ec000 x1830965175215872/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.472475:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec000 with x1830965175215872 ext(0->4095) 00002000:00010000:3.0:1746144894.472478:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ec000 00000100:00100000:3.0:1746144894.472491:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4088 00000100:00100000:3.0:1746144894.472495:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1984:x1830965175215872:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.472631:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1984:x1830965175215872:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 135us (420us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.472637:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4088 00002000:00100000:3.0:1746144894.472641:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ec000 x1830965175215872/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.472648:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec000 with x1830965175215872 ext(0->4095) 00002000:00010000:3.0:1746144894.472651:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ec000 00000100:00100000:0.0:1746144894.476844:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.477081:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175216000 00000100:00100000:1.0:1746144894.477089:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175216000 00000100:00100000:1.0:1746144894.478730:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5594 00000100:00100000:1.0:1746144894.478747:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175216000:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.478774:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.478789:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94cc1 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.478813:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727515256 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cba expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.478820:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.478822:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.478825:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc1 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.478847:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727515256 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cba expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.478857:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727515256 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cba expref: 23 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144894.478867:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172469376:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.478951:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144894.481186:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172469376:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.481211:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc1 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.481225:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cc800, rc 0) 00000100:00100000:1.0:1746144894.481256:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175216000:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2514us (4418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.481262:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5594 00000100:00100000:0.0:1746144894.483412:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.483447:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.483507:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175216256 00000100:00100000:3.0:1746144894.483514:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175216256 00010000:00010000:3.0:1746144894.483543:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727515256 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cba expref: 24 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.483577:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11010 00000100:00100000:3.0:1746144894.483584:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1985:x1830965175216256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.483595:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.483618:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727515256 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cba expref: 24 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.483635:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727515256 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cba expref: 24 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.483653:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cdc00/0x4076af6727515256 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cba expref: 24 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.483674:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.483676:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.483681:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc1 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.483688:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc1 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144894.483739:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175216128 00000100:00100000:1.0:1746144894.483742:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175216128 00010000:00010000:3.0:1746144894.484098:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc1 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.484109:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172469504:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144894.484175:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5595 00000100:00100000:1.0:1746144894.484181:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+24:31565:x1830965175216128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.484191:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.484200:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94cc8 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.484214:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc1 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.484219:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.484220:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.484223:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc8 expref: 25 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.484238:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc1 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.484246:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc1 expref: 5 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144894.484254:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172469632:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144894.484538:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144894.484585:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144894.486890:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172469632:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.486923:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc8 expref: 25 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.486949:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cc000, rc 0) 00000100:00100000:1.0:1746144894.487005:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+25:31565:x1830965175216128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2823us (3596us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.487014:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5595 00000100:00100000:2.0:1746144894.487268:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.487342:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175216512 00000100:00100000:3.0:1746144894.487349:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175216512 00002000:00100000:3.0:1746144894.487452:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336a680 x1830965175216512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.487461:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336a680 with x1830965175216512 ext(0->4095) 00010000:00010000:3.0:1746144894.487468:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc1 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.487483:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc1 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.487488:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009336a680 00000100:00100000:3.0:1746144894.487514:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2101 00000100:00100000:3.0:1746144894.487520:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175216512:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.487668:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175216512:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 146us (406us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.487675:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2101 00002000:00100000:3.0:1746144894.487680:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336a680 x1830965175216512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.487687:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336a680 with x1830965175216512 ext(0->4095) 00010000:00010000:3.0:1746144894.487691:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc1 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.487699:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc1 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.487704:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009336a680 00000100:00100000:3.0:1746144894.487737:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172469504:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.487749:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.487812:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1985:x1830965175216256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4228us (4362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.487821:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11010 00000100:00100000:0.0:1746144894.492191:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.492331:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175216640 00000100:00100000:2.0:1746144894.492342:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175216640 00010000:00010000:2.0:1746144894.492384:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc1 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.492693:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11011 00000100:00100000:2.0:1746144894.492702:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175216640:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.492717:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.492740:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc1 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.492758:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc1 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.492811:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751525d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc1 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.492838:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.492840:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.492847:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc8 expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.492855:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc8 expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.492901:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc8 expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.492914:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172469760:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.493012:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.496586:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172469760:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.496638:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.497117:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175216640:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4414us (4935us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.497127:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11011 00000100:00100000:0.0:1746144894.498832:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.498909:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175216896 00000100:00100000:3.0:1746144894.498915:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175216896 00002000:00100000:3.0:1746144894.498959:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ece00 x1830965175216896/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.498969:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ece00 with x1830965175216896 ext(0->4095) 00002000:00010000:3.0:1746144894.498973:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ece00 00000100:00100000:3.0:1746144894.498990:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4089 00000100:00100000:3.0:1746144894.498996:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1984:x1830965175216896:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.499149:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1984:x1830965175216896:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 152us (320us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.499155:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4089 00002000:00100000:3.0:1746144894.499160:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ece00 x1830965175216896/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.499167:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ece00 with x1830965175216896 ext(0->4095) 00002000:00010000:3.0:1746144894.499170:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ece00 00000100:00100000:0.0:1746144894.502691:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.502802:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175217024 00000100:00100000:1.0:1746144894.502810:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175217024 00000100:00100000:1.0:1746144894.503744:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5596 00000100:00100000:1.0:1746144894.503754:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175217024:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.503800:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.503815:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751526b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ccf expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.503840:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc8 expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.503847:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.503849:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.503852:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751526b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ccf expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.503882:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc8 expref: 23 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.503891:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc8 expref: 23 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144894.503901:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172469888:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.503984:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144894.506148:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172469888:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.506168:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751526b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ccf expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.506180:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cc800, rc 0) 00000100:00100000:1.0:1746144894.506221:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099698c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175217024:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2468us (3536us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.506227:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5596 00000100:00100000:0.0:1746144894.508708:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.509360:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175217152 00000100:00100000:2.0:1746144894.509369:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175217152 00002000:00100000:2.0:1746144894.509409:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800918ef800 x1830965175217152/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.509419:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ef800 with x1830965175217152 ext(0->7) 00010000:00010000:2.0:1746144894.509426:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc8 expref: 24 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.509439:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc8 expref: 24 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.509444:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ef800 00000100:00100000:2.0:1746144894.509474:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2102 00000100:00100000:2.0:1746144894.509481:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1985:x1830965175217152:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144894.509746:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1985:x1830965175217152:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 264us (1043us total) trans 4294968019 rc 0/0 00000100:00100000:2.0:1746144894.509752:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2102 00002000:00100000:2.0:1746144894.509758:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800918ef800 x1830965175217152/t4294968019(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/448 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.509780:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ef800 with x1830965175217152 ext(0->7) 00010000:00010000:2.0:1746144894.509785:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc8 expref: 26 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.509793:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc8 expref: 26 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.509799:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ef800 00000100:00100000:0.0:1746144894.513940:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.514065:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175217280 00000100:00100000:2.0:1746144894.514074:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175217280 00010000:00010000:2.0:1746144894.514113:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc8 expref: 26 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.514139:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11012 00000100:00100000:2.0:1746144894.514145:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1982:x1830965175217280:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.514157:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.514177:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc8 expref: 26 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.514187:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc8 expref: 26 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.514209:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515264 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cc8 expref: 26 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.514734:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.514736:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.514748:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751526b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ccf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.514756:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751526b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ccf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.514823:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751526b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ccf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.514838:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172470016:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.514918:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.518019:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.518153:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172470016:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.518178:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.518238:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1982:x1830965175217280:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4092us (4314us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.518248:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11012 00000100:00100000:3.0:1746144894.519276:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175217536 00000100:00100000:3.0:1746144894.519284:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175217536 00002000:00100000:3.0:1746144894.519328:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358ece00 x1830965175217536/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.519338:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358ece00 with x1830965175217536 ext(0->4095) 00002000:00010000:3.0:1746144894.519342:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801358ece00 00000100:00100000:3.0:1746144894.519370:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4090 00000100:00100000:3.0:1746144894.519378:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175217536:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.519558:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175217536:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 180us (1549us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.519565:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4090 00002000:00100000:3.0:1746144894.519583:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358ece00 x1830965175217536/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.519591:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358ece00 with x1830965175217536 ext(0->4095) 00002000:00010000:3.0:1746144894.519593:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801358ece00 00000100:00100000:0.0:1746144894.522541:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.522894:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175217664 00000100:00100000:1.0:1746144894.522902:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175217664 00000100:00100000:1.0:1746144894.523004:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5597 00000100:00100000:1.0:1746144894.523012:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+25:31565:x1830965175217664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.523028:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.523044:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94cd6 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.523071:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751526b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ccf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.523079:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.523081:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.523084:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cd6 expref: 26 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.523114:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751526b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ccf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.523125:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751526b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ccf expref: 5 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144894.523135:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172470144:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.523206:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.525040:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.525941:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175217792 00000100:00100000:2.0:1746144894.525948:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175217792 00000100:00100000:2.0:1746144894.526001:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5598 00000100:00100000:2.0:1746144894.526008:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+27:31579:x1830965175217792:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.526021:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.526037:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727515279 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94cdd expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.526058:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.526063:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cd6 expref: 28 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.526068:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.526072:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727515279 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cdd expref: 28 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.526106:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cd6 expref: 28 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.526123:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727515279 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cdd expref: 28 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.526132:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377000, rc 0) 00000100:00100000:2.0:1746144894.526180:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+28:31579:x1830965175217792:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 172us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.526187:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5598 00000100:00100000:1.0:1746144894.526905:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172470144:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.526927:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cd6 expref: 27 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.526949:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cc200, rc 0) 00000100:00100000:1.0:1746144894.526990:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+27:31565:x1830965175217664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3974us (4456us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.526996:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5597 00000100:00100000:0.0:1746144894.527683:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.527733:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175217920 00000100:00100000:2.0:1746144894.527739:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175217920 00010000:00010000:2.0:1746144894.527798:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751526b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ccf expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.527822:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11013 00000100:00100000:2.0:1746144894.527829:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175217920:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.527840:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.527861:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751526b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ccf expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.527872:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751526b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ccf expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.527891:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc800/0x4076af672751526b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ccf expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.527920:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.527922:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.527928:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cd6 expref: 26 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.527949:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cd6 expref: 26 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.527973:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cd6 expref: 26 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.527982:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cd6 expref: 26 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.527991:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172470400:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.528067:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.529369:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172470400:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.529390:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.529444:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175217920:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1615us (1762us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.529454:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11013 00000100:00100000:1.0:1746144894.531148:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.531276:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175218176 00000100:00100000:2.0:1746144894.531283:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175218176 00002000:00100000:2.0:1746144894.531322:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932aaa00 x1830965175218176/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.531331:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932aaa00 with x1830965175218176 ext(0->4095) 00010000:00010000:2.0:1746144894.531339:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cd6 expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.531356:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cd6 expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.531362:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932aaa00 00000100:00100000:2.0:1746144894.531417:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2103 00000100:00100000:2.0:1746144894.531425:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1984:x1830965175218176:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144894.531823:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1984:x1830965175218176:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 398us (680us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.531830:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2103 00002000:00100000:2.0:1746144894.531836:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932aaa00 x1830965175218176/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.531842:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932aaa00 with x1830965175218176 ext(0->4095) 00010000:00010000:2.0:1746144894.531847:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cd6 expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.531856:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cd6 expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.531861:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932aaa00 00000100:00100000:0.0:1746144894.533925:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.534173:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175218304 00000100:00100000:3.0:1746144894.534181:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175218304 00010000:00010000:3.0:1746144894.534211:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cd6 expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.534245:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11014 00000100:00100000:3.0:1746144894.534252:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1985:x1830965175218304:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.534265:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.534285:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cd6 expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.534296:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cd6 expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.534320:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515272 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cd6 expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.534354:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.534356:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.534363:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727515279 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cdd expref: 26 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.534371:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727515279 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cdd expref: 26 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.534406:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727515279 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cdd expref: 26 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.534418:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172470528:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.534492:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb540 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.536837:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172470528:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.536855:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.536888:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50dec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1985:x1830965175218304:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2636us (2969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.536898:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11014 00000100:00100000:0.0:1746144894.537707:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.538047:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175218560 00000100:00100000:2.0:1746144894.538054:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175218560 00002000:00100000:2.0:1746144894.538096:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092585f80 x1830965175218560/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.538106:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092585f80 with x1830965175218560 ext(0->4095) 00002000:00010000:2.0:1746144894.538111:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092585f80 00000100:00100000:2.0:1746144894.538139:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4091 00000100:00100000:2.0:1746144894.538146:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1985:x1830965175218560:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144894.538304:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1985:x1830965175218560:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 159us (598us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.538311:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4091 00002000:00100000:2.0:1746144894.538316:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092585f80 x1830965175218560/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.538323:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092585f80 with x1830965175218560 ext(0->4095) 00002000:00010000:2.0:1746144894.538326:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092585f80 00000100:00100000:0.0:1746144894.540269:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.540498:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175218688 00000100:00100000:1.0:1746144894.540503:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175218688 00000100:00100000:1.0:1746144894.540547:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5599 00000100:00100000:1.0:1746144894.540554:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175218688:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.540568:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.540585:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515280 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ce4 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.540610:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727515279 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cdd expref: 25 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.540617:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.540619:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.540622:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515280 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ce4 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.540650:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727515279 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cdd expref: 25 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.540661:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727515279 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cdd expref: 25 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144894.540671:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172470656:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.540738:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144894.542186:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172470656:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.542210:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515280 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ce4 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.542223:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cc000, rc 0) 00000100:00100000:1.0:1746144894.542251:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175218688:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1697us (1988us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.542263:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5599 00000100:00100000:0.0:1746144894.543636:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.544011:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175218816 00000100:00100000:3.0:1746144894.544017:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175218816 00010000:00010000:3.0:1746144894.544050:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727515279 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cdd expref: 26 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.544075:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11015 00000100:00100000:3.0:1746144894.544082:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1985:x1830965175218816:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.544096:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.544118:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727515279 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cdd expref: 26 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.544129:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727515279 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cdd expref: 26 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.544151:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377000/0x4076af6727515279 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cdd expref: 26 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.544180:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.544182:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.544189:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515280 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ce4 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.544197:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ce4 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.544228:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ce4 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.544237:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172470784:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.544309:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.548322:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.548429:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172470784:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.548447:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.548499:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1985:x1830965175218816:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4416us (4867us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.548513:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11015 00000100:00100000:2.0:1746144894.548621:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175219072 00000100:00100000:2.0:1746144894.548629:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175219072 00002000:00100000:2.0:1746144894.548673:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb48000 x1830965175219072/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.548681:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb48000 with x1830965175219072 ext(0->4095) 00002000:00010000:2.0:1746144894.548685:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb48000 00000100:00100000:2.0:1746144894.548708:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4092 00000100:00100000:2.0:1746144894.548714:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175219072:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144894.548904:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175219072:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 190us (593us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.548914:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4092 00002000:00100000:2.0:1746144894.548919:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bb48000 x1830965175219072/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.548938:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb48000 with x1830965175219072 ext(0->4095) 00002000:00010000:2.0:1746144894.548941:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb48000 00000100:00100000:0.0:1746144894.550296:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.550516:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175219200 00000100:00100000:1.0:1746144894.550520:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175219200 00000100:00100000:1.0:1746144894.550557:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5600 00000100:00100000:1.0:1746144894.550563:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+25:31565:x1830965175219200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.550573:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.550589:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ceb expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.550615:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515280 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ce4 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.550622:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.550624:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.550627:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ceb expref: 26 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.550658:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ce4 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.550668:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ce4 expref: 5 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144894.550678:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172470912:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.550745:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.551588:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.551815:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175219328 00000100:00100000:3.0:1746144894.551819:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175219328 00000100:00100000:3.0:1746144894.551846:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5601 00000100:00100000:3.0:1746144894.551852:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+27:31579:x1830965175219328:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144894.551860:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144894.551869:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751528e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94cf2 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.551884:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.551888:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ceb expref: 28 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.551893:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144894.551895:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751528e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf2 expref: 28 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.551916:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ceb expref: 28 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.551927:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751528e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf2 expref: 28 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.551946:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:3.0:1746144894.551974:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+28:31579:x1830965175219328:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 122us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.551980:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5601 00000100:00100000:1.0:1746144894.553444:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172470912:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.553466:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ceb expref: 27 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.553478:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cc200, rc 0) 00000100:00100000:1.0:1746144894.553514:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+27:31565:x1830965175219200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2951us (3221us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.553519:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5600 00000100:00100000:0.0:1746144894.554296:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.554422:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175219456 00000100:00100000:3.0:1746144894.554426:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175219456 00010000:00010000:3.0:1746144894.554451:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ce4 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.554610:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11016 00000100:00100000:3.0:1746144894.554617:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175219456:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.554630:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.554652:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ce4 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.554664:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ce4 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.554685:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc000/0x4076af6727515280 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ce4 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.554703:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.554705:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.554712:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ceb expref: 26 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.554720:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ceb expref: 26 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.554746:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ceb expref: 26 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.554785:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ceb expref: 26 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.554797:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172471168:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.554864:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.557365:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172471168:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.557385:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.557866:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175219456:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3247us (3569us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.557877:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11016 00000100:00100000:1.0:1746144894.558364:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.558750:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175219712 00000100:00100000:3.0:1746144894.558756:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175219712 00002000:00100000:3.0:1746144894.558807:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932a9500 x1830965175219712/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.558817:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a9500 with x1830965175219712 ext(0->4095) 00010000:00010000:3.0:1746144894.558825:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ceb expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.558837:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ceb expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.558844:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932a9500 00000100:00100000:3.0:1746144894.559716:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2104 00000100:00100000:3.0:1746144894.559726:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1984:x1830965175219712:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.559943:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1984:x1830965175219712:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 219us (1579us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.559949:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2104 00002000:00100000:3.0:1746144894.559955:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932a9500 x1830965175219712/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.559963:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a9500 with x1830965175219712 ext(0->4095) 00010000:00010000:3.0:1746144894.559969:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ceb expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.559979:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ceb expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.559988:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932a9500 00000100:00100000:0.0:1746144894.566598:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.566701:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175219840 00000100:00100000:3.0:1746144894.566711:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175219840 00010000:00010000:3.0:1746144894.566748:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ceb expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.566805:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11017 00000100:00100000:3.0:1746144894.566812:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1983:x1830965175219840:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.566825:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.566848:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ceb expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.566860:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ceb expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.566886:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800935cc200/0x4076af6727515287 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ceb expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.567083:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.567086:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.567094:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751528e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf2 expref: 26 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.567102:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751528e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf2 expref: 26 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.567136:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751528e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf2 expref: 26 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.567148:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172471296:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.568338:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.572268:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172471296:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.572293:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.572550:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1983:x1830965175219840:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5735us (5960us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.572560:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11017 00000100:00100000:0.0:1746144894.573356:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.574690:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175220096 00000100:00100000:2.0:1746144894.574698:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175220096 00002000:00100000:2.0:1746144894.574746:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee6aa00 x1830965175220096/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.574756:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6aa00 with x1830965175220096 ext(0->4095) 00002000:00010000:2.0:1746144894.574760:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee6aa00 00000100:00100000:2.0:1746144894.575023:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4093 00000100:00100000:2.0:1746144894.575031:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1982:x1830965175220096:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746144894.575215:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1982:x1830965175220096:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 186us (1860us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.575221:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4093 00002000:00100000:2.0:1746144894.575226:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee6aa00 x1830965175220096/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.575233:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee6aa00 with x1830965175220096 ext(0->4095) 00002000:00010000:2.0:1746144894.575236:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee6aa00 00000100:00100000:0.0:1746144894.578711:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.578830:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175220224 00000100:00100000:1.0:1746144894.578839:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175220224 00000100:00100000:1.0:1746144894.578900:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5602 00000100:00100000:1.0:1746144894.578908:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175220224:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.578925:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.578950:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94cf9 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.578979:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751528e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf2 expref: 25 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.578986:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.578988:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.578991:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf9 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.579019:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751528e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf2 expref: 25 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.579030:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751528e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf2 expref: 25 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144894.579041:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172471424:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.579129:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144894.580576:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172471424:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144894.580927:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:1.0:1746144894.581002:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf9 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.581016:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0cb200, rc 0) 00000100:00100000:1.0:1746144894.581046:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175220224:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2140us (2343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.581053:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5602 00000100:00100000:3.0:1746144894.581116:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175220352 00000100:00100000:3.0:1746144894.581120:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175220352 00010000:00010000:3.0:1746144894.581142:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751528e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf2 expref: 26 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.581172:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11018 00000100:00100000:3.0:1746144894.581177:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1984:x1830965175220352:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.581186:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.581205:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751528e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf2 expref: 26 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.581214:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751528e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf2 expref: 26 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.581235:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751528e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf2 expref: 26 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.582278:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.582282:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.582291:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf9 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.582299:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf9 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.582332:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf9 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.582343:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172471552:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.582408:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.582650:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.582713:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175220480 00000100:00100000:0.0:1746144894.582717:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175220480 00000100:00100000:0.0:1746144894.582756:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5603 00000100:00100000:0.0:1746144894.582778:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+26:31565:x1830965175220480:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144894.582790:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144894.582802:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d00 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.582820:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf9 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.582828:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144894.582830:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144894.582833:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d00 expref: 27 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.582849:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf9 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.582860:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf9 expref: 5 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:0.0:1746144894.582872:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172471680:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144894.582907:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3180 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.585213:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172471552:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.585232:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.585274:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1984:x1830965175220352:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4095us (4346us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.585284:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11018 00000100:00100000:0.0:1746144894.586341:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.586429:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172471680:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.586450:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d00 expref: 26 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.586465:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b2c00, rc 0) 00000100:00100000:1.0:1746144894.586494:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+26:31565:x1830965175220480:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3732us (3845us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.586501:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5603 00000100:00100000:3.0:1746144894.586663:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175220736 00000100:00100000:3.0:1746144894.586669:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175220736 00002000:00100000:3.0:1746144894.586705:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5fb80 x1830965175220736/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.586714:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5fb80 with x1830965175220736 ext(0->4095) 00010000:00010000:3.0:1746144894.586720:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf9 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.586732:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf9 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.586743:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5fb80 00000100:00100000:3.0:1746144894.586795:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2105 00000100:00100000:3.0:1746144894.586802:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175220736:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144894.588202:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175220736:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1397us (1859us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.588209:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2105 00002000:00100000:3.0:1746144894.588215:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5fb80 x1830965175220736/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.588223:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5fb80 with x1830965175220736 ext(0->4095) 00010000:00010000:3.0:1746144894.588229:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf9 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.588239:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf9 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.588245:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5fb80 00000100:00100000:0.0:1746144894.594557:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.594674:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175220864 00000100:00100000:3.0:1746144894.594684:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175220864 00010000:00010000:3.0:1746144894.594721:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf9 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.595173:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11019 00000100:00100000:3.0:1746144894.595181:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175220864:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.595195:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.595217:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf9 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.595230:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf9 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.595254:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af6727515295 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94cf9 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.595286:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.595288:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.595296:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d00 expref: 25 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.595309:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d00 expref: 25 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.595345:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d00 expref: 25 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.595357:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172471808:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.596244:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.598244:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172471808:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144894.598266:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144894.598321:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175220864:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3139us (3773us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144894.598333:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11019 00000100:00100000:0.0:1746144894.599082:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.599180:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175221120 00000100:00100000:3.0:1746144894.599187:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175221120 00002000:00100000:3.0:1746144894.599227:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417e680 x1830965175221120/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.599236:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417e680 with x1830965175221120 ext(0->4095) 00002000:00010000:3.0:1746144894.599240:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417e680 00000100:00100000:3.0:1746144894.599267:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4094 00000100:00100000:3.0:1746144894.599274:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1984:x1830965175221120:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.599441:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1984:x1830965175221120:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 166us (358us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.599448:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4094 00002000:00100000:3.0:1746144894.599453:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417e680 x1830965175221120/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.599460:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417e680 with x1830965175221120 ext(0->4095) 00002000:00010000:3.0:1746144894.599462:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417e680 00000100:00100000:0.0:1746144894.606538:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.606882:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175221248 00000100:00100000:1.0:1746144894.606892:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175221248 00000100:00100000:1.0:1746144894.606954:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5604 00000100:00100000:1.0:1746144894.606961:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175221248:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.606980:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.606999:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d07 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.607029:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d00 expref: 25 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.607037:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.607038:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.607042:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d07 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.607071:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d00 expref: 25 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.607083:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d00 expref: 25 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144894.607094:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172471936:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.607188:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00010000:00010000:2.0:1746144894.607435:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746144894.613444:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172471936:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.613473:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d07 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.613488:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0cb200, rc 0) 00000100:00100000:1.0:1746144894.613550:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175221248:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6587us (7022us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.613557:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5604 00000100:00100000:0.0:1746144894.614882:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.615333:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175221376 00000100:00100000:3.0:1746144894.615343:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175221376 00002000:00100000:3.0:1746144894.615405:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800a417c700 x1830965175221376/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.615416:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417c700 with x1830965175221376 ext(0->7) 00010000:00010000:3.0:1746144894.615425:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d00 expref: 26 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.615439:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d00 expref: 26 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.615446:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417c700 00000100:00100000:3.0:1746144894.615493:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2106 00000100:00100000:3.0:1746144894.615501:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1984:x1830965175221376:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144894.616228:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1984:x1830965175221376:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 727us (1351us total) trans 4294968020 rc 0/0 00000100:00100000:3.0:1746144894.616235:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2106 00002000:00100000:3.0:1746144894.616242:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800a417c700 x1830965175221376/t4294968020(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/448 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.616250:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417c700 with x1830965175221376 ext(0->7) 00010000:00010000:3.0:1746144894.616256:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d00 expref: 28 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.616264:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d00 expref: 28 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.616274:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417c700 00000100:00100000:0.0:1746144894.617162:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.617259:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175221504 00000100:00100000:1.0:1746144894.617274:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175221504 00000100:00100000:1.0:1746144894.617345:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5605 00000100:00100000:1.0:1746144894.617353:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+28:31565:x1830965175221504:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.617369:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.617386:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d0e expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.617409:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.617414:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d07 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.617419:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144894.617422:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d0e expref: 29 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.617453:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d07 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.617463:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d0e expref: 29 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.617471:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4165800, rc 0) 00000100:00100000:1.0:1746144894.617526:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+29:31565:x1830965175221504:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 173us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.617531:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5605 00000100:00100000:0.0:1746144894.618833:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.619342:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175221632 00000100:00100000:1.0:1746144894.619348:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175221632 00010000:00010000:1.0:1746144894.619383:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d00 expref: 29 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144894.619410:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11020 00000100:00100000:1.0:1746144894.619417:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+29:1985:x1830965175221632:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144894.619427:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746144894.619443:0:7097:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 1746144894 -> 1746144895 00002000:00010000:1.0:1746144894.619446:0:7097:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 1746144894 -> 1746144895 00010000:00010000:1.0:1746144894.619451:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d00 expref: 29 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.619462:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d00 expref: 29 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.619480:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af672751529c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d00 expref: 29 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.619506:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.619508:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.619513:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d07 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.619519:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d07 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.619544:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d07 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.619557:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d07 expref: 5 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144894.619568:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172472192:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144894.619639:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.624236:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172472192:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.624264:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.624322:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1985:x1830965175221632:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4903us (5490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.624333:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11020 00000100:00100000:3.0:1746144894.624492:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.625022:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175221888 00000100:00100000:2.0:1746144894.625029:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175221888 00002000:00100000:2.0:1746144894.625076:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38f100 x1830965175221888/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.625086:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38f100 with x1830965175221888 ext(0->4095) 00010000:00010000:2.0:1746144894.625094:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d07 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.625107:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d07 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.625113:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f38f100 00000100:00100000:2.0:1746144894.625143:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2107 00000100:00100000:2.0:1746144894.625151:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175221888:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144894.625327:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175221888:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 176us (834us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.625334:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2107 00002000:00100000:2.0:1746144894.625339:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38f100 x1830965175221888/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.625346:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38f100 with x1830965175221888 ext(0->4095) 00010000:00010000:2.0:1746144894.625351:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d07 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.625360:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d07 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.625370:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f38f100 00000100:00100000:0.0:1746144894.627410:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.627578:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175222016 00000100:00100000:2.0:1746144894.627587:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175222016 00010000:00010000:2.0:1746144894.627619:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d07 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.627656:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11021 00000100:00100000:2.0:1746144894.627664:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175222016:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.627677:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.627698:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d07 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.627711:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d07 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.627734:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0cb200/0x4076af67275152a3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d07 expref: 6 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.628411:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.628414:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.628424:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d0e expref: 27 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.628432:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d0e expref: 27 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.628476:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d0e expref: 27 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.628488:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172472320:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.629909:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.635945:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.636040:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172472320:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144894.636067:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144894.636129:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50de850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175222016:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 8465us (8725us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144894.636141:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11021 00000100:00100000:3.0:1746144894.636420:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175222272 00000100:00100000:3.0:1746144894.636429:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175222272 00002000:00100000:3.0:1746144894.636469:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea6a00 x1830965175222272/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.636479:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea6a00 with x1830965175222272 ext(0->4095) 00002000:00010000:3.0:1746144894.636483:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea6a00 00000100:00100000:3.0:1746144894.636499:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4095 00000100:00100000:3.0:1746144894.636506:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1984:x1830965175222272:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.636919:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1984:x1830965175222272:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 412us (992us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.636926:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4095 00002000:00100000:3.0:1746144894.636940:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea6a00 x1830965175222272/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.636947:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea6a00 with x1830965175222272 ext(0->4095) 00002000:00010000:3.0:1746144894.636950:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea6a00 00000100:00100000:0.0:1746144894.640163:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.640257:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175222400 00000100:00100000:3.0:1746144894.640267:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175222400 00000100:00100000:3.0:1746144894.640329:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5606 00000100:00100000:3.0:1746144894.640339:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175222400:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144894.640356:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144894.640374:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d15 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.640405:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d0e expref: 27 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.640413:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144894.640415:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144894.640418:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152b1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d15 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.640447:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d0e expref: 27 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.640457:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d0e expref: 27 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.640469:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172472448:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144894.641663:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.642927:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172472448:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144894.642966:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152b1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d15 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.642983:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:3.0:1746144894.643032:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175222400:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2695us (2881us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.643041:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5606 00000100:00100000:0.0:1746144894.648071:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.648218:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175222528 00000100:00100000:3.0:1746144894.648229:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175222528 00002000:00100000:3.0:1746144894.648277:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880093254e00 x1830965175222528/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.648286:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254e00 with x1830965175222528 ext(0->7) 00010000:00010000:3.0:1746144894.648295:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d0e expref: 28 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.648308:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d0e expref: 28 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.648315:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093254e00 00000100:00100000:3.0:1746144894.648348:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2108 00000100:00100000:3.0:1746144894.648355:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1984:x1830965175222528:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144894.648705:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965175222528:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 349us (643us total) trans 4294968021 rc 0/0 00000100:00100000:3.0:1746144894.648713:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2108 00002000:00100000:3.0:1746144894.648718:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880093254e00 x1830965175222528/t4294968021(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/448 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.648725:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254e00 with x1830965175222528 ext(0->7) 00010000:00010000:3.0:1746144894.648729:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d0e expref: 30 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.648738:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d0e expref: 30 pid: 20722 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.648743:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093254e00 00000100:00100000:0.0:1746144894.656135:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.656206:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175222656 00000100:00100000:2.0:1746144894.656225:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175222656 00010000:00010000:2.0:1746144894.656270:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d0e expref: 30 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.656312:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11022 00000100:00100000:2.0:1746144894.656320:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1985:x1830965175222656:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.656334:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.656355:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d0e expref: 30 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.656368:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d0e expref: 30 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.656391:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d0e expref: 30 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.656421:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.656424:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.656431:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d15 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.656439:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d15 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.656471:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d15 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.656482:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172472576:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.656565:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.660760:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172472576:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.660818:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.660872:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+29:1985:x1830965175222656:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4551us (4746us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.660882:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11022 00000100:00100000:0.0:1746144894.662422:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.662524:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175222912 00000100:00100000:3.0:1746144894.662533:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175222912 00002000:00100000:3.0:1746144894.662576:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2fb80 x1830965175222912/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.662586:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2fb80 with x1830965175222912 ext(0->4095) 00002000:00010000:3.0:1746144894.662591:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2fb80 00000100:00100000:3.0:1746144894.663806:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4096 00000100:00100000:3.0:1746144894.663819:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175222912:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.664742:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175222912:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 924us (2323us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.664750:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4096 00002000:00100000:3.0:1746144894.664757:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2fb80 x1830965175222912/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.664781:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2fb80 with x1830965175222912 ext(0->4095) 00002000:00010000:3.0:1746144894.664785:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2fb80 00000100:00100000:0.0:1746144894.666020:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.666517:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175223040 00000100:00100000:3.0:1746144894.666524:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175223040 00000100:00100000:3.0:1746144894.666567:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5607 00000100:00100000:3.0:1746144894.666573:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+29:31565:x1830965175223040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144894.666587:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144894.666606:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d1c expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.666635:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d15 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.666648:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.666650:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.666654:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d1c expref: 30 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.666683:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d15 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.666694:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d15 expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.666704:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172472704:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144894.667878:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.668333:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.668410:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175223168 00000100:00100000:1.0:1746144894.668416:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175223168 00000100:00100000:1.0:1746144894.668465:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5608 00000100:00100000:1.0:1746144894.668471:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31579:x1830965175223168:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.668483:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.668497:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152bf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d23 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.668518:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.668524:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d1c expref: 32 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.668529:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.668533:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152bf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d23 expref: 32 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.668563:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d1c expref: 32 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.668574:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152bf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d23 expref: 32 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.668589:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4165800, rc 0) 00000100:00100000:1.0:1746144894.668643:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+32:31579:x1830965175223168:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 172us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.668650:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5608 00000100:00100000:3.0:1746144894.670737:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172472704:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144894.670791:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d1c expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.670808:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:2.0:1746144894.671205:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31565:x1830965175223040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4630us (5185us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.671213:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5607 00000100:00100000:0.0:1746144894.671309:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.672741:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175223296 00000100:00100000:2.0:1746144894.672748:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175223296 00010000:00010000:2.0:1746144894.672816:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d15 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.672839:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11023 00000100:00100000:2.0:1746144894.672847:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175223296:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.672861:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.672881:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d15 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.672893:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d15 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.672916:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d15 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.672950:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.672952:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.672960:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d1c expref: 30 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.672967:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d1c expref: 30 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.672998:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d1c expref: 30 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.673008:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d1c expref: 30 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.673019:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172472960:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.673098:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.677066:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172472960:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.677093:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.677154:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175223296:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4306us (5843us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.677166:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11023 00000100:00100000:0.0:1746144894.679105:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.680352:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175223552 00000100:00100000:3.0:1746144894.680363:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175223552 00002000:00100000:3.0:1746144894.680411:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a0000 x1830965175223552/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.680421:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a0000 with x1830965175223552 ext(0->4095) 00010000:00010000:3.0:1746144894.680431:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d1c expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.680451:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d1c expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.680458:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918a0000 00000100:00100000:3.0:1746144894.680491:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2109 00000100:00100000:3.0:1746144894.680502:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1984:x1830965175223552:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.680693:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1984:x1830965175223552:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 190us (1593us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.680699:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2109 00002000:00100000:3.0:1746144894.680704:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a0000 x1830965175223552/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.680713:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a0000 with x1830965175223552 ext(0->4095) 00010000:00010000:3.0:1746144894.680718:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d1c expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.680727:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d1c expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.680732:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918a0000 00000100:00100000:0.0:1746144894.683623:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.684041:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175223680 00000100:00100000:2.0:1746144894.684051:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175223680 00010000:00010000:2.0:1746144894.684102:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d1c expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.684169:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11024 00000100:00100000:2.0:1746144894.684178:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1984:x1830965175223680:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.684193:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.684216:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d1c expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.684228:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d1c expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.684251:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d1c expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.685941:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.685946:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.685960:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d23 expref: 30 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.687130:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d23 expref: 30 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.687182:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d23 expref: 30 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.687197:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172473088:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.687294:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.691950:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172473088:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.691981:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.692045:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965175223680:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7866us (8431us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.692057:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11024 00000100:00100000:0.0:1746144894.692148:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.692945:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175223936 00000100:00100000:2.0:1746144894.692952:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175223936 00002000:00100000:2.0:1746144894.692992:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a0700 x1830965175223936/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.693003:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a0700 with x1830965175223936 ext(0->4095) 00002000:00010000:2.0:1746144894.693007:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918a0700 00000100:00100000:2.0:1746144894.693039:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4097 00000100:00100000:2.0:1746144894.693047:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1982:x1830965175223936:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746144894.693205:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1982:x1830965175223936:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 159us (1058us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.693211:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4097 00002000:00100000:2.0:1746144894.693215:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a0700 x1830965175223936/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.693227:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a0700 with x1830965175223936 ext(0->4095) 00002000:00010000:2.0:1746144894.693230:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918a0700 00000100:00100000:0.0:1746144894.697318:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.698407:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175224064 00000100:00100000:2.0:1746144894.698419:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175224064 00000100:00100000:2.0:1746144894.698488:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5609 00000100:00100000:2.0:1746144894.698497:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175224064:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.698516:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.698533:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d2a expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.698564:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d23 expref: 29 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.698571:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.698573:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.698577:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d2a expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.698606:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d23 expref: 29 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.698618:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d23 expref: 29 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.698629:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172473216:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.698724:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.702271:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.702366:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175224192 00000100:00100000:3.0:1746144894.702375:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175224192 00000100:00100000:3.0:1746144894.703100:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5610 00000100:00100000:3.0:1746144894.703110:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31565:x1830965175224192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144894.703127:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144894.703147:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d31 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.703176:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144894.703182:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d2a expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.703189:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144894.703192:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152cd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d31 expref: 31 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.703229:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d2a expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.703302:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172473216:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.703326:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d2a expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.703337:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377a00, rc 0) 00000100:00100000:2.0:1746144894.703393:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175224064:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4897us (6086us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.703400:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5609 00000100:00100000:0.0:1746144894.703811:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:3.0:1746144894.703928:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152cd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d31 expref: 31 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.703944:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:3.0:1746144894.703965:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31565:x1830965175224192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 858us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.703970:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5610 00000100:00100000:2.0:1746144894.704344:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175224320 00000100:00100000:2.0:1746144894.704350:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175224320 00010000:00010000:2.0:1746144894.704372:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d23 expref: 31 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.704402:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11025 00000100:00100000:2.0:1746144894.704409:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965175224320:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.704421:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.706724:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d23 expref: 31 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.706756:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d23 expref: 31 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.706798:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af67275152bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d23 expref: 31 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.706833:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.706835:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.706844:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d2a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.706852:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d2a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.706898:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d2a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.706910:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d2a expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.706922:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172473472:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.707035:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.709067:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172473472:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.709094:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.709276:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1985:x1830965175224320:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4865us (5462us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.709287:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11025 00000100:00100000:2.0:1746144894.711458:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.711554:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175224576 00000100:00100000:3.0:1746144894.711562:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175224576 00002000:00100000:3.0:1746144894.711607:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea5180 x1830965175224576/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.711616:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5180 with x1830965175224576 ext(0->4095) 00010000:00010000:3.0:1746144894.711625:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d2a expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.711641:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d2a expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.711647:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea5180 00000100:00100000:3.0:1746144894.711675:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2110 00000100:00100000:3.0:1746144894.711682:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175224576:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.712091:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175224576:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 408us (637us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.712097:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2110 00002000:00100000:3.0:1746144894.712102:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea5180 x1830965175224576/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.712109:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5180 with x1830965175224576 ext(0->4095) 00010000:00010000:3.0:1746144894.712113:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d2a expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.712122:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d2a expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.712127:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea5180 00000100:00100000:0.0:1746144894.715280:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.715372:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175224704 00000100:00100000:2.0:1746144894.715381:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175224704 00010000:00010000:2.0:1746144894.715421:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d2a expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.715459:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11026 00000100:00100000:2.0:1746144894.715467:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175224704:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.715481:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.715502:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d2a expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.715514:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d2a expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.715538:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152c6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d2a expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.716429:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.716434:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.716444:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d31 expref: 29 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.716453:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d31 expref: 29 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.716494:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d31 expref: 29 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.716508:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013612d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172473600:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.716596:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.719819:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013612d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172473600:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.719846:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.719895:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175224704:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4428us (4624us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.719910:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11026 00000100:00100000:0.0:1746144894.720547:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.720665:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175224960 00000100:00100000:3.0:1746144894.720672:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175224960 00002000:00100000:3.0:1746144894.720711:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a1880 x1830965175224960/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.720721:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a1880 with x1830965175224960 ext(0->4095) 00002000:00010000:3.0:1746144894.720725:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918a1880 00000100:00100000:3.0:1746144894.720750:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4098 00000100:00100000:3.0:1746144894.720757:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1985:x1830965175224960:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144894.720957:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1985:x1830965175224960:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 200us (410us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.720962:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4098 00002000:00100000:3.0:1746144894.720967:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a1880 x1830965175224960/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.720973:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a1880 with x1830965175224960 ext(0->4095) 00002000:00010000:3.0:1746144894.720975:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918a1880 00000100:00100000:0.0:1746144894.723130:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.723207:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175225088 00000100:00100000:3.0:1746144894.723213:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175225088 00000100:00100000:3.0:1746144894.723832:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5611 00000100:00100000:3.0:1746144894.723841:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175225088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144894.723859:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144894.723876:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d38 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.723906:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d31 expref: 29 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.723913:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144894.723915:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144894.723918:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d38 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.723963:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d31 expref: 29 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.723975:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d31 expref: 29 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.723988:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172473728:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144894.724556:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.726869:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172473728:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144894.726897:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d38 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.726915:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:3.0:1746144894.726979:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175225088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3137us (3854us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.726988:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5611 00000100:00100000:0.0:1746144894.727973:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.728217:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175225216 00000100:00100000:2.0:1746144894.728225:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175225216 00010000:00010000:2.0:1746144894.728257:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d31 expref: 30 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.728288:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11027 00000100:00100000:2.0:1746144894.728294:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1985:x1830965175225216:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.728306:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.728325:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d31 expref: 30 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.728337:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d31 expref: 30 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.728359:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275152cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d31 expref: 30 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.728384:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.728386:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.728392:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d38 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.728400:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d38 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.728427:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d38 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.728439:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013612d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172473856:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.728503:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.730460:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.730686:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175225344 00000100:00100000:3.0:1746144894.730692:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175225344 00000100:00100000:3.0:1746144894.730735:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5612 00000100:00100000:3.0:1746144894.730740:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31565:x1830965175225344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144894.730754:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144894.730808:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d3f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.730831:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d38 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.730838:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.730839:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.730842:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d3f expref: 31 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.730865:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d38 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.730874:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d38 expref: 5 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.730883:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172473984:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144894.730957:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.731368:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.731461:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175225600 00000100:00100000:2.0:1746144894.731465:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175225600 00002000:00100000:2.0:1746144894.731499:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a2680 x1830965175225600/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.731507:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a2680 with x1830965175225600 ext(0->4095) 00010000:00010000:2.0:1746144894.731513:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d38 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.731521:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d38 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.731526:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918a2680 00000100:00100000:2.0:1746144894.731549:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2111 00000100:00100000:2.0:1746144894.731556:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175225600:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144894.731723:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175225600:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 166us (353us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.731729:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2111 00002000:00100000:2.0:1746144894.731735:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a2680 x1830965175225600/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.731743:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a2680 with x1830965175225600 ext(0->4095) 00010000:00010000:2.0:1746144894.731747:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d38 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.731756:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d38 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.731784:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918a2680 00000100:00100000:3.0:1746144894.733311:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013612d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172473856:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.733329:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.733366:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965175225216:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5072us (5395us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.733375:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11027 00000100:00100000:0.0:1746144894.735369:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.735641:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172473984:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.735745:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175225728 00000100:00100000:1.0:1746144894.735751:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175225728 00000100:00100000:1.0:1746144894.735828:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5613 00000100:00100000:1.0:1746144894.735836:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31579:x1830965175225728:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.735851:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.735867:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af67275152e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d46 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.735891:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.735897:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d3f expref: 32 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.735903:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.735906:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af67275152e2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d46 expref: 32 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.735955:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d3f expref: 32 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.735965:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af67275152e2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d46 expref: 32 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.735979:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880135fe5800, rc 0) 00000100:00100000:1.0:1746144894.736017:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+32:31579:x1830965175225728:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 181us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.736022:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5613 00010000:00010000:3.0:1746144894.736141:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d3f expref: 31 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.736149:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:3.0:1746144894.736164:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31565:x1830965175225344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5424us (5712us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.736173:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5612 00000100:00100000:0.0:1746144894.736949:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.737294:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175225856 00000100:00100000:3.0:1746144894.737300:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175225856 00010000:00010000:3.0:1746144894.737320:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d38 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.737344:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11028 00000100:00100000:3.0:1746144894.737349:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175225856:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.737359:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.737379:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d38 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.737389:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d38 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.737408:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275152d4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d38 expref: 6 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.737430:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.737431:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.737437:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d3f expref: 30 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.737445:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d3f expref: 30 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.737466:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d3f expref: 30 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.737476:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d3f expref: 30 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.737487:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172474240:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.737551:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bb840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.740731:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.740802:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175226112 00000100:00100000:1.0:1746144894.740810:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175226112 00002000:00100000:1.0:1746144894.740853:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a2d80 x1830965175226112/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.740863:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a2d80 with x1830965175226112 ext(0->4095) 00010000:00010000:1.0:1746144894.740872:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d3f expref: 31 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.740884:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d3f expref: 31 pid: 8432 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144894.740891:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918a2d80 00000100:00100000:3.0:1746144894.740894:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172474240:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144894.740909:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2112 00010000:00010000:3.0:1746144894.740911:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144894.740916:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965175226112:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144894.740961:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50de450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175225856:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3610us (4012us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.740970:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11028 00000100:00100000:1.0:1746144894.741099:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965175226112:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 183us (376us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144894.741105:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2112 00002000:00100000:1.0:1746144894.741110:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a2d80 x1830965175226112/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.741122:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a2d80 with x1830965175226112 ext(0->4095) 00010000:00010000:1.0:1746144894.741126:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d3f expref: 31 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:1.0:1746144894.741135:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d3f expref: 31 pid: 8432 timeout: 588 lvb_type: 0 00002000:00010000:1.0:1746144894.741141:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918a2d80 00000100:00100000:0.0:1746144894.744005:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.744251:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175226240 00000100:00100000:3.0:1746144894.744258:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175226240 00010000:00010000:3.0:1746144894.744293:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d3f expref: 31 pid: 8432 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.744388:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11029 00000100:00100000:3.0:1746144894.744396:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1984:x1830965175226240:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.744409:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.744430:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d3f expref: 31 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.744442:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d3f expref: 31 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.744465:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275152db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d3f expref: 31 pid: 8432 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.744480:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.744482:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.744489:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af67275152e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d46 expref: 30 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.744497:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af67275152e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d46 expref: 30 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.744533:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af67275152e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d46 expref: 30 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.744546:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172474368:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.744616:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.748558:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172474368:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.748581:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.748633:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965175226240:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4236us (4636us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.748643:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11029 00000100:00100000:0.0:1746144894.749360:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.749543:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175226496 00000100:00100000:1.0:1746144894.749551:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175226496 00002000:00100000:1.0:1746144894.749601:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a3480 x1830965175226496/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.749705:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a3480 with x1830965175226496 ext(0->4095) 00002000:00010000:1.0:1746144894.749711:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918a3480 00000100:00100000:1.0:1746144894.750368:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4099 00000100:00100000:1.0:1746144894.750377:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965175226496:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144894.750555:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965175226496:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 178us (1196us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144894.750561:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4099 00002000:00100000:1.0:1746144894.750566:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a3480 x1830965175226496/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.750574:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a3480 with x1830965175226496 ext(0->4095) 00002000:00010000:1.0:1746144894.750577:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918a3480 00000100:00100000:0.0:1746144894.752069:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.752296:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175226624 00000100:00100000:2.0:1746144894.752302:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175226624 00000100:00100000:2.0:1746144894.752357:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5614 00000100:00100000:2.0:1746144894.752365:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175226624:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.752376:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.752394:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d4d expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.752426:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af67275152e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d46 expref: 29 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.752434:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.752436:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.752440:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d4d expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.752471:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af67275152e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d46 expref: 29 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.752483:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af67275152e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d46 expref: 29 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.752495:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013612fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172474496:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.752570:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.753751:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013612fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172474496:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.753787:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d4d expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.753856:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094376e00, rc 0) 00000100:00100000:2.0:1746144894.754085:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175226624:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1720us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.754093:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5614 00000100:00100000:0.0:1746144894.754790:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.755259:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175226752 00000100:00100000:3.0:1746144894.755266:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175226752 00010000:00010000:3.0:1746144894.755292:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af67275152e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d46 expref: 30 pid: 20722 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.755364:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11030 00000100:00100000:3.0:1746144894.755372:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965175226752:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.755388:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.755410:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af67275152e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d46 expref: 30 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.755422:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af67275152e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d46 expref: 30 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.755444:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880135fe5800/0x4076af67275152e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d46 expref: 30 pid: 20722 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.755620:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.755623:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.755631:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d4d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.755639:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d4d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.755671:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d4d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.755681:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172474624:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.756123:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.758453:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.758552:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172474624:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.758557:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175226880 00000100:00100000:2.0:1746144894.758568:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175226880 00010000:00010000:3.0:1746144894.758569:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.758612:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965175226752:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3241us (3823us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.758618:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5615 00000100:00100000:3.0:1746144894.758624:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11030 00000100:00100000:2.0:1746144894.758626:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31565:x1830965175226880:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.758642:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.758659:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d54 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.758685:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d4d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.758692:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.758694:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.758698:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d54 expref: 30 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.758729:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d4d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.758745:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d4d expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.758754:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013612fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172474752:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.758842:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.758985:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.759263:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175227136 00000100:00100000:2.0:1746144894.759267:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175227136 00002000:00100000:2.0:1746144894.759293:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a1180 x1830965175227136/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.759303:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a1180 with x1830965175227136 ext(0->4095) 00010000:00010000:2.0:1746144894.759309:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d4d expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.759320:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d4d expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.759327:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918a1180 00000100:00100000:2.0:1746144894.759354:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2113 00000100:00100000:2.0:1746144894.759359:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175227136:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144894.759711:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175227136:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 351us (725us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.759718:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2113 00002000:00100000:2.0:1746144894.759723:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a1180 x1830965175227136/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.759737:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a1180 with x1830965175227136 ext(0->4095) 00010000:00010000:2.0:1746144894.759742:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d4d expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.759751:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d4d expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.759757:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918a1180 00000100:00100000:2.0:1746144894.762147:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013612fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172474752:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.762178:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d54 expref: 30 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.762194:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094376600, rc 0) 00000100:00100000:2.0:1746144894.762390:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31565:x1830965175226880:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3748us (3927us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.762398:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5615 00000100:00100000:0.0:1746144894.762423:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.762439:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175227264 00000100:00100000:2.0:1746144894.762444:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175227264 00000100:00100000:2.0:1746144894.762480:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5616 00000100:00100000:2.0:1746144894.762487:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31579:x1830965175227264:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.762499:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.762511:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af67275152f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d5b expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.762529:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.762534:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d54 expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.762540:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.762543:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af67275152f7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d5b expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.762568:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d54 expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.762578:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af67275152f7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d5b expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.762584:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377800, rc 0) 00000100:00100000:2.0:1746144894.762618:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31579:x1830965175227264:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 132us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.762624:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5616 00000100:00100000:0.0:1746144894.766306:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.766413:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175227392 00000100:00100000:3.0:1746144894.766423:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175227392 00010000:00010000:3.0:1746144894.766459:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d4d expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.766499:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11031 00000100:00100000:3.0:1746144894.766506:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175227392:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.766520:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.766539:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d4d expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.766551:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d4d expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.766573:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af67275152e9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d4d expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.766591:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.766593:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.766601:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d54 expref: 30 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.766609:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d54 expref: 30 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.766642:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d54 expref: 30 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.766654:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d54 expref: 30 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.766665:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172475008:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.766756:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.770009:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172475008:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.770030:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144894.770178:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.770274:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175227648 00000100:00100000:3.0:1746144894.770281:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175227648 00002000:00100000:3.0:1746144894.770325:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c28000 x1830965175227648/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.770334:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28000 with x1830965175227648 ext(0->4095) 00010000:00010000:3.0:1746144894.770342:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d54 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.770353:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d54 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.770359:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c28000 00000100:00100000:3.0:1746144894.770378:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2114 00000100:00100000:3.0:1746144894.770385:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965175227648:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144894.770537:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965175227648:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 153us (360us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.770543:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2114 00002000:00100000:3.0:1746144894.770548:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c28000 x1830965175227648/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.770560:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28000 with x1830965175227648 ext(0->4095) 00010000:00010000:3.0:1746144894.770564:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d54 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.770572:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d54 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.770577:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c28000 00000100:00100000:2.0:1746144894.771022:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175227392:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3574us (3785us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.771033:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11031 00000100:00100000:2.0:1746144894.773833:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.773903:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175227776 00000100:00100000:0.0:1746144894.773913:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175227776 00010000:00010000:0.0:1746144894.773961:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d54 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:0.0:1746144894.774002:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11032 00000100:00100000:0.0:1746144894.774010:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965175227776:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144894.774024:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144894.774046:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d54 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1746144894.774058:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d54 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1746144894.774083:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094376600/0x4076af67275152f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d54 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1746144894.774112:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144894.774114:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144894.774121:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af67275152f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d5b expref: 30 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.774130:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af67275152f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d5b expref: 30 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.774163:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af67275152f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d5b expref: 30 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144894.774175:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c28380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172475136:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144894.774260:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.776997:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c28380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172475136:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144894.777021:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144894.777076:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1985:x1830965175227776:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3065us (3251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.777092:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11032 00000100:00100000:0.0:1746144894.778057:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.778387:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175228032 00000100:00100000:2.0:1746144894.778394:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175228032 00002000:00100000:2.0:1746144894.778440:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c28700 x1830965175228032/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.778450:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28700 with x1830965175228032 ext(0->4095) 00002000:00010000:2.0:1746144894.778454:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c28700 00000100:00100000:2.0:1746144894.778484:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4100 00000100:00100000:2.0:1746144894.778537:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965175228032:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144894.778701:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965175228032:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 211us (646us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.778708:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4100 00002000:00100000:2.0:1746144894.778712:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c28700 x1830965175228032/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.778719:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28700 with x1830965175228032 ext(0->4095) 00002000:00010000:2.0:1746144894.778721:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c28700 00000100:00100000:0.0:1746144894.781894:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.781979:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175228160 00000100:00100000:2.0:1746144894.781988:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175228160 00000100:00100000:2.0:1746144894.782039:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5617 00000100:00100000:2.0:1746144894.782047:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175228160:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.782065:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.782110:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d62 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.782149:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af67275152f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d5b expref: 29 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.782156:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.782158:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.782161:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d62 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.782187:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af67275152f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d5b expref: 29 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.782200:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af67275152f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d5b expref: 29 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.782210:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013612d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172475264:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.782803:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.784448:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013612d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172475264:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.784480:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d62 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.784497:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377a00, rc 0) 00000100:00100000:2.0:1746144894.784538:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175228160:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2491us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.784547:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5617 00000100:00100000:0.0:1746144894.785580:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.785795:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175228288 00000100:00100000:2.0:1746144894.785803:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175228288 00010000:00010000:2.0:1746144894.785834:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af67275152f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d5b expref: 30 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.785872:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11033 00000100:00100000:2.0:1746144894.785880:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1985:x1830965175228288:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144894.785894:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144894.785916:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af67275152f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d5b expref: 30 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.785941:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af67275152f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d5b expref: 30 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.786101:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377800/0x4076af67275152f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d5b expref: 30 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.786246:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.786249:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.786256:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d62 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.786265:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d62 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.786296:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d62 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144894.786307:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013612d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172475392:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.786383:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.790179:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.790386:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175228416 00000100:00100000:2.0:1746144894.790395:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175228416 00000100:00100000:2.0:1746144894.790454:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5618 00000100:00100000:2.0:1746144894.790463:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31565:x1830965175228416:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.790482:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.790501:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d69 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.790534:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d62 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.790543:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.790544:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.790548:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.790581:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d62 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.790593:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d62 expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.790605:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013612d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172475520:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.790692:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.790974:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013612d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172475392:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.790992:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.791020:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965175228288:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5141us (5442us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.791029:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11033 00000100:00100000:2.0:1746144894.791452:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.791913:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175228672 00000100:00100000:3.0:1746144894.791917:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175228672 00002000:00100000:3.0:1746144894.791962:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612d180 x1830965175228672/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.791971:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612d180 with x1830965175228672 ext(0->4095) 00010000:00010000:3.0:1746144894.791978:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d62 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.791989:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d62 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.791995:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612d180 00000100:00100000:3.0:1746144894.792020:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2115 00000100:00100000:3.0:1746144894.792026:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175228672:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144894.792194:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175228672:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 168us (742us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.792201:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2115 00002000:00100000:3.0:1746144894.792205:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612d180 x1830965175228672/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.792212:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612d180 with x1830965175228672 ext(0->4095) 00010000:00010000:3.0:1746144894.792217:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d62 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.792225:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d62 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:3.0:1746144894.792231:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612d180 00000100:00100000:2.0:1746144894.794411:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013612d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172475520:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.794444:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 30 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.794459:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377600, rc 0) 00000100:00100000:2.0:1746144894.794692:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31565:x1830965175228416:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4229us (4523us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.794700:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5618 00000100:00100000:0.0:1746144894.794987:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.795031:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.795084:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175228928 00000100:00100000:3.0:1746144894.795091:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175228928 00010000:00010000:3.0:1746144894.795119:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d62 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.795154:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11034 00000100:00100000:3.0:1746144894.795161:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175228928:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.795176:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144894.795180:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175228800 00000100:00100000:2.0:1746144894.795184:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175228800 00010000:00010000:3.0:1746144894.795199:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d62 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.795204:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5619 00000100:00100000:2.0:1746144894.795209:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31579:x1830965175228800:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144894.795214:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d62 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.795222:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.795235:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af672751530c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d70 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.795237:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377a00/0x4076af67275152fe lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d62 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.795250:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144894.795254:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.795260:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.795263:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af672751530c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d70 expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.795575:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.795578:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.795584:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.795591:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.795619:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.795630:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.795641:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013612d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172475648:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144894.795742:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.795750:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.795757:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172475776:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144894.795844:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.795924:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.798273:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013612d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172475648:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144894.798307:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af672751530c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d70 expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.798324:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0caa00, rc 0) 00000100:00100000:0.0:1746144894.798378:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31579:x1830965175228800:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3167us (3389us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144894.798386:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5619 00000100:00100000:0.0:1746144894.799199:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.799325:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175229184 00000100:00100000:2.0:1746144894.799333:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175229184 00002000:00100000:2.0:1746144894.799375:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c29c00 x1830965175229184/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.799385:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c29c00 with x1830965175229184 ext(0->4095) 00010000:00010000:2.0:1746144894.799391:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.799403:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.799408:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c29c00 00000100:00100000:2.0:1746144894.799425:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2116 00000100:00100000:2.0:1746144894.799430:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1983:x1830965175229184:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746144894.799591:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1983:x1830965175229184:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 161us (393us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.799598:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2116 00002000:00100000:2.0:1746144894.799604:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c29c00 x1830965175229184/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.799611:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c29c00 with x1830965175229184 ext(0->4095) 00010000:00010000:2.0:1746144894.799616:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.799625:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.799630:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c29c00 00000100:00100000:3.0:1746144894.799757:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172475776:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.799793:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.799828:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175228928:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4668us (4796us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.799839:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11034 00000100:00100000:0.0:1746144894.801401:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.801466:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175229312 00000100:00100000:3.0:1746144894.801472:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175229312 00010000:00010000:3.0:1746144894.801497:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.801527:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11035 00000100:00100000:3.0:1746144894.801533:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965175229312:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.801543:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.801559:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.801569:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.801590:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094377600/0x4076af6727515305 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d69 expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.801612:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.801614:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.801620:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af672751530c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d70 expref: 30 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.801628:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af672751530c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d70 expref: 30 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.801655:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af672751530c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d70 expref: 30 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.801665:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172475904:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.801732:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012a2bbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.803712:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172475904:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.803731:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.803793:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50de050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1985:x1830965175229312:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2257us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.803802:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11035 00000100:00100000:0.0:1746144894.804255:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.805262:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175229568 00000100:00100000:1.0:1746144894.805271:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175229568 00002000:00100000:1.0:1746144894.805316:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c29f80 x1830965175229568/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.805327:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c29f80 with x1830965175229568 ext(0->4095) 00002000:00010000:1.0:1746144894.805332:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c29f80 00000100:00100000:1.0:1746144894.805361:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4101 00000100:00100000:1.0:1746144894.805368:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965175229568:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144894.805561:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965175229568:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 193us (1306us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144894.805567:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4101 00002000:00100000:1.0:1746144894.805572:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c29f80 x1830965175229568/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.805579:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c29f80 with x1830965175229568 ext(0->4095) 00002000:00010000:1.0:1746144894.805582:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c29f80 00000100:00100000:0.0:1746144894.808812:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.809040:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175229696 00000100:00100000:2.0:1746144894.809049:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175229696 00000100:00100000:2.0:1746144894.809100:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5620 00000100:00100000:2.0:1746144894.809109:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175229696:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.809126:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.809146:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d77 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.809176:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af672751530c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d70 expref: 29 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.809187:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.809188:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.809192:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.809225:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af672751530c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d70 expref: 29 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.809237:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af672751530c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d70 expref: 29 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:2.0:1746144894.809249:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013612fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172476032:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.809341:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.816178:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.816272:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.816357:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175229824 00000100:00100000:3.0:1746144894.816367:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175229824 00000100:00100000:0.0:1746144894.816395:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013612fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172476032:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144894.816401:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af672751530c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d70 expref: 30 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.816426:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11036 00010000:00010000:0.0:1746144894.816426:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.816433:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965175229824:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144894.816440:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1ac00, rc 0) 00010000:00010000:3.0:1746144894.816446:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.816466:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af672751530c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d70 expref: 30 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.816478:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af672751530c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d70 expref: 30 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:0.0:1746144894.816482:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175229696:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7375us (7723us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144894.816493:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5620 00010000:00010000:3.0:1746144894.816500:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0caa00/0x4076af672751530c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d70 expref: 30 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:0.0:1746144894.816512:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175229952 00000100:00100000:0.0:1746144894.816515:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175229952 00010000:00010000:3.0:1746144894.816524:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.816526:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746144894.816532:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5621 00010000:00010000:3.0:1746144894.816534:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144894.816537:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31565:x1830965175229952:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144894.816543:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.816548:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144894.816559:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d7e expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.816570:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.816574:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.816580:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144894.816581:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144894.816583:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d7e expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.816677:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.816689:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172476160:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.816739:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9300 going to sleep for 11 seconds 00010000:00010000:0.0:1746144894.816757:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:0.0:1746144894.816785:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:0.0:1746144894.816793:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091c2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172476288:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144894.816826:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144894.818606:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091c2a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172476288:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.818626:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d7e expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.818639:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b3c00, rc 0) 00000100:00100000:3.0:1746144894.818645:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172476160:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.818657:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144894.818684:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31565:x1830965175229952:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2145us (2410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.818690:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5621 00000100:00100000:3.0:1746144894.818847:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965175229824:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2412us (2680us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.818855:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11036 00000100:00100000:0.0:1746144894.819885:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.820021:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175230208 00000100:00100000:2.0:1746144894.820027:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175230208 00002000:00100000:2.0:1746144894.820066:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c2aa00 x1830965175230208/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.820076:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c2aa00 with x1830965175230208 ext(0->4095) 00010000:00010000:2.0:1746144894.820082:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.820094:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.820100:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c2aa00 00000100:00100000:2.0:1746144894.820126:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2117 00000100:00100000:2.0:1746144894.820133:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175230208:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144894.820682:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175230208:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 548us (796us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.820687:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2117 00002000:00100000:2.0:1746144894.820693:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c2aa00 x1830965175230208/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.820699:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c2aa00 with x1830965175230208 ext(0->4095) 00010000:00010000:2.0:1746144894.820704:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.820718:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.820724:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c2aa00 00000100:00100000:0.0:1746144894.822900:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.823165:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175230336 00000100:00100000:3.0:1746144894.823173:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175230336 00010000:00010000:3.0:1746144894.823203:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.823227:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11037 00000100:00100000:3.0:1746144894.823233:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175230336:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.823248:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.823266:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.823278:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.823300:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ac00/0x4076af6727515313 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d77 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.823328:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.823330:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.823337:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d7e expref: 29 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.823344:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d7e expref: 29 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.823376:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d7e expref: 29 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.823386:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172476416:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.823460:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.826748:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.826890:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172476416:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.826912:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.826965:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175230336:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3732us (4073us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.826979:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11037 00000100:00100000:2.0:1746144894.827056:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175230592 00000100:00100000:2.0:1746144894.827063:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175230592 00002000:00100000:2.0:1746144894.827105:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c2b100 x1830965175230592/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.827114:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c2b100 with x1830965175230592 ext(0->4095) 00002000:00010000:2.0:1746144894.827118:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c2b100 00000100:00100000:2.0:1746144894.827145:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4102 00000100:00100000:2.0:1746144894.827152:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965175230592:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144894.827602:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1984:x1830965175230592:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 450us (864us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.827608:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4102 00002000:00100000:2.0:1746144894.827613:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c2b100 x1830965175230592/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.827621:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c2b100 with x1830965175230592 ext(0->4095) 00002000:00010000:2.0:1746144894.827624:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c2b100 00000100:00100000:0.0:1746144894.832874:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.832950:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175230720 00000100:00100000:1.0:1746144894.832960:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175230720 00000100:00100000:1.0:1746144894.833026:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5622 00000100:00100000:1.0:1746144894.833035:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175230720:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.833056:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.833075:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d85 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.833104:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d7e expref: 29 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.833111:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.833113:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.833116:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d85 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.833147:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d7e expref: 29 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.833157:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d7e expref: 29 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:1.0:1746144894.833169:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172476544:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.833263:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.845997:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.846267:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172476544:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.846298:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d85 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.846318:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4165800, rc 0) 00000100:00100000:1.0:1746144894.846370:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175230720:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 13336us (13505us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.846378:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5622 00000100:00100000:1.0:1746144894.846402:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175230848 00000100:00100000:1.0:1746144894.846407:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175230848 00000100:00100000:1.0:1746144894.846435:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5623 00000100:00100000:1.0:1746144894.846441:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+30:31565:x1830965175230848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.846454:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.846466:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d8c expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.846482:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.846486:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d85 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.846491:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144894.846494:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d8c expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.846519:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d85 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.846527:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d8c expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.846539:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a8600, rc 0) 00000100:00100000:1.0:1746144894.846554:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+31:31565:x1830965175230848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 113us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.846559:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5623 00000100:00100000:0.0:1746144894.847798:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.847846:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175230976 00000100:00100000:2.0:1746144894.847854:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175230976 00002000:00100000:2.0:1746144894.847903:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880091c2bb80 x1830965175230976/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.847920:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c2bb80 with x1830965175230976 ext(0->7) 00010000:00010000:2.0:1746144894.847935:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d7e expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.847950:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d7e expref: 31 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.847958:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c2bb80 00000100:00100000:2.0:1746144894.847979:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2118 00000100:00100000:2.0:1746144894.847986:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965175230976:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144894.848287:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1985:x1830965175230976:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 301us (529us total) trans 4294968022 rc 0/0 00000100:00100000:2.0:1746144894.848293:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2118 00002000:00100000:2.0:1746144894.848297:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880091c2bb80 x1830965175230976/t4294968022(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/448 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.848304:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c2bb80 with x1830965175230976 ext(0->7) 00010000:00010000:2.0:1746144894.848308:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d7e expref: 33 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.848316:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d7e expref: 33 pid: 10401 timeout: 588 lvb_type: 0 00002000:00010000:2.0:1746144894.848321:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c2bb80 00000100:00100000:0.0:1746144894.850642:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.850739:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175231104 00000100:00100000:3.0:1746144894.850746:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175231104 00010000:00010000:3.0:1746144894.850807:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d7e expref: 33 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.850828:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11038 00000100:00100000:3.0:1746144894.850834:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1984:x1830965175231104:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.850847:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.850867:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d7e expref: 33 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.850878:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d7e expref: 33 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.850900:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751531a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d7e expref: 33 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:3.0:1746144894.850940:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.850942:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.850950:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d85 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.850957:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d85 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.850991:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d85 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.851002:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d85 expref: 5 pid: 10401 timeout: 588 lvb_type: 0 00000100:00100000:3.0:1746144894.851014:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172476800:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.851092:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.852536:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172476800:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.852553:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.852576:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1984:x1830965175231104:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1742us (1944us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.852584:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11038 00000100:00100000:0.0:1746144894.854391:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.854527:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175231360 00000100:00100000:2.0:1746144894.854535:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175231360 00002000:00100000:2.0:1746144894.854584:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c28e00 x1830965175231360/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.854593:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28e00 with x1830965175231360 ext(0->4095) 00010000:00010000:2.0:1746144894.854602:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d85 expref: 6 pid: 10401 timeout: 588 lvb_type: 0 00010000:00010000:2.0:1746144894.854615:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d85 expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144894.854623:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c28e00 00000100:00100000:1.0:1746144894.855350:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2119 00000100:00100000:1.0:1746144894.855360:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175231360:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144894.855534:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175231360:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 176us (1149us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144894.855540:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2119 00002000:00100000:1.0:1746144894.855545:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c28e00 x1830965175231360/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.855552:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28e00 with x1830965175231360 ext(0->4095) 00010000:00010000:1.0:1746144894.855556:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d85 expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144894.855565:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d85 expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144894.855570:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c28e00 00000100:00100000:0.0:1746144894.859355:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.859579:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175231488 00000100:00100000:3.0:1746144894.859589:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175231488 00010000:00010000:3.0:1746144894.859623:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d85 expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144894.859651:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11039 00000100:00100000:3.0:1746144894.859658:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175231488:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.859670:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.860257:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d85 expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.860271:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d85 expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.860435:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af6727515321 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d85 expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.860668:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.860671:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.860680:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d8c expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.860688:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d8c expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.860727:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d8c expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.860740:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172476928:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.861331:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.866602:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172476928:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.866627:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.866688:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175231488:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7029us (7343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.866700:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11039 00000100:00100000:0.0:1746144894.867447:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.867744:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175231744 00000100:00100000:3.0:1746144894.867751:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175231744 00002000:00100000:3.0:1746144894.867821:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c28380 x1830965175231744/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.867831:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28380 with x1830965175231744 ext(0->4095) 00002000:00010000:3.0:1746144894.867836:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c28380 00000100:00100000:3.0:1746144894.867863:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4103 00000100:00100000:3.0:1746144894.867871:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1982:x1830965175231744:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:3.0:1746144894.868048:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1982:x1830965175231744:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 177us (603us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.868054:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4103 00002000:00100000:3.0:1746144894.868059:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c28380 x1830965175231744/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.868066:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28380 with x1830965175231744 ext(0->4095) 00002000:00010000:3.0:1746144894.868068:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c28380 00000100:00100000:0.0:1746144894.873001:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.875398:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175231872 00000100:00100000:2.0:1746144894.875414:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175231872 00000100:00100000:2.0:1746144894.875900:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5624 00000100:00100000:2.0:1746144894.875911:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175231872:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144894.875940:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144894.875962:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d93 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.875995:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d8c expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.876003:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.876006:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144894.876009:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d93 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.876041:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d8c expref: 31 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.876054:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d8c expref: 31 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144894.876065:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d366d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172477056:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144894.880900:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144894.886045:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d366d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172477056:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144894.886088:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d93 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144894.886106:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1ae00, rc 0) 00000100:00100000:2.0:1746144894.886150:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175231872:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 10240us (13159us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144894.886158:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5624 00000100:00100000:0.0:1746144894.894906:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.895015:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175232000 00000100:00100000:1.0:1746144894.895026:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175232000 00002000:00100000:1.0:1746144894.895078:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800938a0000 x1830965175232000/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.895095:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a0000 with x1830965175232000 ext(0->7) 00010000:00010000:1.0:1746144894.895105:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d8c expref: 32 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144894.895119:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d8c expref: 32 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144894.895125:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a0000 00000100:00100000:1.0:1746144894.895160:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2120 00000100:00100000:1.0:1746144894.895167:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1985:x1830965175232000:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144894.895526:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1985:x1830965175232000:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 358us (630us total) trans 4294968023 rc 0/0 00000100:00100000:1.0:1746144894.895533:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2120 00002000:00100000:1.0:1746144894.895538:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800938a0000 x1830965175232000/t4294968023(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/448 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.895545:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a0000 with x1830965175232000 ext(0->7) 00010000:00010000:1.0:1746144894.895550:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d8c expref: 34 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144894.895559:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d8c expref: 34 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144894.895564:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a0000 00000100:00100000:2.0:1746144894.902197:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.902314:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.902888:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175232128 00000100:00100000:0.0:1746144894.902900:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175232128 00000100:00100000:0.0:1746144894.903326:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5625 00000100:00100000:0.0:1746144894.903334:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+34:31565:x1830965175232128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144894.903352:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144894.903370:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94d9a expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.903399:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144894.903405:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d93 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.903411:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746144894.903414:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d9a expref: 35 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.903452:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d93 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.903464:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d9a expref: 35 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144894.903475:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b3000, rc 0) 00000100:00100000:0.0:1746144894.903522:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+35:31565:x1830965175232128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 189us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144894.903528:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5625 00000100:00100000:3.0:1746144894.904056:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175232256 00000100:00100000:3.0:1746144894.904061:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175232256 00010000:00010000:3.0:1746144894.904082:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d8c expref: 35 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144894.904193:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11040 00000100:00100000:3.0:1746144894.904200:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1983:x1830965175232256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.904210:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.904233:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d8c expref: 35 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.904244:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d8c expref: 35 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.904262:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515328 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d8c expref: 35 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.904454:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.904457:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.904463:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d93 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.904470:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d93 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.904493:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d93 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.904505:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d93 expref: 5 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144894.904518:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172477312:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.904592:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.905881:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172477312:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.905898:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.905946:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1983:x1830965175232256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1745us (3631us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.905955:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11040 00000100:00100000:0.0:1746144894.906472:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.906557:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175232512 00000100:00100000:3.0:1746144894.906562:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175232512 00002000:00100000:3.0:1746144894.906595:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a0380 x1830965175232512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.906610:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a0380 with x1830965175232512 ext(0->4095) 00010000:00010000:3.0:1746144894.906618:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d93 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.906630:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d93 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144894.906636:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a0380 00000100:00100000:3.0:1746144894.906664:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2121 00000100:00100000:3.0:1746144894.906671:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175232512:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:3.0:1746144894.906871:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175232512:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 200us (399us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.906877:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2121 00002000:00100000:3.0:1746144894.906882:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a0380 x1830965175232512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.906890:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a0380 with x1830965175232512 ext(0->4095) 00010000:00010000:3.0:1746144894.906894:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d93 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.906903:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d93 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144894.906909:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a0380 00000100:00100000:0.0:1746144894.909889:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.911168:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175232640 00000100:00100000:3.0:1746144894.911179:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175232640 00010000:00010000:3.0:1746144894.911215:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d93 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144894.911252:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11041 00000100:00100000:3.0:1746144894.911259:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175232640:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.911272:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.911293:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d93 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.911305:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d93 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.911328:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af672751532f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d93 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.911343:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.911345:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.911351:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d9a expref: 33 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.911359:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d9a expref: 33 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.911395:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d9a expref: 33 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.911407:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172477440:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.911495:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.919432:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.919469:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175232896 00000100:00100000:0.0:1746144894.919479:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175232896 00002000:00100000:0.0:1746144894.919527:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a0a80 x1830965175232896/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144894.919537:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a0a80 with x1830965175232896 ext(0->4095) 00002000:00010000:0.0:1746144894.919544:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938a0a80 00000100:00100000:3.0:1746144894.920053:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172477440:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.920074:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.920123:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175232640:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 8863us (10244us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.920134:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11041 00000100:00100000:0.0:1746144894.922173:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4104 00000100:00100000:0.0:1746144894.922189:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1985:x1830965175232896:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144894.922510:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1985:x1830965175232896:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 326us (3088us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144894.922517:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4104 00002000:00100000:0.0:1746144894.922525:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a0a80 x1830965175232896/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144894.922539:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a0a80 with x1830965175232896 ext(0->4095) 00002000:00010000:0.0:1746144894.922543:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938a0a80 00000100:00100000:0.0:1746144894.928228:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.928390:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175233024 00000100:00100000:1.0:1746144894.928401:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175233024 00000100:00100000:1.0:1746144894.928456:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5626 00000100:00100000:1.0:1746144894.928465:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175233024:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.928485:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.928504:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94da1 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.928534:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d9a expref: 33 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.928541:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.928543:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.928546:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.928578:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d9a expref: 33 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.928590:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d9a expref: 33 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144894.928602:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172477568:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.931003:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144894.932755:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172477568:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.932895:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.932917:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4165800, rc 0) 00000100:00100000:1.0:1746144894.933496:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175233024:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5031us (5736us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.933505:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5626 00000100:00100000:0.0:1746144894.934683:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144894.934798:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175233152 00000100:00100000:2.0:1746144894.934805:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175233152 00002000:00100000:2.0:1746144894.934854:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800938a1180 x1830965175233152/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.934864:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a1180 with x1830965175233152 ext(0->7) 00010000:00010000:2.0:1746144894.934871:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d9a expref: 34 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144894.934884:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d9a expref: 34 pid: 8432 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144894.934891:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a1180 00000100:00100000:2.0:1746144894.934907:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2122 00000100:00100000:2.0:1746144894.934914:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1985:x1830965175233152:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144894.935981:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1985:x1830965175233152:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 1061us (1296us total) trans 4294968024 rc 0/0 00000100:00100000:2.0:1746144894.935987:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2122 00002000:00100000:2.0:1746144894.935993:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800938a1180 x1830965175233152/t4294968024(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/448 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.936000:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a1180 with x1830965175233152 ext(0->7) 00010000:00010000:2.0:1746144894.936006:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d9a expref: 36 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144894.936015:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d9a expref: 36 pid: 8432 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144894.936020:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a1180 00000100:00100000:0.0:1746144894.951191:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.951279:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.951351:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175233408 00000100:00100000:3.0:1746144894.951362:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175233408 00010000:00010000:3.0:1746144894.951395:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d9a expref: 36 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144894.951419:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175233280 00000100:00100000:1.0:1746144894.951423:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175233280 00000100:00100000:3.0:1746144894.951424:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11042 00000100:00100000:3.0:1746144894.951431:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+37:1984:x1830965175233408:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.951444:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746144894.951445:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5627 00000100:00100000:1.0:1746144894.951451:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+37:31565:x1830965175233280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.951465:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144894.951466:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d9a expref: 37 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.951479:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d9a expref: 37 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144894.951479:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94da8 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.951499:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af6727515336 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94d9a expref: 38 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144894.951504:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.951511:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.951516:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.951520:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da8 expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.951529:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.951531:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.951537:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.951716:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.951745:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.951757:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 5 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144894.951824:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172477696:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144894.951861:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 5 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.951869:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 5 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144894.951878:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172477824:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144894.951888:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.951901:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9180 going to sleep for 11 seconds 00000100:00100000:1.0:1746144894.953191:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172477696:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144894.953196:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172477824:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.953207:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144894.953212:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da8 expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.953223:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a8600, rc 0) 00000100:00100000:3.0:1746144894.953277:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+37:1984:x1830965175233408:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1845us (2095us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.953287:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11042 00000100:00100000:1.0:1746144894.953364:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+36:31565:x1830965175233280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1912us (2084us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.953370:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5627 00000100:00100000:0.0:1746144894.953524:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.953593:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175233664 00000100:00100000:3.0:1746144894.953597:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175233664 00002000:00100000:3.0:1746144894.953625:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a1880 x1830965175233664/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.953634:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a1880 with x1830965175233664 ext(0->4095) 00010000:00010000:3.0:1746144894.953640:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.953656:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144894.953663:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a1880 00000100:00100000:3.0:1746144894.953678:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2123 00000100:00100000:3.0:1746144894.953683:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175233664:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:3.0:1746144894.954295:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175233664:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 610us (770us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144894.954303:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2123 00002000:00100000:3.0:1746144894.954308:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a1880 x1830965175233664/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144894.954316:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a1880 with x1830965175233664 ext(0->4095) 00010000:00010000:3.0:1746144894.954321:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.954330:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144894.954336:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a1880 00000100:00100000:0.0:1746144894.955276:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.955326:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175233792 00000100:00100000:3.0:1746144894.955330:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175233792 00010000:00010000:3.0:1746144894.955344:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144894.955356:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11043 00000100:00100000:3.0:1746144894.955361:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175233792:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.955367:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.955378:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.955385:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.955401:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4165800/0x4076af672751533d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da1 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.955411:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.955413:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.955418:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da8 expref: 35 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.955424:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da8 expref: 35 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.955445:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da8 expref: 35 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.955452:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172477952:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.955514:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.956590:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172477952:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.956604:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.956627:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175233792:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1264us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.956634:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11043 00000100:00100000:2.0:1746144894.957186:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.957249:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175234048 00000100:00100000:0.0:1746144894.957253:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175234048 00002000:00100000:0.0:1746144894.957286:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d364e00 x1830965175234048/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144894.957294:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d364e00 with x1830965175234048 ext(0->4095) 00002000:00010000:0.0:1746144894.957297:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d364e00 00000100:00100000:0.0:1746144894.957421:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4105 00000100:00100000:0.0:1746144894.957428:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1984:x1830965175234048:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144894.957649:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1984:x1830965175234048:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 221us (463us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144894.957655:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4105 00002000:00100000:0.0:1746144894.957660:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d364e00 x1830965175234048/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144894.957667:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d364e00 with x1830965175234048 ext(0->4095) 00002000:00010000:0.0:1746144894.957669:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d364e00 00000100:00100000:0.0:1746144894.959743:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.960542:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175234176 00000100:00100000:1.0:1746144894.960550:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175234176 00000100:00100000:1.0:1746144894.960592:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5628 00000100:00100000:1.0:1746144894.960600:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175234176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.960631:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.960650:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94daf expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.960679:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da8 expref: 35 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.960686:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.960687:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.960690:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94daf expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.960725:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da8 expref: 35 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.960737:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da8 expref: 35 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144894.960748:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172478080:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.960853:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.967803:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.967989:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172478080:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.968028:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94daf expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.968046:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a9600, rc 0) 00000100:00100000:2.0:1746144894.968138:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175234304 00000100:00100000:2.0:1746144894.968145:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175234304 00002000:00100000:2.0:1746144894.968203:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800938a2300 x1830965175234304/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.968214:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a2300 with x1830965175234304 ext(0->7) 00010000:00010000:2.0:1746144894.968220:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da8 expref: 36 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144894.968237:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da8 expref: 36 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144894.968243:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a2300 00000100:00100000:2.0:1746144894.968264:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2124 00000100:00100000:2.0:1746144894.968386:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1985:x1830965175234304:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144894.968707:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175234176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 8105us (8968us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.968714:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5628 00000100:00100000:2.0:1746144894.970700:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1985:x1830965175234304:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 2417us (2928us total) trans 4294968025 rc 0/0 00000100:00100000:2.0:1746144894.970711:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2124 00002000:00100000:2.0:1746144894.970722:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800938a2300 x1830965175234304/t4294968025(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/448 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.970730:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a2300 with x1830965175234304 ext(0->7) 00010000:00010000:2.0:1746144894.970739:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da8 expref: 38 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144894.970752:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da8 expref: 38 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144894.970759:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a2300 00000100:00100000:0.0:1746144894.974536:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144894.974635:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.974714:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175234432 00000100:00100000:3.0:1746144894.974733:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175234432 00010000:00010000:3.0:1746144894.974801:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da8 expref: 38 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144894.974838:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11044 00000100:00100000:3.0:1746144894.974848:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1985:x1830965175234432:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.974863:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.974886:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da8 expref: 38 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.974898:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da8 expref: 38 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.974922:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af6727515344 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94da8 expref: 38 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.974967:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.974969:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.974977:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94daf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.974985:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94daf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.975032:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94daf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.975046:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172478208:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144894.975111:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175234560 00000100:00100000:1.0:1746144894.975116:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175234560 00000100:00100000:3.0:1746144894.975117:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9300 going to sleep for 11 seconds 00000100:00100000:1.0:1746144894.975140:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5629 00000100:00100000:1.0:1746144894.975145:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:31565:x1830965175234560:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.975226:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.975240:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94db6 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.975257:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94daf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.975264:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.975265:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144894.975268:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94db6 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.975287:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94daf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.975297:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94daf expref: 5 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144894.975305:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172478336:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.975330:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.976613:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.976685:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172478208:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144894.976695:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172478336:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144894.976700:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144894.976711:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94db6 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.976721:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f27a00, rc 0) 00000100:00100000:2.0:1746144894.976939:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175234816 00000100:00100000:2.0:1746144894.976944:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175234816 00000100:00100000:3.0:1746144894.977027:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1985:x1830965175234432:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2178us (2499us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.977027:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+39:31565:x1830965175234560:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1881us (2392us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.977034:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11044 00000100:00100000:1.0:1746144894.977034:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5629 00002000:00100000:2.0:1746144894.977161:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a2d80 x1830965175234816/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.977170:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a2d80 with x1830965175234816 ext(0->4095) 00010000:00010000:2.0:1746144894.977176:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94daf expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144894.977191:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94daf expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144894.977197:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a2d80 00000100:00100000:2.0:1746144894.977221:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2125 00000100:00100000:2.0:1746144894.977228:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175234816:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144894.977395:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175234816:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 167us (785us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144894.977401:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2125 00002000:00100000:2.0:1746144894.977406:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a2d80 x1830965175234816/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144894.977414:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a2d80 with x1830965175234816 ext(0->4095) 00010000:00010000:2.0:1746144894.977418:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94daf expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144894.977426:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94daf expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144894.977431:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a2d80 00000100:00100000:0.0:1746144894.979841:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.979978:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175234944 00000100:00100000:3.0:1746144894.979985:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175234944 00010000:00010000:3.0:1746144894.980012:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94daf expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144894.980034:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11045 00000100:00100000:3.0:1746144894.980039:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175234944:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.980050:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.980068:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94daf expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.980079:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94daf expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.980118:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a9600/0x4076af672751534b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94daf expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.980222:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.980224:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.980230:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94db6 expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.980247:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94db6 expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.980274:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94db6 expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.980282:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172478464:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.980359:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144894.983273:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172478464:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.983296:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144894.983343:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175234944:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3302us (3507us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.983353:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11045 00000100:00100000:0.0:1746144894.984557:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.984623:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175235200 00000100:00100000:1.0:1746144894.984630:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175235200 00002000:00100000:1.0:1746144894.984674:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a3480 x1830965175235200/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.984689:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a3480 with x1830965175235200 ext(0->4095) 00002000:00010000:1.0:1746144894.984694:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938a3480 00000100:00100000:1.0:1746144894.984924:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4106 00000100:00100000:1.0:1746144894.984940:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1983:x1830965175235200:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144894.985504:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1983:x1830965175235200:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 564us (949us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144894.985553:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4106 00002000:00100000:1.0:1746144894.985561:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a3480 x1830965175235200/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.985568:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a3480 with x1830965175235200 ext(0->4095) 00002000:00010000:1.0:1746144894.985571:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938a3480 00000100:00100000:0.0:1746144894.986992:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.987039:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175235328 00000100:00100000:1.0:1746144894.987044:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175235328 00000100:00100000:1.0:1746144894.987076:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5630 00000100:00100000:1.0:1746144894.987083:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175235328:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144894.987094:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144894.987111:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af6727515359 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94dbd expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.987138:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94db6 expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.987146:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.987148:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144894.987151:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af6727515359 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dbd expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.987181:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94db6 expref: 37 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.987193:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94db6 expref: 37 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144894.987204:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172478592:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144894.987269:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144894.989011:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172478592:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144894.989032:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af6727515359 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dbd expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144894.989043:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009334b000, rc 0) 00000100:00100000:1.0:1746144894.989076:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175235328:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1994us (2087us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144894.989082:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5630 00000100:00100000:0.0:1746144894.989443:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144894.989518:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175235456 00000100:00100000:1.0:1746144894.989522:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175235456 00002000:00100000:1.0:1746144894.989558:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800938a3b80 x1830965175235456/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.989566:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a3b80 with x1830965175235456 ext(0->7) 00010000:00010000:1.0:1746144894.989573:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94db6 expref: 38 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144894.989601:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94db6 expref: 38 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144894.989608:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a3b80 00000100:00100000:1.0:1746144894.989632:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2126 00000100:00100000:1.0:1746144894.989639:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1985:x1830965175235456:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144894.990026:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1985:x1830965175235456:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 386us (583us total) trans 4294968026 rc 0/0 00000100:00100000:1.0:1746144894.990033:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2126 00002000:00100000:1.0:1746144894.990038:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800938a3b80 x1830965175235456/t4294968026(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:535/0 lens 496/448 e 0 to 0 dl 1746144905 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.990046:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a3b80 with x1830965175235456 ext(0->7) 00010000:00010000:1.0:1746144894.990051:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94db6 expref: 40 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144894.990060:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94db6 expref: 40 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144894.990065:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a3b80 00000100:00100000:0.0:1746144894.993071:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.993161:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175235584 00000100:00100000:3.0:1746144894.993169:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175235584 00010000:00010000:3.0:1746144894.993205:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94db6 expref: 40 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144894.993242:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11046 00000100:00100000:3.0:1746144894.993249:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1984:x1830965175235584:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144894.993264:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144894.993285:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94db6 expref: 40 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.993303:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94db6 expref: 40 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.993326:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af6727515352 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94db6 expref: 40 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144894.994021:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.994023:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144894.994032:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af6727515359 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dbd expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.994040:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af6727515359 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dbd expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144894.994077:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af6727515359 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dbd expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144894.994089:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172478720:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144894.994180:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144894.996316:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144894.996487:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172478720:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144894.996509:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144894.996527:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175235840 00000100:00100000:1.0:1746144894.996533:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175235840 00000100:00100000:3.0:1746144894.996546:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1984:x1830965175235584:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3296us (3483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144894.996556:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11046 00002000:00100000:1.0:1746144894.996570:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094000 x1830965175235840/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/0 e 0 to 0 dl 1746144905 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.996579:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094000 with x1830965175235840 ext(0->4095) 00002000:00010000:1.0:1746144894.996584:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a094000 00000100:00100000:1.0:1746144894.997053:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4107 00000100:00100000:1.0:1746144894.997060:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175235840:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144894.998982:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175235840:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 1914us (2664us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144894.998992:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4107 00002000:00100000:1.0:1746144894.999002:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094000 x1830965175235840/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:535/0 lens 488/4536 e 0 to 0 dl 1746144905 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144894.999011:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094000 with x1830965175235840 ext(0->4095) 00002000:00010000:1.0:1746144894.999015:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a094000 00000100:00100000:0.0:1746144895.003812:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.004111:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175235968 00000100:00100000:1.0:1746144895.004121:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175235968 00000100:00080000:0.0:1746144895.004240:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746144895.004299:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5631 00000100:00100000:1.0:1746144895.004308:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+39:31579:x1830965175235968:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.004326:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.004343:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94dc4 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.004371:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af6727515359 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dbd expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.004377:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.004379:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.004382:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dc4 expref: 40 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.004419:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af6727515359 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dbd expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.004473:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af6727515359 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dbd expref: 5 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.004626:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172478848:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144895.004913:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.005342:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.005474:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175236096 00000100:00100000:2.0:1746144895.005479:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175236096 00000100:00100000:2.0:1746144895.005517:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5632 00000100:00100000:2.0:1746144895.005523:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+41:31565:x1830965175236096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.005532:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.005542:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94dcb expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.005557:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.005561:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dc4 expref: 42 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.005566:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.005569:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dcb expref: 42 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.005593:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dc4 expref: 42 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.005603:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dcb expref: 42 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.005613:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1ae00, rc 0) 00000100:00100000:2.0:1746144895.005642:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+42:31565:x1830965175236096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 118us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.005648:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5632 00000100:00100000:1.0:1746144895.008644:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172478848:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144895.008674:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dc4 expref: 41 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.008690:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009334bc00, rc 0) 00000100:00100000:1.0:1746144895.009049:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+41:31579:x1830965175235968:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4740us (5286us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.009057:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5631 00000100:00100000:0.0:1746144895.009315:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.009364:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175236224 00000100:00100000:3.0:1746144895.009370:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175236224 00010000:00010000:3.0:1746144895.009407:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af6727515359 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dbd expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.009427:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11047 00000100:00100000:3.0:1746144895.009433:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175236224:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.009444:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.009465:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af6727515359 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dbd expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.009476:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af6727515359 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dbd expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.009497:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af6727515359 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dbd expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.009526:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.009528:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.009535:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dc4 expref: 40 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.009542:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dc4 expref: 40 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.009572:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dc4 expref: 40 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.009583:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dc4 expref: 40 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.009593:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172479104:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.009648:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9300 going to sleep for 11 seconds 00000100:00080000:0.0:1746144895.009780:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746144895.013234:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172479104:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.013258:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.013309:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175236224:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3874us (3992us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.013320:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11047 00000100:00100000:0.0:1746144895.013878:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.014116:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175236480 00000100:00100000:2.0:1746144895.014123:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175236480 00002000:00100000:2.0:1746144895.014164:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094e00 x1830965175236480/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.014174:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094e00 with x1830965175236480 ext(0->4095) 00010000:00010000:2.0:1746144895.014183:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dc4 expref: 41 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.014196:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dc4 expref: 41 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.014203:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a094e00 00000100:00100000:2.0:1746144895.014228:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2127 00000100:00100000:2.0:1746144895.014235:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1985:x1830965175236480:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144895.014884:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1985:x1830965175236480:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 649us (1007us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.014890:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2127 00002000:00100000:2.0:1746144895.014895:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094e00 x1830965175236480/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.014903:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094e00 with x1830965175236480 ext(0->4095) 00010000:00010000:2.0:1746144895.014907:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dc4 expref: 41 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.014916:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dc4 expref: 41 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.014921:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a094e00 00000100:00100000:0.0:1746144895.016366:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.016997:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175236608 00000100:00100000:1.0:1746144895.017004:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175236608 00000100:00100000:1.0:1746144895.017049:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5633 00000100:00100000:1.0:1746144895.017056:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175236608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.017068:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.017086:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94dd2 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.017111:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.017118:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dcb expref: 40 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.017124:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144895.017127:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd2 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.017168:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dcb expref: 40 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.017181:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd2 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.017191:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009334b000, rc 0) 00000100:00100000:1.0:1746144895.017233:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175236608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 178us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.017239:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5633 00000100:00100000:0.0:1746144895.018053:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.018102:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175236736 00000100:00100000:3.0:1746144895.018108:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175236736 00010000:00010000:3.0:1746144895.018125:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dc4 expref: 41 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.018158:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11048 00000100:00100000:3.0:1746144895.018163:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1984:x1830965175236736:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.018172:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.018192:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dc4 expref: 41 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.018202:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dc4 expref: 41 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.018221:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515360 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dc4 expref: 41 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.018244:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.018247:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.018253:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dcb expref: 40 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.018260:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dcb expref: 40 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.018282:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dcb expref: 40 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.018291:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dcb expref: 40 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.018302:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172479360:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.018383:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.019759:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172479360:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.019804:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.019833:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1984:x1830965175236736:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1669us (1780us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.019842:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11048 00000100:00100000:0.0:1746144895.020058:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.020348:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175236992 00000100:00100000:3.0:1746144895.020353:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175236992 00002000:00100000:3.0:1746144895.020386:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a095880 x1830965175236992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.020400:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a095880 with x1830965175236992 ext(0->4095) 00010000:00010000:3.0:1746144895.020408:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dcb expref: 40 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.020422:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dcb expref: 40 pid: 8432 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.020429:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a095880 00000100:00100000:3.0:1746144895.020455:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2128 00000100:00100000:3.0:1746144895.020462:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1984:x1830965175236992:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144895.020628:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1984:x1830965175236992:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 166us (571us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.020634:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2128 00002000:00100000:3.0:1746144895.020640:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a095880 x1830965175236992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.020646:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a095880 with x1830965175236992 ext(0->4095) 00010000:00010000:3.0:1746144895.020651:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dcb expref: 40 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.020659:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dcb expref: 40 pid: 8432 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.020664:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a095880 00000100:00100000:0.0:1746144895.022053:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.022162:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175237120 00000100:00100000:1.0:1746144895.022167:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175237120 00000100:00100000:0.0:1746144895.022188:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.022207:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5634 00000100:00100000:1.0:1746144895.022213:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+40:31565:x1830965175237120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:3.0:1746144895.022249:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175237248 00000100:00100000:3.0:1746144895.022253:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175237248 00010000:00010000:1.0:1746144895.022267:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.022268:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dcb expref: 41 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.022282:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009439ac00/0x4076af6727515375 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94dd9 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.022285:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11049 00000100:00100000:3.0:1746144895.022290:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+42:1985:x1830965175237248:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.022298:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.022304:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.022309:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd2 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.022319:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144895.022323:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009439ac00/0x4076af6727515375 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd9 expref: 42 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.022390:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dcb expref: 42 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.022399:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dcb expref: 42 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.022414:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd2 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.022420:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1ae00/0x4076af6727515367 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dcb expref: 42 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.022425:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009439ac00/0x4076af6727515375 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd9 expref: 42 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.022431:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.022432:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.022437:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd2 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.022444:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd2 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.022452:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009439ac00, rc 0) 00010000:00010000:3.0:1746144895.022462:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd2 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.022471:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd2 expref: 5 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.022481:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172479616:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.022520:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+41:31565:x1830965175237120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 306us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.022525:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5634 00000100:00100000:3.0:1746144895.022539:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.024022:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172479616:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.024037:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.024079:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50dd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1985:x1830965175237248:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1787us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.024088:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11049 00000100:00100000:2.0:1746144895.025250:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.025315:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175237504 00000100:00100000:0.0:1746144895.025322:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175237504 00002000:00100000:0.0:1746144895.025360:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d367b80 x1830965175237504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144895.025370:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d367b80 with x1830965175237504 ext(0->4095) 00010000:00010000:0.0:1746144895.025378:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd2 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:0.0:1746144895.025390:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd2 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:0.0:1746144895.025396:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d367b80 00000100:00100000:0.0:1746144895.025583:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2129 00000100:00100000:0.0:1746144895.025591:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d367b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175237504:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:0.0:1746144895.025961:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d367b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175237504:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 370us (713us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144895.025967:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2129 00002000:00100000:0.0:1746144895.025972:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d367b80 x1830965175237504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144895.025979:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d367b80 with x1830965175237504 ext(0->4095) 00010000:00010000:0.0:1746144895.025983:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd2 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:0.0:1746144895.025991:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd2 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:0.0:1746144895.025997:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012d367b80 00000100:00100000:0.0:1746144895.029025:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.029073:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175237632 00000100:00100000:3.0:1746144895.029082:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175237632 00010000:00010000:3.0:1746144895.029116:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd2 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.029204:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11050 00000100:00100000:3.0:1746144895.029213:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175237632:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.029225:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.029247:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd2 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.029258:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd2 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.029282:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751536e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd2 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.029313:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.029315:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.029323:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009439ac00/0x4076af6727515375 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd9 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.029331:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009439ac00/0x4076af6727515375 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd9 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.029366:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009439ac00/0x4076af6727515375 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd9 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.029378:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172479744:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.029460:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.031635:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172479744:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.031657:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.031700:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175237632:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2487us (2682us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.031710:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11050 00000100:00100000:2.0:1746144895.032073:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.032265:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175237888 00000100:00100000:0.0:1746144895.032271:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175237888 00002000:00100000:0.0:1746144895.032311:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d364a80 x1830965175237888/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144895.032329:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d364a80 with x1830965175237888 ext(0->4095) 00002000:00010000:0.0:1746144895.032333:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d364a80 00000100:00100000:0.0:1746144895.032654:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4108 00000100:00100000:0.0:1746144895.032662:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1985:x1830965175237888:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144895.032866:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1985:x1830965175237888:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 204us (793us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144895.032872:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4108 00002000:00100000:0.0:1746144895.032878:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d364a80 x1830965175237888/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144895.032884:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d364a80 with x1830965175237888 ext(0->4095) 00002000:00010000:0.0:1746144895.032887:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d364a80 00000100:00100000:0.0:1746144895.034688:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.034801:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175238016 00000100:00100000:1.0:1746144895.034807:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175238016 00000100:00100000:1.0:1746144895.034850:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5635 00000100:00100000:1.0:1746144895.034857:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175238016:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.034870:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.034887:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751537c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94de0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.034914:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009439ac00/0x4076af6727515375 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd9 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.034921:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.034924:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.034936:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751537c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de0 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.034966:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009439ac00/0x4076af6727515375 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd9 expref: 39 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.034977:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009439ac00/0x4076af6727515375 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd9 expref: 39 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.034988:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172479872:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144895.035061:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.037237:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.037303:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175238144 00000100:00100000:3.0:1746144895.037309:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175238144 00010000:00010000:3.0:1746144895.037337:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009439ac00/0x4076af6727515375 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd9 expref: 40 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.037361:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11051 00000100:00100000:3.0:1746144895.037367:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1985:x1830965175238144:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.037379:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.037399:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009439ac00/0x4076af6727515375 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd9 expref: 40 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.037410:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009439ac00/0x4076af6727515375 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd9 expref: 40 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.037433:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.037436:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.037454:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751537c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de0 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.037462:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751537c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de0 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.037492:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751537c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de0 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.037503:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172480000:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.037567:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9300 going to sleep for 11 seconds 00010000:00010000:1.0:1746144895.037817:0:20722:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009439ac00/0x4076af6727515375 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dd9 expref: 40 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.037844:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172479872:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144895.037865:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751537c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de0 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.037873:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009334b000, rc 0) 00000100:00100000:1.0:1746144895.037909:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175238016:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3053us (3226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.037916:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5635 00000100:00100000:0.0:1746144895.040232:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.040338:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172480000:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.040355:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.040388:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1985:x1830965175238144:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3020us (3156us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.040397:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11051 00000100:00100000:1.0:1746144895.040639:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175238400 00000100:00100000:1.0:1746144895.040645:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175238400 00002000:00100000:1.0:1746144895.040680:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a096a00 x1830965175238400/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.040694:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a096a00 with x1830965175238400 ext(0->4095) 00002000:00010000:1.0:1746144895.040699:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a096a00 00000100:00100000:1.0:1746144895.040716:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4109 00000100:00100000:1.0:1746144895.040722:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175238400:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144895.042363:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175238400:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1635us (2135us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144895.042371:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4109 00002000:00100000:1.0:1746144895.042377:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a096a00 x1830965175238400/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.042385:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a096a00 with x1830965175238400 ext(0->4095) 00002000:00010000:1.0:1746144895.042388:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a096a00 00000100:00100000:0.0:1746144895.043173:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.043303:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175238528 00000100:00100000:1.0:1746144895.043310:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175238528 00000100:00100000:1.0:1746144895.043354:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5636 00000100:00100000:1.0:1746144895.043361:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+39:31565:x1830965175238528:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.043375:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.043393:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94de7 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.043418:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751537c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de0 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.043425:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.043427:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.043431:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de7 expref: 40 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.043462:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751537c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de0 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.043473:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751537c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de0 expref: 5 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.043484:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172480128:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144895.043570:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.045321:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.046288:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175238656 00000100:00100000:3.0:1746144895.046295:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175238656 00000100:00100000:1.0:1746144895.046977:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800932a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172480128:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144895.047007:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de7 expref: 41 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.047010:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5637 00010000:00010000:1.0:1746144895.047022:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009334be00, rc 0) 00000100:00100000:3.0:1746144895.047027:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+41:31579:x1830965175238656:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.047045:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.047060:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751538a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94dee expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144895.047064:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+41:31565:x1830965175238528:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3703us (3892us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.047070:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5636 00010000:00010000:3.0:1746144895.047085:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.047091:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de7 expref: 41 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.047097:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.047100:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751538a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dee expref: 41 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.047131:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de7 expref: 41 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.047146:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751538a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dee expref: 41 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.047154:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:3.0:1746144895.047192:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+41:31579:x1830965175238656:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 173us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.047198:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5637 00000100:00100000:0.0:1746144895.047596:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.047663:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175238784 00000100:00100000:3.0:1746144895.047667:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175238784 00010000:00010000:3.0:1746144895.047684:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751537c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de0 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.047701:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11052 00000100:00100000:3.0:1746144895.047705:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175238784:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.047715:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.047733:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751537c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de0 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.047744:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751537c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de0 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.047777:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009334b000/0x4076af672751537c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de0 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.047798:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.047800:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.047807:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de7 expref: 40 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.047814:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de7 expref: 40 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.047835:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de7 expref: 40 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.047844:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de7 expref: 40 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.047854:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172480384:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.047911:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.051141:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172480384:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.051159:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.051210:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175238784:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3503us (3614us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.051218:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11052 00000100:00100000:0.0:1746144895.051615:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.051976:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175239040 00000100:00100000:1.0:1746144895.051983:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175239040 00002000:00100000:1.0:1746144895.052027:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a097800 x1830965175239040/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.052037:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a097800 with x1830965175239040 ext(0->4095) 00010000:00010000:1.0:1746144895.052047:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de7 expref: 41 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.052064:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de7 expref: 41 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144895.052071:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a097800 00000100:00100000:1.0:1746144895.052103:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2130 00000100:00100000:1.0:1746144895.052110:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1984:x1830965175239040:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144895.052304:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1984:x1830965175239040:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 194us (693us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144895.052310:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2130 00002000:00100000:1.0:1746144895.052315:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a097800 x1830965175239040/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.052321:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a097800 with x1830965175239040 ext(0->4095) 00010000:00010000:1.0:1746144895.052326:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de7 expref: 41 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.052334:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de7 expref: 41 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144895.052339:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a097800 00000100:00100000:0.0:1746144895.055174:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.055239:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175239168 00000100:00100000:3.0:1746144895.055247:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175239168 00010000:00010000:3.0:1746144895.055278:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de7 expref: 41 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.055318:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11053 00000100:00100000:3.0:1746144895.055326:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1985:x1830965175239168:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.055338:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.055359:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de7 expref: 41 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.055371:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de7 expref: 41 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.055396:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515383 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94de7 expref: 41 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.055425:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.055428:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.055434:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751538a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dee expref: 40 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.055442:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751538a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dee expref: 40 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.055476:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751538a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dee expref: 40 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.055488:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172480512:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.055577:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.058869:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172480512:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.058890:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144895.058894:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.058973:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175239424 00000100:00100000:2.0:1746144895.058980:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175239424 00002000:00100000:2.0:1746144895.059038:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094a80 x1830965175239424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.059047:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094a80 with x1830965175239424 ext(0->4095) 00002000:00010000:2.0:1746144895.059051:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a094a80 00000100:00100000:2.0:1746144895.059082:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4110 00000100:00100000:2.0:1746144895.059090:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1984:x1830965175239424:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144895.059153:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1985:x1830965175239168:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3827us (3987us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.059160:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11053 00000100:00100000:2.0:1746144895.060039:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1984:x1830965175239424:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 949us (1145us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.060046:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4110 00002000:00100000:2.0:1746144895.060050:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094a80 x1830965175239424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.060058:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094a80 with x1830965175239424 ext(0->4095) 00002000:00010000:2.0:1746144895.060061:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a094a80 00000100:00100000:0.0:1746144895.061727:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.061823:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175239552 00000100:00100000:2.0:1746144895.061830:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175239552 00000100:00100000:2.0:1746144895.061879:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5638 00000100:00100000:2.0:1746144895.061886:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175239552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.061901:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.061918:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94df5 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.061955:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751538a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dee expref: 39 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.061964:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.061967:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.061971:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94df5 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.062001:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751538a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dee expref: 39 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.062012:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751538a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dee expref: 39 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.062024:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172480640:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.062097:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.065524:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172480640:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.065557:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94df5 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.065573:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b000, rc 0) 00000100:00100000:2.0:1746144895.065622:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175239552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3736us (3900us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.065630:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5638 00000100:00100000:0.0:1746144895.066555:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.066961:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175239680 00000100:00100000:3.0:1746144895.066969:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175239680 00010000:00010000:3.0:1746144895.066996:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751538a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dee expref: 40 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.067017:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11054 00000100:00100000:3.0:1746144895.067023:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091684000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1984:x1830965175239680:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.067034:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.067054:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751538a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dee expref: 40 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.067064:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751538a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dee expref: 40 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.067087:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751538a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dee expref: 40 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.067115:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.067117:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.067124:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94df5 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.067136:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94df5 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.067167:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94df5 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.067178:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172480768:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.067244:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9300 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.070701:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.070823:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.070901:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175240064 00000100:00100000:2.0:1746144895.070909:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175240064 00000100:00100000:2.0:1746144895.070971:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5639 00000100:00100000:2.0:1746144895.070980:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+40:31565:x1830965175240064:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.070999:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.071019:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94dfc expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.071053:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94df5 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.071060:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.071062:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.071065:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dfc expref: 41 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.071096:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94df5 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.071108:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94df5 expref: 5 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.071120:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172480896:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.071213:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.071228:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175239936 00000100:00100000:2.0:1746144895.071231:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175239936 00002000:00100000:2.0:1746144895.071259:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091684380 x1830965175239936/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.071267:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091684380 with x1830965175239936 ext(0->4095) 00010000:00010000:2.0:1746144895.071273:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94df5 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.071282:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94df5 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.072278:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172480768:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.072296:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.072342:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091684000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1984:x1830965175239680:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5318us (5787us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.072353:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11054 00002000:00010000:2.0:1746144895.073017:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091684380 00000100:00100000:2.0:1746144895.073049:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2131 00000100:00100000:2.0:1746144895.073060:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175239936:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144895.073239:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175239936:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 182us (2549us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.073245:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2131 00002000:00100000:2.0:1746144895.073252:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091684380 x1830965175239936/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.073261:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091684380 with x1830965175239936 ext(0->4095) 00010000:00010000:2.0:1746144895.073268:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94df5 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.073278:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94df5 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.073284:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091684380 00000100:00100000:3.0:1746144895.073632:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172480896:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144895.073650:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dfc expref: 40 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.073663:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b600, rc 0) 00000100:00100000:3.0:1746144895.074015:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+40:31565:x1830965175240064:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3036us (3191us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.074022:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5639 00000100:00100000:0.0:1746144895.075313:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.075432:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175240192 00000100:00100000:3.0:1746144895.075438:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175240192 00000100:00100000:0.0:1746144895.075485:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.075624:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5640 00000100:00100000:3.0:1746144895.075632:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+40:31579:x1830965175240192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.075646:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.075660:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751539f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e03 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.075682:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746144895.075684:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175240320 00010000:00010000:3.0:1746144895.075687:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dfc expref: 41 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144895.075687:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175240320 00010000:00010000:3.0:1746144895.075693:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.075696:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751539f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e03 expref: 41 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.075704:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94df5 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.075728:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dfc expref: 41 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144895.075732:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11055 00000100:00100000:2.0:1746144895.075737:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175240320:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.075738:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751539f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e03 expref: 41 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.075746:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.075747:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00010000:00010000:2.0:1746144895.075786:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94df5 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.075795:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94df5 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.075806:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+41:31579:x1830965175240192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 175us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.075811:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5640 00010000:00010000:2.0:1746144895.075813:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af6727515391 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94df5 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.075826:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.075827:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.075832:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dfc expref: 40 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.075870:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dfc expref: 40 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.075891:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dfc expref: 40 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.075902:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dfc expref: 40 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.075919:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172481152:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144895.075987:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.077749:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172481152:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144895.077787:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144895.077791:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.077822:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175240320:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2084us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.077831:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11055 00000100:00100000:3.0:1746144895.077900:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175240576 00000100:00100000:3.0:1746144895.077904:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175240576 00002000:00100000:3.0:1746144895.077941:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091685180 x1830965175240576/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.077957:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091685180 with x1830965175240576 ext(0->4095) 00010000:00010000:3.0:1746144895.078050:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dfc expref: 41 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.078062:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dfc expref: 41 pid: 8432 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.078068:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091685180 00000100:00100000:3.0:1746144895.078092:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2132 00000100:00100000:3.0:1746144895.078099:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1985:x1830965175240576:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144895.078259:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1985:x1830965175240576:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 160us (467us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.078265:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2132 00002000:00100000:3.0:1746144895.078271:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091685180 x1830965175240576/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.078278:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091685180 with x1830965175240576 ext(0->4095) 00010000:00010000:3.0:1746144895.078282:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dfc expref: 41 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.078291:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dfc expref: 41 pid: 8432 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.078297:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091685180 00000100:00100000:0.0:1746144895.080049:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.080493:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175240704 00000100:00100000:2.0:1746144895.080499:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175240704 00010000:00010000:2.0:1746144895.080528:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dfc expref: 41 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.080852:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11056 00000100:00100000:2.0:1746144895.080860:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1985:x1830965175240704:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144895.080872:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144895.080891:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dfc expref: 41 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.080904:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dfc expref: 41 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.080940:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b600/0x4076af6727515398 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94dfc expref: 41 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.081287:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.081290:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.081298:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751539f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e03 expref: 40 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.081307:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751539f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e03 expref: 40 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.081346:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751539f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e03 expref: 40 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144895.081360:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172481280:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144895.081955:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.085389:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172481280:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144895.085416:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144895.085473:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50dd450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1985:x1830965175240704:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4612us (5426us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.085484:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11056 00000100:00100000:0.0:1746144895.085577:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.085977:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175240960 00000100:00100000:2.0:1746144895.085984:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175240960 00002000:00100000:2.0:1746144895.086021:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091685500 x1830965175240960/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.086030:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091685500 with x1830965175240960 ext(0->4095) 00002000:00010000:2.0:1746144895.086035:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091685500 00000100:00100000:2.0:1746144895.086064:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4111 00000100:00100000:2.0:1746144895.086071:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1985:x1830965175240960:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144895.086251:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1985:x1830965175240960:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 180us (674us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.086257:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4111 00002000:00100000:2.0:1746144895.086262:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091685500 x1830965175240960/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.086269:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091685500 with x1830965175240960 ext(0->4095) 00002000:00010000:2.0:1746144895.086272:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091685500 00000100:00100000:0.0:1746144895.089067:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.089130:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175241088 00000100:00100000:3.0:1746144895.089139:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175241088 00000100:00100000:3.0:1746144895.089723:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5641 00000100:00100000:3.0:1746144895.089732:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175241088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.089750:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.089821:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e0a expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.089851:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751539f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e03 expref: 39 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.089859:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.089861:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.089865:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e0a expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.089896:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751539f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e03 expref: 39 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.089908:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751539f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e03 expref: 39 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.089920:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172481408:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144895.090018:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.092306:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172481408:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144895.092338:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e0a expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.092360:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:3.0:1746144895.092412:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175241088:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2680us (3353us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.092420:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5641 00000100:00100000:0.0:1746144895.095984:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.096097:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.096200:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175241216 00000100:00100000:2.0:1746144895.096210:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175241216 00010000:00010000:2.0:1746144895.096258:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751539f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e03 expref: 40 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.096288:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11057 00000100:00100000:2.0:1746144895.096296:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1985:x1830965175241216:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144895.096309:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144895.096332:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751539f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e03 expref: 40 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.096345:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751539f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e03 expref: 40 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.096371:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751539f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e03 expref: 40 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.096404:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.096406:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.096414:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e0a expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.096422:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e0a expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.096457:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e0a expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144895.096475:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172481536:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144895.096552:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.096708:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175241344 00000100:00100000:3.0:1746144895.096712:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175241344 00000100:00100000:3.0:1746144895.096736:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5642 00000100:00100000:3.0:1746144895.096741:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+40:31565:x1830965175241344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.096754:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.096793:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e11 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.096810:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e0a expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.096816:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.096817:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.096820:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e11 expref: 41 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.096838:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e0a expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.096849:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e0a expref: 5 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.096864:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172481664:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144895.096898:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.100252:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172481664:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144895.100285:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e11 expref: 41 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.100301:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:3.0:1746144895.101049:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+41:31565:x1830965175241344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4304us (4948us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.101059:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5642 00000100:00100000:1.0:1746144895.101297:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.101411:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172481536:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144895.101427:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144895.101451:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1985:x1830965175241216:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5157us (5479us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.101459:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11057 00000100:00100000:3.0:1746144895.101519:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175241600 00000100:00100000:3.0:1746144895.101525:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175241600 00002000:00100000:3.0:1746144895.101559:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932a8e00 x1830965175241600/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.101569:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a8e00 with x1830965175241600 ext(0->4095) 00010000:00010000:3.0:1746144895.101576:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e0a expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.101587:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e0a expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.101594:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932a8e00 00000100:00100000:3.0:1746144895.101607:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2133 00000100:00100000:3.0:1746144895.101613:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175241600:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144895.101783:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175241600:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 169us (486us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.101789:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2133 00002000:00100000:3.0:1746144895.101793:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932a8e00 x1830965175241600/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.101801:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a8e00 with x1830965175241600 ext(0->4095) 00010000:00010000:3.0:1746144895.101806:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e0a expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.101815:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e0a expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.101821:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932a8e00 00000100:00100000:0.0:1746144895.105533:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.105644:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175241728 00000100:00100000:2.0:1746144895.105652:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175241728 00010000:00010000:2.0:1746144895.105691:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e0a expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.105718:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11058 00000100:00100000:2.0:1746144895.105725:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091686300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175241728:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144895.105738:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144895.105758:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e0a expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.105797:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e0a expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.105821:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275153a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e0a expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.106134:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.106137:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.106145:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e11 expref: 39 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.106154:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e11 expref: 39 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.106188:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e11 expref: 39 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144895.106199:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172481792:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144895.106664:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.108277:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172481792:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144895.108299:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144895.108333:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091686300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175241728:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2609us (2811us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.108343:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11058 00000100:00100000:0.0:1746144895.109200:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.109270:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175241984 00000100:00100000:2.0:1746144895.109276:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175241984 00002000:00100000:2.0:1746144895.109312:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091686680 x1830965175241984/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.109322:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091686680 with x1830965175241984 ext(0->4095) 00002000:00010000:2.0:1746144895.109326:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091686680 00000100:00100000:2.0:1746144895.109354:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4112 00000100:00100000:2.0:1746144895.109360:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1984:x1830965175241984:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144895.110137:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091686680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+40:1984:x1830965175241984:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 775us (937us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.110145:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4112 00002000:00100000:2.0:1746144895.110151:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091686680 x1830965175241984/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.110158:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091686680 with x1830965175241984 ext(0->4095) 00002000:00010000:2.0:1746144895.110161:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091686680 00000100:00100000:0.0:1746144895.125079:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.127355:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175242112 00000100:00100000:3.0:1746144895.127369:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175242112 00000100:00100000:3.0:1746144895.127425:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5643 00000100:00100000:3.0:1746144895.127433:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175242112:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.127450:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.127469:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e18 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.127499:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e11 expref: 39 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.127506:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.127508:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.127512:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e18 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.127544:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e11 expref: 39 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.127556:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e11 expref: 39 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.127567:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172481920:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144895.127652:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.136934:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.137037:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.137147:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175242240 00000100:00100000:1.0:1746144895.137156:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175242240 00000100:00100000:1.0:1746144895.137197:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5644 00000100:00100000:1.0:1746144895.137204:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+40:31565:x1830965175242240:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.137223:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.137242:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e1f expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.137275:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.137280:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e18 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.137291:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144895.137294:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e1f expref: 41 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.137333:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e18 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.137344:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e1f expref: 41 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.137359:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009334b800, rc 0) 00000100:00100000:1.0:1746144895.137405:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+41:31565:x1830965175242240:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 201us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.137415:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5644 00000100:00100000:2.0:1746144895.137485:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175242368 00000100:00100000:2.0:1746144895.137490:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175242368 00000100:00100000:3.0:1746144895.137504:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172481920:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144895.137521:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e18 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746144895.137523:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880091686d80 x1830965175242368/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1746144895.137529:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00002000:00100000:2.0:1746144895.137532:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091686d80 with x1830965175242368 ext(0->7) 00010000:00010000:2.0:1746144895.137537:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e11 expref: 41 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.137545:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099698850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175242112:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 10115us (12479us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144895.137547:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e11 expref: 41 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.137551:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5643 00002000:00010000:2.0:1746144895.137553:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091686d80 00000100:00100000:2.0:1746144895.137568:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2134 00000100:00100000:2.0:1746144895.137573:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+41:1985:x1830965175242368:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144895.137920:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091686d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+43:1985:x1830965175242368:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 345us (881us total) trans 4294968027 rc 0/0 00000100:00100000:2.0:1746144895.137935:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2134 00002000:00100000:2.0:1746144895.137940:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880091686d80 x1830965175242368/t4294968027(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/448 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.137953:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091686d80 with x1830965175242368 ext(0->7) 00010000:00010000:2.0:1746144895.137957:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e11 expref: 43 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.137966:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e11 expref: 43 pid: 8432 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.137971:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091686d80 00000100:00100000:0.0:1746144895.147465:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.147692:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175242496 00000100:00100000:2.0:1746144895.147702:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175242496 00010000:00010000:2.0:1746144895.147746:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e11 expref: 43 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:0.0:1746144895.148988:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11059 00000100:00100000:0.0:1746144895.149001:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+43:1985:x1830965175242496:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144895.149017:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144895.149042:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e11 expref: 43 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:0.0:1746144895.149055:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e11 expref: 43 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:0.0:1746144895.149079:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275153ad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e11 expref: 43 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:0.0:1746144895.149115:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144895.149119:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144895.149126:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e18 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144895.149135:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e18 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144895.149171:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e18 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144895.149182:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e18 expref: 5 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:0.0:1746144895.149193:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091687480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172482176:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144895.149284:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.151246:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.151705:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091687480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172482176:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144895.151724:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144895.151801:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+42:1985:x1830965175242496:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2803us (4346us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.151811:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11059 00000100:00100000:3.0:1746144895.152025:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175242752 00000100:00100000:3.0:1746144895.152032:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175242752 00002000:00100000:3.0:1746144895.152071:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091687800 x1830965175242752/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.152079:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091687800 with x1830965175242752 ext(0->4095) 00010000:00010000:3.0:1746144895.152088:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e18 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.152106:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e18 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.152112:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091687800 00000100:00100000:3.0:1746144895.152129:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2135 00000100:00100000:3.0:1746144895.152134:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175242752:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144895.152305:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175242752:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 170us (1065us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.152310:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2135 00002000:00100000:3.0:1746144895.152315:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091687800 x1830965175242752/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.152321:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091687800 with x1830965175242752 ext(0->4095) 00010000:00010000:3.0:1746144895.152326:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e18 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.152335:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e18 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.152341:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091687800 00000100:00100000:0.0:1746144895.155562:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.155671:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175242880 00000100:00100000:2.0:1746144895.155679:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175242880 00010000:00010000:2.0:1746144895.155719:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e18 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.156393:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11060 00000100:00100000:2.0:1746144895.156403:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091687b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175242880:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144895.156417:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144895.156438:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e18 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.156450:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e18 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.156478:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af67275153b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e18 expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.156639:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.156641:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.156649:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e1f expref: 41 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.156658:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e1f expref: 41 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.156691:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e1f expref: 41 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144895.156704:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172482304:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144895.156789:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.159454:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172482304:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144895.159476:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144895.159515:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091687b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175242880:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3112us (3960us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.159524:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11060 00000100:00100000:0.0:1746144895.159829:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.159918:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175243136 00000100:00100000:1.0:1746144895.159937:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175243136 00002000:00100000:1.0:1746144895.159974:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091687480 x1830965175243136/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.159984:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091687480 with x1830965175243136 ext(0->4095) 00002000:00010000:1.0:1746144895.159988:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091687480 00000100:00100000:1.0:1746144895.160408:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4113 00000100:00100000:1.0:1746144895.160416:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+42:1985:x1830965175243136:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144895.160593:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091687480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+42:1985:x1830965175243136:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 178us (764us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144895.160599:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4113 00002000:00100000:1.0:1746144895.160604:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091687480 x1830965175243136/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.160612:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091687480 with x1830965175243136 ext(0->4095) 00002000:00010000:1.0:1746144895.160615:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091687480 00000100:00100000:0.0:1746144895.167713:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.167801:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175243264 00000100:00100000:2.0:1746144895.167811:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175243264 00000100:00100000:2.0:1746144895.167874:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5645 00000100:00100000:2.0:1746144895.167883:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175243264:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.167905:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.167923:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e26 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.167960:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e1f expref: 41 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.167967:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.167969:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.167972:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e26 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.168002:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e1f expref: 41 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.168013:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e1f expref: 41 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.168025:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172482432:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.168100:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.174357:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172482432:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.174396:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e26 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.174413:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1a000, rc 0) 00000100:00100000:2.0:1746144895.174458:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175243264:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6576us (6755us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.174470:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5645 00000100:00100000:0.0:1746144895.179754:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.179888:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175243392 00000100:00100000:3.0:1746144895.179898:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175243392 00002000:00100000:3.0:1746144895.179971:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880091684a80 x1830965175243392/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.179980:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091684a80 with x1830965175243392 ext(0->7) 00010000:00010000:3.0:1746144895.179992:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e1f expref: 42 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.180006:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e1f expref: 42 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.180013:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091684a80 00000100:00100000:3.0:1746144895.180039:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2136 00000100:00100000:3.0:1746144895.180047:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+42:1985:x1830965175243392:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144895.180406:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175243392:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 358us (659us total) trans 4294968028 rc 0/0 00000100:00100000:3.0:1746144895.180412:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2136 00002000:00100000:3.0:1746144895.180418:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880091684a80 x1830965175243392/t4294968028(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/448 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.180425:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091684a80 with x1830965175243392 ext(0->7) 00010000:00010000:3.0:1746144895.180429:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e1f expref: 44 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.180438:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e1f expref: 44 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.180444:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091684a80 00000100:00100000:0.0:1746144895.189825:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.189913:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175243520 00000100:00100000:2.0:1746144895.189933:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175243520 00010000:00010000:2.0:1746144895.189977:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e1f expref: 44 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.190167:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11061 00000100:00100000:2.0:1746144895.190176:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1983:x1830965175243520:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144895.190193:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144895.190214:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e1f expref: 44 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.190226:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e1f expref: 44 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.190250:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af67275153bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e1f expref: 44 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.190609:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.190611:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.190620:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e26 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.190629:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e26 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.190663:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e26 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144895.190675:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172482560:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144895.191648:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.194429:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.194567:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175243648 00000100:00100000:2.0:1746144895.194576:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175243648 00000100:00100000:2.0:1746144895.194633:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5646 00000100:00100000:2.0:1746144895.194640:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175243648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.194657:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.194674:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e2d expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.194700:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e26 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.194708:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.194710:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.194713:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e2d expref: 45 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.194745:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e26 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.194755:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e26 expref: 5 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.194787:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a094700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172482688:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.196951:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.197028:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172482560:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.197052:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.197085:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1983:x1830965175243520:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6910us (7270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.197098:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11061 00000100:00100000:1.0:1746144895.197680:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.198120:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175243904 00000100:00100000:2.0:1746144895.198126:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175243904 00002000:00100000:2.0:1746144895.198166:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932a8000 x1830965175243904/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.198175:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a8000 with x1830965175243904 ext(0->4095) 00010000:00010000:2.0:1746144895.198183:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e26 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.198195:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e26 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.198201:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932a8000 00000100:00100000:2.0:1746144895.198229:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2137 00000100:00100000:2.0:1746144895.198236:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175243904:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144895.198401:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175243904:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 166us (722us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.198407:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2137 00002000:00100000:2.0:1746144895.198411:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800932a8000 x1830965175243904/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.198418:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800932a8000 with x1830965175243904 ext(0->4095) 00010000:00010000:2.0:1746144895.198422:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e26 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.198432:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e26 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.198438:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800932a8000 00000100:00100000:2.0:1746144895.200190:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a094700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172482688:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.200217:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e2d expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.200231:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf1b000, rc 0) 00000100:00100000:2.0:1746144895.200259:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175243648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5619us (5839us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.200266:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5646 00000100:00100000:0.0:1746144895.200452:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.200489:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.200616:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175244032 00000100:00100000:2.0:1746144895.200620:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175244032 00000100:00100000:2.0:1746144895.200645:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5647 00000100:00100000:2.0:1746144895.200651:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31579:x1830965175244032:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.200661:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.200675:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af67275153d0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e34 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.200700:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.200704:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e2d expref: 45 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.200710:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.200713:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af67275153d0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e34 expref: 45 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.200743:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e2d expref: 45 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.200754:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af67275153d0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e34 expref: 45 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.200789:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f27a00, rc 0) 00000100:00100000:2.0:1746144895.200807:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31579:x1830965175244032:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 157us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.200813:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5647 00000100:00100000:3.0:1746144895.200876:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175244160 00000100:00100000:3.0:1746144895.200880:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175244160 00010000:00010000:3.0:1746144895.200896:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e26 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.200919:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11062 00000100:00100000:3.0:1746144895.200934:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175244160:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.200943:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.200962:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e26 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.200972:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e26 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.200989:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1a000/0x4076af67275153c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e26 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.201002:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.201004:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.201010:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e2d expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.201017:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e2d expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.201037:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e2d expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.201050:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e2d expref: 44 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.201061:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172482944:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.201119:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.202167:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172482944:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.202180:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.202215:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175244160:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1290us (1725us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.202222:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11062 00000100:00100000:0.0:1746144895.202610:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.202733:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175244416 00000100:00100000:3.0:1746144895.202737:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175244416 00002000:00100000:3.0:1746144895.202788:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2ce00 x1830965175244416/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.202797:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2ce00 with x1830965175244416 ext(0->4095) 00010000:00010000:3.0:1746144895.202804:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e2d expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.202815:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e2d expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.202820:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2ce00 00000100:00100000:3.0:1746144895.202846:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2138 00000100:00100000:3.0:1746144895.202852:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1985:x1830965175244416:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144895.203007:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1985:x1830965175244416:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 154us (397us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.203013:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2138 00002000:00100000:3.0:1746144895.203018:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2ce00 x1830965175244416/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.203025:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2ce00 with x1830965175244416 ext(0->4095) 00010000:00010000:3.0:1746144895.203034:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e2d expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.203043:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e2d expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.203049:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012cf2ce00 00000100:00100000:0.0:1746144895.205207:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.205803:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175244544 00000100:00100000:3.0:1746144895.205810:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175244544 00010000:00010000:3.0:1746144895.205838:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e2d expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.205867:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11063 00000100:00100000:3.0:1746144895.205874:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1982:x1830965175244544:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.205886:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.205907:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e2d expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.205918:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e2d expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.205953:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf1b000/0x4076af67275153c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e2d expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.205983:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.205985:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.205992:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af67275153d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e34 expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.205999:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af67275153d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e34 expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.206031:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af67275153d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e34 expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.206043:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172483072:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.206121:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.207686:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172483072:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.207705:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.207740:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50dd050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1982:x1830965175244544:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1865us (2540us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.207750:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11063 00000100:00100000:0.0:1746144895.208390:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.208475:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175244800 00000100:00100000:2.0:1746144895.208481:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175244800 00002000:00100000:2.0:1746144895.208522:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2f480 x1830965175244800/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.208532:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2f480 with x1830965175244800 ext(0->4095) 00002000:00010000:2.0:1746144895.208536:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2f480 00000100:00100000:2.0:1746144895.208561:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4114 00000100:00100000:2.0:1746144895.208569:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175244800:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144895.208717:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175244800:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 150us (329us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.208723:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4114 00002000:00100000:2.0:1746144895.208727:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012cf2f480 x1830965175244800/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.208734:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2f480 with x1830965175244800 ext(0->4095) 00002000:00010000:2.0:1746144895.208736:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2f480 00000100:00100000:0.0:1746144895.209898:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.209985:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175244928 00000100:00100000:3.0:1746144895.209990:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175244928 00000100:00100000:3.0:1746144895.210026:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5648 00000100:00100000:3.0:1746144895.210035:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175244928:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.210049:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.210070:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275153d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e3b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.210095:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af67275153d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e34 expref: 43 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.210103:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.210105:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.210108:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275153d7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e3b expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.210137:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af67275153d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e34 expref: 43 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.210149:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af67275153d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e34 expref: 43 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.210161:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172483200:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144895.210237:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.211485:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172483200:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144895.211505:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275153d7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e3b expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.211517:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:3.0:1746144895.211554:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175244928:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1522us (1658us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.211565:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5648 00000100:00100000:2.0:1746144895.212650:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.212941:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175245056 00000100:00100000:3.0:1746144895.212946:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175245056 00010000:00010000:3.0:1746144895.212972:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af67275153d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e34 expref: 44 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.213000:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11064 00000100:00100000:3.0:1746144895.213007:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175245056:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.213018:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.213039:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af67275153d0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e34 expref: 44 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.213049:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af67275153d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e34 expref: 44 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.213068:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f27a00/0x4076af67275153d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e34 expref: 44 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.213090:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.213092:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.213099:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275153d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e3b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.213107:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275153d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e3b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.213135:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275153d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e3b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.213146:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172483328:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.213208:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.215583:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172483328:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.215604:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.215662:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+43:1985:x1830965175245056:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2654us (3012us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.215672:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11064 00000100:00100000:2.0:1746144895.216756:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.216923:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175245312 00000100:00100000:3.0:1746144895.216939:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175245312 00002000:00100000:3.0:1746144895.216980:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094380 x1830965175245312/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.216989:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094380 with x1830965175245312 ext(0->4095) 00002000:00010000:3.0:1746144895.216993:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a094380 00000100:00100000:3.0:1746144895.217021:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4115 00000100:00100000:3.0:1746144895.217028:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175245312:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144895.217209:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175245312:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 181us (455us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.217216:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4115 00002000:00100000:3.0:1746144895.217221:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094380 x1830965175245312/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.217228:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094380 with x1830965175245312 ext(0->4095) 00002000:00010000:3.0:1746144895.217231:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a094380 00000100:00100000:0.0:1746144895.219659:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.219752:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.221086:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175245440 00000100:00100000:2.0:1746144895.221097:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175245440 00000100:00100000:3.0:1746144895.221207:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175245568 00000100:00100000:3.0:1746144895.221211:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175245568 00000100:00100000:2.0:1746144895.221304:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5649 00000100:00100000:2.0:1746144895.221313:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31579:x1830965175245440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.221331:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.221348:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e42 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.221378:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275153d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e3b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.221386:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.221388:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.221392:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e42 expref: 45 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.221423:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275153d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e3b expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.221434:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275153d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e3b expref: 5 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.221446:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a095180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172483456:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.221527:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.221774:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5650 00000100:00100000:3.0:1746144895.221782:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31565:x1830965175245568:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.221788:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.221794:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e49 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.221805:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.221808:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e42 expref: 46 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.221813:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.221816:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e49 expref: 46 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.221837:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e42 expref: 46 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.221848:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e49 expref: 46 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.221858:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:3.0:1746144895.221895:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+46:31565:x1830965175245568:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 114us (2142us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.221901:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5650 00000100:00100000:2.0:1746144895.225571:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a095180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172483456:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.225611:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e42 expref: 45 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.225628:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800942a8600, rc 0) 00000100:00100000:2.0:1746144895.225674:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31579:x1830965175245440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4362us (6021us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.225681:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5649 00000100:00100000:0.0:1746144895.226512:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.226625:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175245696 00000100:00100000:3.0:1746144895.226631:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175245696 00010000:00010000:3.0:1746144895.226660:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275153d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e3b expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.226682:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11065 00000100:00100000:3.0:1746144895.226688:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175245696:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.226699:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.226720:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275153d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e3b expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.226732:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275153d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e3b expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.226755:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275153d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e3b expref: 6 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.226806:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.226808:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.226815:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e42 expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.226822:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e42 expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.226852:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e42 expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.226863:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e42 expref: 44 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.226879:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172483712:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.226953:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.230044:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172483712:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.230066:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.230108:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175245696:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3419us (3595us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.230118:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11065 00000100:00100000:2.0:1746144895.230814:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.230866:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175245952 00000100:00100000:0.0:1746144895.230872:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175245952 00002000:00100000:0.0:1746144895.230912:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a095180 x1830965175245952/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144895.230921:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a095180 with x1830965175245952 ext(0->4095) 00010000:00010000:0.0:1746144895.230940:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e42 expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:0.0:1746144895.230953:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e42 expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:0.0:1746144895.230960:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a095180 00000100:00100000:0.0:1746144895.230986:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2139 00000100:00100000:0.0:1746144895.230993:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1985:x1830965175245952:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144895.231160:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1985:x1830965175245952:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 167us (347us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144895.231166:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2139 00002000:00100000:0.0:1746144895.231172:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a095180 x1830965175245952/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144895.231179:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a095180 with x1830965175245952 ext(0->4095) 00010000:00010000:0.0:1746144895.231184:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e42 expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:0.0:1746144895.231197:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e42 expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:0.0:1746144895.231203:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a095180 00000100:00100000:0.0:1746144895.235944:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.236307:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.236395:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175246080 00000100:00100000:2.0:1746144895.236405:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175246080 00000100:00100000:2.0:1746144895.236468:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5651 00000100:00100000:2.0:1746144895.236478:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175246080:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.236496:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.236514:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e50 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.236543:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.236549:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e49 expref: 44 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.236555:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144895.236558:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e50 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.236592:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e49 expref: 44 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.236602:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e50 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.236615:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009930b600, rc 0) 00000100:00100000:2.0:1746144895.236656:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175246080:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 181us (731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.236662:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5651 00000100:00100000:3.0:1746144895.236787:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175246208 00000100:00100000:3.0:1746144895.236791:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175246208 00010000:00010000:3.0:1746144895.236807:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e42 expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.236832:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11066 00000100:00100000:3.0:1746144895.236836:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1982:x1830965175246208:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.236844:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.236862:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e42 expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.236872:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e42 expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.236888:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800942a8600/0x4076af67275153de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e42 expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.236901:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.236903:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.236909:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e49 expref: 44 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.236915:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e49 expref: 44 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.236942:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e49 expref: 44 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.236951:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e49 expref: 44 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.236961:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172483968:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.237022:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.239273:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172483968:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.239294:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.239345:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1982:x1830965175246208:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2506us (3037us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.239354:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11066 00000100:00100000:2.0:1746144895.239885:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.239954:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175246464 00000100:00100000:3.0:1746144895.239960:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175246464 00002000:00100000:3.0:1746144895.239992:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a095c00 x1830965175246464/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.240001:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a095c00 with x1830965175246464 ext(0->4095) 00010000:00010000:3.0:1746144895.240009:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e49 expref: 44 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.240026:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e49 expref: 44 pid: 8432 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.240033:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a095c00 00000100:00100000:3.0:1746144895.240060:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2140 00000100:00100000:3.0:1746144895.240067:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175246464:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144895.240250:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175246464:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 182us (365us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.240257:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2140 00002000:00100000:3.0:1746144895.240262:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a095c00 x1830965175246464/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.240269:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a095c00 with x1830965175246464 ext(0->4095) 00010000:00010000:3.0:1746144895.240274:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e49 expref: 44 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.240283:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e49 expref: 44 pid: 8432 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.240288:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a095c00 00000100:00100000:0.0:1746144895.241970:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.242125:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.242267:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175246720 00000100:00100000:3.0:1746144895.242273:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175246720 00010000:00010000:3.0:1746144895.242299:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e49 expref: 44 pid: 8432 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.242331:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11067 00000100:00100000:3.0:1746144895.242338:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1982:x1830965175246720:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.242350:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.242368:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e49 expref: 44 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.242378:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e49 expref: 44 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.242400:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275153e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e49 expref: 44 pid: 8432 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.242415:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.242417:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.242424:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e50 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.242432:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e50 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.242461:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e50 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.242472:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172484096:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.242549:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.243027:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175246592 00000100:00100000:2.0:1746144895.243031:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175246592 00000100:00100000:2.0:1746144895.243066:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5652 00000100:00100000:2.0:1746144895.243071:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175246592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.243081:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.243093:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af67275153f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e57 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.243112:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e50 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.243118:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.243119:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.243122:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af67275153f3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e57 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.243139:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e50 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.243150:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e50 expref: 5 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.243164:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172484224:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.243278:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.245132:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172484096:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.245153:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.245204:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1982:x1830965175246720:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2865us (3078us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.245216:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11067 00000100:00100000:2.0:1746144895.245536:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172484224:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.245561:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af67275153f3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e57 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.245576:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009930a800, rc 0) 00000100:00100000:2.0:1746144895.245600:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175246592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2529us (3636us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.245607:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5652 00000100:00100000:0.0:1746144895.246524:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.246717:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175246976 00000100:00100000:2.0:1746144895.246724:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175246976 00002000:00100000:2.0:1746144895.246815:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a0700 x1830965175246976/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.246824:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a0700 with x1830965175246976 ext(0->4095) 00010000:00010000:2.0:1746144895.246832:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e50 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.246843:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e50 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.246849:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a0700 00000100:00100000:2.0:1746144895.246876:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2141 00000100:00100000:2.0:1746144895.246884:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175246976:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144895.247078:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175246976:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 195us (556us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.247085:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2141 00002000:00100000:2.0:1746144895.247090:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a0700 x1830965175246976/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.247097:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a0700 with x1830965175246976 ext(0->4095) 00010000:00010000:2.0:1746144895.247102:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e50 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.247110:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e50 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.247115:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a0700 00000100:00100000:0.0:1746144895.254080:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.254634:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175247104 00000100:00100000:3.0:1746144895.254644:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175247104 00010000:00010000:3.0:1746144895.254683:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e50 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.254712:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11068 00000100:00100000:3.0:1746144895.254720:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175247104:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.254733:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.254754:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e50 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.254784:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e50 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.254807:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153ec lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e50 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.254827:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.254829:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.254836:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af67275153f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e57 expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.254844:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af67275153f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e57 expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.254877:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af67275153f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e57 expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.254891:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172484352:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.254984:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.257402:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.257490:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172484352:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.257510:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.257555:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175247104:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2834us (3484us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.257565:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11068 00000100:00100000:2.0:1746144895.257649:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175247360 00000100:00100000:2.0:1746144895.257655:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175247360 00002000:00100000:2.0:1746144895.257699:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d366d80 x1830965175247360/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.257708:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d366d80 with x1830965175247360 ext(0->4095) 00002000:00010000:2.0:1746144895.257713:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d366d80 00000100:00100000:2.0:1746144895.257741:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4116 00000100:00100000:2.0:1746144895.257749:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175247360:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144895.257957:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175247360:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 208us (562us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.257962:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4116 00002000:00100000:2.0:1746144895.257969:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012d366d80 x1830965175247360/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.257976:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d366d80 with x1830965175247360 ext(0->4095) 00002000:00010000:2.0:1746144895.257978:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d366d80 00000100:00100000:0.0:1746144895.261346:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.261482:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175247488 00000100:00100000:2.0:1746144895.261493:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175247488 00000100:00100000:2.0:1746144895.261562:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5653 00000100:00100000:2.0:1746144895.261571:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175247488:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.261588:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.261608:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e5e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.261637:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af67275153f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e57 expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.261645:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.261647:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.261650:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153fa lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e5e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.261680:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af67275153f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e57 expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.261692:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af67275153f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e57 expref: 43 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.261704:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172484480:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.261822:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.264080:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172484480:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.264113:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153fa lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e5e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.264129:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009930b600, rc 0) 00000100:00100000:0.0:1746144895.264219:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.264254:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175247488:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2684us (2916us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.264262:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5653 00000100:00100000:3.0:1746144895.264337:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175247616 00000100:00100000:3.0:1746144895.264343:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175247616 00010000:00010000:3.0:1746144895.264366:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af67275153f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e57 expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.264392:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11069 00000100:00100000:3.0:1746144895.264397:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175247616:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.264410:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.264431:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af67275153f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e57 expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.264441:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af67275153f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e57 expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.264462:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af67275153f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e57 expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.264632:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.264636:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.264644:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e5e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.264652:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e5e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.264680:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e5e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.264690:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172484608:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.265225:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.268619:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.268697:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.268812:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175248000 00000100:00100000:2.0:1746144895.268821:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175248000 00000100:00100000:2.0:1746144895.268874:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5654 00000100:00100000:2.0:1746144895.268883:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175248000:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:3.0:1746144895.268969:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175247872 00000100:00100000:3.0:1746144895.268976:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175247872 00002000:00100000:3.0:1746144895.269027:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c28a80 x1830965175247872/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.269042:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28a80 with x1830965175247872 ext(0->4095) 00002000:00010000:3.0:1746144895.269047:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c28a80 00010000:00010000:2.0:1746144895.269063:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.269154:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e65 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.269232:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4117 00010000:00010000:2.0:1746144895.269353:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e5e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.269364:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175247872:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00010000:00010000:2.0:1746144895.269425:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.269427:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.269430:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e65 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.269694:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e5e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.269710:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153fa lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e5e expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.269977:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172484736:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144895.270459:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175247872:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 1220us (1849us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.270467:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4117 00000100:00100000:2.0:1746144895.270545:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00002000:00100000:3.0:1746144895.270587:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c28a80 x1830965175247872/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.270658:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28a80 with x1830965175247872 ext(0->4095) 00010000:00010000:3.0:1746144895.270664:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153fa lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e5e expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.270673:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153fa lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e5e expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.270678:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c28a80 00000100:00100000:3.0:1746144895.270723:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172484608:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.270738:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.271040:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1985:x1830965175247616:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6641us (6821us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.271048:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11069 00000100:00100000:0.0:1746144895.274119:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.274153:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172484736:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.274185:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e65 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.274201:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cf07800, rc 0) 00000100:00100000:0.0:1746144895.274220:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.274240:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175248000:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5359us (5542us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.274248:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5654 00000100:00100000:2.0:1746144895.274274:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175248128 00000100:00100000:2.0:1746144895.274279:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175248128 00000100:00100000:2.0:1746144895.274307:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5655 00000100:00100000:2.0:1746144895.274313:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31579:x1830965175248128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.274326:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.274339:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af6727515408 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e6c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.274358:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.274363:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e65 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.274374:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.274377:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af6727515408 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e6c expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.274403:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e65 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.274413:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af6727515408 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e6c expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.274419:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009930a800, rc 0) 00000100:00100000:2.0:1746144895.274445:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31579:x1830965175248128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 132us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.274450:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5655 00000100:00100000:3.0:1746144895.274503:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175248256 00000100:00100000:3.0:1746144895.274507:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175248256 00010000:00010000:3.0:1746144895.274524:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e5e expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.274543:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11070 00000100:00100000:3.0:1746144895.274547:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175248256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.274556:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.274575:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e5e expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.274589:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e5e expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.274606:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275153fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e5e expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.274631:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.274633:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.274639:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e65 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.274646:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e65 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.274668:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e65 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.274677:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e65 expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.274688:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172484992:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.274758:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4a823c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.276596:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172484992:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.276611:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.277010:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175248256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2460us (2787us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.277020:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11070 00000100:00100000:0.0:1746144895.277195:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.277213:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175248512 00000100:00100000:2.0:1746144895.277219:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175248512 00002000:00100000:2.0:1746144895.277255:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c2a300 x1830965175248512/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.277264:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c2a300 with x1830965175248512 ext(0->4095) 00010000:00010000:2.0:1746144895.277272:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e65 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.277284:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e65 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.277290:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c2a300 00000100:00100000:2.0:1746144895.277317:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2142 00000100:00100000:2.0:1746144895.277324:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1985:x1830965175248512:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144895.277495:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1985:x1830965175248512:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 171us (300us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.277502:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2142 00002000:00100000:2.0:1746144895.277507:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c2a300 x1830965175248512/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.277513:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c2a300 with x1830965175248512 ext(0->4095) 00010000:00010000:2.0:1746144895.277518:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e65 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.277526:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e65 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.277531:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091c2a300 00000100:00100000:0.0:1746144895.279654:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.280348:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175248640 00000100:00100000:3.0:1746144895.280355:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175248640 00010000:00010000:3.0:1746144895.280388:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e65 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.280670:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11071 00000100:00100000:3.0:1746144895.280677:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1983:x1830965175248640:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.280691:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.280711:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e65 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.280721:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e65 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.280742:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012cf07800/0x4076af6727515401 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e65 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.281482:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.281485:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.281494:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af6727515408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e6c expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.281502:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af6727515408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e6c expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.281678:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af6727515408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e6c expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.281691:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172485120:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.281802:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.284271:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172485120:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.284295:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.284349:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1983:x1830965175248640:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3670us (4700us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.284360:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11071 00000100:00100000:1.0:1746144895.285031:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.285078:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175248896 00000100:00100000:3.0:1746144895.285085:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175248896 00002000:00100000:3.0:1746144895.285125:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f72300 x1830965175248896/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.285135:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f72300 with x1830965175248896 ext(0->4095) 00002000:00010000:3.0:1746144895.285139:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f72300 00000100:00100000:3.0:1746144895.285166:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4118 00000100:00100000:3.0:1746144895.285173:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175248896:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144895.285506:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175248896:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 333us (475us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.285513:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4118 00002000:00100000:3.0:1746144895.285518:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f72300 x1830965175248896/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.285525:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f72300 with x1830965175248896 ext(0->4095) 00002000:00010000:3.0:1746144895.285528:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f72300 00000100:00100000:0.0:1746144895.287114:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.287694:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175249024 00000100:00100000:2.0:1746144895.287703:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175249024 00000100:00100000:2.0:1746144895.287944:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5656 00000100:00100000:2.0:1746144895.287955:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175249024:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.287972:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.287989:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751540f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e73 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.288020:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af6727515408 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e6c expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.288032:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.288035:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.288038:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751540f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e73 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.288070:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af6727515408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e6c expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.288081:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af6727515408 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e6c expref: 43 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.288093:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172485248:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.288171:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.289991:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172485248:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.290019:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751540f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e73 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.290038:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e4800, rc 0) 00000100:00100000:2.0:1746144895.290075:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175249024:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2123us (2967us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.290081:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5656 00000100:00100000:0.0:1746144895.291242:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.291340:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175249152 00000100:00100000:3.0:1746144895.291347:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175249152 00010000:00010000:3.0:1746144895.291378:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af6727515408 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e6c expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.291985:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11072 00000100:00100000:3.0:1746144895.291994:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175249152:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.292008:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.292032:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af6727515408 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e6c expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.292043:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af6727515408 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e6c expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.292067:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009930a800/0x4076af6727515408 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e6c expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.292089:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.292092:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.292099:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751540f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e73 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.292108:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751540f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e73 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.292140:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751540f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e73 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.292151:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172485376:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.292227:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.294124:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172485376:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.294154:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.294192:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+43:1985:x1830965175249152:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2198us (2953us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.294201:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11072 00000100:00100000:0.0:1746144895.294831:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.295241:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175249408 00000100:00100000:3.0:1746144895.295248:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175249408 00002000:00100000:3.0:1746144895.295280:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c2a680 x1830965175249408/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.295289:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c2a680 with x1830965175249408 ext(0->4095) 00002000:00010000:3.0:1746144895.295293:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c2a680 00000100:00100000:3.0:1746144895.295576:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4119 00000100:00100000:3.0:1746144895.295583:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175249408:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144895.296371:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175249408:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 787us (1539us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.296378:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4119 00002000:00100000:3.0:1746144895.296385:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091c2a680 x1830965175249408/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.296393:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c2a680 with x1830965175249408 ext(0->4095) 00002000:00010000:3.0:1746144895.296395:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c2a680 00000100:00100000:0.0:1746144895.296483:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.296729:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175249536 00000100:00100000:2.0:1746144895.296733:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175249536 00000100:00100000:2.0:1746144895.296779:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5657 00000100:00100000:2.0:1746144895.296784:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+43:31565:x1830965175249536:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.296795:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.296811:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e7a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.296833:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751540f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e73 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.296840:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.296841:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.296844:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e7a expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.296870:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751540f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e73 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.296879:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751540f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e73 expref: 5 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.296889:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172485504:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.296953:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.300521:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172485504:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.300557:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e7a expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.300572:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e4600, rc 0) 00000100:00100000:2.0:1746144895.300616:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175249536:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3831us (4133us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.300628:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5657 00000100:00100000:0.0:1746144895.300760:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.300864:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.301248:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175249664 00000100:00100000:2.0:1746144895.301254:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175249664 00000100:00100000:2.0:1746144895.301293:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5658 00000100:00100000:2.0:1746144895.301300:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31579:x1830965175249664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.301314:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.301328:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751541d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e81 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.301347:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.301351:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e7a expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.301356:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.301359:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751541d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e81 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.301385:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e7a expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.301394:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751541d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e81 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.301401:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e5c00, rc 0) 00000100:00100000:3.0:1746144895.301854:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175249792 00000100:00100000:3.0:1746144895.301858:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175249792 00010000:00010000:3.0:1746144895.301876:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751540f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e73 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.301896:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11073 00000100:00100000:3.0:1746144895.301901:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175249792:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.301908:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.301937:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751540f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e73 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.301947:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751540f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e73 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.301964:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751540f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e73 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.301983:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.301984:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.301990:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e7a expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.301996:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e7a expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.302015:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e7a expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.302024:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e7a expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.302039:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172485760:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144895.302258:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31579:x1830965175249664:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 958us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.302264:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5658 00000100:00100000:3.0:1746144895.302921:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.306304:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172485760:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.306330:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.306431:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175249792:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4526us (5563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.306441:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11073 00000100:00100000:0.0:1746144895.307717:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.307893:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175250048 00000100:00100000:3.0:1746144895.307902:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175250048 00002000:00100000:3.0:1746144895.307954:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a1c00 x1830965175250048/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.307964:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a1c00 with x1830965175250048 ext(0->4095) 00010000:00010000:3.0:1746144895.307974:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e7a expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.307987:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e7a expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.307994:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918a1c00 00000100:00100000:3.0:1746144895.308245:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2143 00000100:00100000:3.0:1746144895.308254:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1985:x1830965175250048:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144895.308638:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1985:x1830965175250048:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 384us (925us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.308648:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2143 00002000:00100000:3.0:1746144895.308654:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a1c00 x1830965175250048/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.308661:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a1c00 with x1830965175250048 ext(0->4095) 00010000:00010000:3.0:1746144895.308666:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e7a expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.308675:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e7a expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.308681:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918a1c00 00000100:00100000:0.0:1746144895.316638:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.316849:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175250176 00000100:00100000:3.0:1746144895.316859:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175250176 00010000:00010000:3.0:1746144895.316900:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e7a expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.316993:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11074 00000100:00100000:1.0:1746144895.317005:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1983:x1830965175250176:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.317020:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.317045:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e7a expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.317568:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e7a expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.317596:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515416 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e7a expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.317627:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.317630:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.317637:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751541d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e81 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.317644:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751541d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e81 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.317680:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751541d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e81 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144895.317698:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172485888:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.317813:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144895.323068:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172485888:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144895.323092:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144895.323148:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1983:x1830965175250176:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6144us (6519us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.323160:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11074 00000100:00100000:0.0:1746144895.325583:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.325708:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175250432 00000100:00100000:3.0:1746144895.325717:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175250432 00002000:00100000:3.0:1746144895.325800:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a2300 x1830965175250432/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.325810:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a2300 with x1830965175250432 ext(0->4095) 00002000:00010000:3.0:1746144895.325815:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918a2300 00000100:00100000:3.0:1746144895.325847:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4120 00000100:00100000:3.0:1746144895.325855:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175250432:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144895.326044:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175250432:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 190us (469us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.326051:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4120 00002000:00100000:3.0:1746144895.326056:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a2300 x1830965175250432/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.326063:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a2300 with x1830965175250432 ext(0->4095) 00002000:00010000:3.0:1746144895.326066:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918a2300 00000100:00100000:0.0:1746144895.328269:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.328404:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175250560 00000100:00100000:2.0:1746144895.328412:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175250560 00000100:00100000:2.0:1746144895.328463:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5659 00000100:00100000:2.0:1746144895.328469:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175250560:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.328486:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.328502:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e88 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.328528:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751541d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e81 expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.328535:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.328537:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.328541:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e88 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.328568:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751541d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e81 expref: 43 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.328579:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751541d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e81 expref: 43 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.328590:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172486016:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.328662:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.330485:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172486016:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.330514:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e88 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.330533:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e4400, rc 0) 00000100:00100000:2.0:1746144895.330574:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175250560:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2104us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.330581:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5659 00000100:00100000:0.0:1746144895.331639:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.331728:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175250688 00000100:00100000:1.0:1746144895.331735:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175250688 00010000:00010000:1.0:1746144895.331776:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751541d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e81 expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.331848:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11075 00000100:00100000:1.0:1746144895.331855:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175250688:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.331866:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.331885:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751541d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e81 expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.331895:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751541d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e81 expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.331917:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751541d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e81 expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.331949:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.331951:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.331958:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e88 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.331966:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e88 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.331991:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e88 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144895.332000:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172486144:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.332059:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:1.0:1746144895.335180:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172486144:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144895.335201:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144895.335246:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+43:1984:x1830965175250688:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3391us (3608us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.335255:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11075 00000100:00100000:0.0:1746144895.335508:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.336373:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.336453:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175251072 00000100:00100000:3.0:1746144895.336460:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175251072 00000100:00100000:3.0:1746144895.336499:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5660 00000100:00100000:3.0:1746144895.336505:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+43:31565:x1830965175251072:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.336522:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.336539:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e8f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.336564:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e88 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.336571:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.336573:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.336576:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e8f expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.336601:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e88 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.336611:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e88 expref: 5 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.336625:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172486272:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144895.336678:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.336826:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175250944 00000100:00100000:2.0:1746144895.336830:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175250944 00002000:00100000:2.0:1746144895.336859:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a3100 x1830965175250944/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.336868:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a3100 with x1830965175250944 ext(0->4095) 00010000:00010000:2.0:1746144895.336874:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e88 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.336882:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e88 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.336887:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918a3100 00000100:00100000:2.0:1746144895.336906:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2144 00000100:00100000:2.0:1746144895.336911:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175250944:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144895.337060:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175250944:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 148us (687us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.337065:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2144 00002000:00100000:2.0:1746144895.337070:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a3100 x1830965175250944/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.337082:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a3100 with x1830965175250944 ext(0->4095) 00010000:00010000:2.0:1746144895.337086:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e88 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.337094:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e88 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.337099:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918a3100 00000100:00100000:3.0:1746144895.340840:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172486272:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144895.340871:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e8f expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.340889:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:3.0:1746144895.340948:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31565:x1830965175251072:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4442us (5439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.340956:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5660 00000100:00100000:0.0:1746144895.342218:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.342486:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.342794:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175251200 00000100:00100000:3.0:1746144895.342801:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175251200 00000100:00100000:1.0:1746144895.343072:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175251328 00000100:00100000:1.0:1746144895.343076:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175251328 00010000:00010000:1.0:1746144895.343098:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e88 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.343129:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11076 00000100:00100000:1.0:1746144895.343136:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175251328:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.343147:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.343168:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e88 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.343178:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e88 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.343200:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515424 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e88 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.343216:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.343218:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.343224:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e8f expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.343232:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e8f expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.343261:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e8f expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144895.343272:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172486400:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.343335:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.343848:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5661 00000100:00100000:3.0:1746144895.343855:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31579:x1830965175251200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.343868:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.343879:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e96 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.343896:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e8f expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.343901:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.343902:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.343905:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e96 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.343936:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e8f expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.343946:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e8f expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.343953:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172486528:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144895.343979:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4de9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.346809:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.347181:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172486400:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144895.347201:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144895.347241:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175251328:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4105us (4755us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.347250:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11076 00000100:00100000:3.0:1746144895.347407:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175251584 00000100:00100000:3.0:1746144895.347414:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175251584 00002000:00100000:3.0:1746144895.347448:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093f46d80 x1830965175251584/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.347457:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f46d80 with x1830965175251584 ext(0->4095) 00010000:00010000:3.0:1746144895.347465:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e8f expref: 46 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.347476:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e8f expref: 46 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.347481:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f46d80 00000100:00100000:3.0:1746144895.347502:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2145 00000100:00100000:3.0:1746144895.347507:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1985:x1830965175251584:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144895.347644:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1985:x1830965175251584:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 137us (844us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.347652:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2145 00002000:00100000:3.0:1746144895.347656:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093f46d80 x1830965175251584/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.347662:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f46d80 with x1830965175251584 ext(0->4095) 00010000:00010000:3.0:1746144895.347666:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e8f expref: 46 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.347674:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e8f expref: 46 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.347679:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093f46d80 00000100:00100000:3.0:1746144895.349863:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172486528:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144895.349890:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e96 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.349904:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:3.0:1746144895.350706:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31579:x1830965175251200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6848us (8489us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.350714:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5661 00000100:00100000:0.0:1746144895.351564:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.351606:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.351678:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175251840 00000100:00100000:1.0:1746144895.351684:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175251840 00010000:00010000:1.0:1746144895.351711:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e8f expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.352099:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11077 00000100:00100000:1.0:1746144895.352106:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1982:x1830965175251840:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.352119:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.352140:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e8f expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.352151:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e8f expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.352172:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751542b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e8f expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.352188:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.352190:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.352196:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e96 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.352204:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e96 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.352230:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e96 expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144895.352239:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172486656:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.352316:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175251712 00000100:00100000:3.0:1746144895.352320:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175251712 00000100:00100000:3.0:1746144895.352339:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5662 00000100:00100000:3.0:1746144895.352343:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+45:31565:x1830965175251712:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.352355:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.352366:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515439 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94e9d expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.352380:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e96 expref: 46 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.352385:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.352386:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.352389:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515439 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e9d expref: 46 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.352402:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e96 expref: 46 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.352410:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e96 expref: 46 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.352417:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172486784:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144895.354711:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.354804:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.355336:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172486784:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144895.355363:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515439 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e9d expref: 46 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.355378:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:3.0:1746144895.355417:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+46:31565:x1830965175251712:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3072us (3853us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.355425:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5662 00000100:00100000:1.0:1746144895.355493:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172486656:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144895.355503:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144895.355521:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1982:x1830965175251840:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3416us (3914us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.355529:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11077 00000100:00100000:0.0:1746144895.357202:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.357389:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175252096 00000100:00100000:2.0:1746144895.357396:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175252096 00002000:00100000:2.0:1746144895.357444:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ec700 x1830965175252096/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.357453:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec700 with x1830965175252096 ext(0->4095) 00010000:00010000:2.0:1746144895.357462:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e96 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.357474:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e96 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.357480:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ec700 00000100:00100000:2.0:1746144895.357509:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2146 00000100:00100000:2.0:1746144895.357517:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1984:x1830965175252096:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144895.357686:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1984:x1830965175252096:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 170us (490us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.357691:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2146 00002000:00100000:2.0:1746144895.357697:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ec700 x1830965175252096/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.357704:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec700 with x1830965175252096 ext(0->4095) 00010000:00010000:2.0:1746144895.357708:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e96 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.357716:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e96 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.357721:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ec700 00000100:00100000:0.0:1746144895.360351:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.360606:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175252224 00000100:00100000:3.0:1746144895.360614:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175252224 00000100:00100000:3.0:1746144895.361031:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5663 00000100:00100000:3.0:1746144895.361039:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175252224:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.361056:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.361073:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515440 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ea4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.361099:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.361105:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515439 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e9d expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.361110:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144895.361113:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515440 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ea4 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.361146:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515439 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e9d expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.361156:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515440 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ea4 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.361164:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:3.0:1746144895.361204:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175252224:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 166us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.361209:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5663 00000100:00100000:0.0:1746144895.361402:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.361508:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175252352 00000100:00100000:1.0:1746144895.361513:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175252352 00010000:00010000:1.0:1746144895.361530:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e96 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.361557:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11078 00000100:00100000:1.0:1746144895.361561:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+45:1982:x1830965175252352:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.361573:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.361592:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e96 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.361601:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e96 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.361619:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515432 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e96 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.361633:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.361634:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.361640:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515439 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e9d expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.361646:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e9d expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.361664:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e9d expref: 44 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.361674:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e9d expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.361684:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172487040:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.361739:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144895.363940:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172487040:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144895.363958:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144895.363990:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1982:x1830965175252352:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2427us (2587us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.363999:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11078 00000100:00100000:2.0:1746144895.365191:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.365242:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175252480 00000100:00100000:1.0:1746144895.365248:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175252480 00010000:00010000:1.0:1746144895.365273:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e9d expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.365303:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11079 00000100:00100000:1.0:1746144895.365310:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1985:x1830965175252480:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.365320:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.365339:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515439 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e9d expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.365348:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515439 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e9d expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.365368:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515439 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94e9d expref: 44 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.365389:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.365391:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.365398:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515440 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ea4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.365405:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515440 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ea4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.365431:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515440 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ea4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144895.365440:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172487168:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.366827:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.367520:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.367652:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175252736 00000100:00100000:3.0:1746144895.367658:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175252736 00002000:00100000:3.0:1746144895.367696:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ed80 x1830965175252736/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.367706:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ed80 with x1830965175252736 ext(0->4095) 00002000:00010000:3.0:1746144895.367711:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ed80 00000100:00100000:1.0:1746144895.367813:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172487168:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144895.367828:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.367988:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4121 00000100:00100000:3.0:1746144895.367995:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175252736:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144895.368317:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+43:1985:x1830965175252480:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3006us (3127us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.368325:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11079 00000100:00100000:3.0:1746144895.369124:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175252736:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 1127us (1606us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.369130:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4121 00002000:00100000:3.0:1746144895.369138:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ed80 x1830965175252736/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.369144:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ed80 with x1830965175252736 ext(0->4095) 00002000:00010000:3.0:1746144895.369147:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ed80 00000100:00100000:0.0:1746144895.371637:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.371730:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175252864 00000100:00100000:1.0:1746144895.371738:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175252864 00000100:00100000:1.0:1746144895.372022:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5664 00000100:00100000:1.0:1746144895.372030:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+43:31579:x1830965175252864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.372047:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.372064:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94eab expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.372090:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515440 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ea4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.372096:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.372098:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.372101:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eab expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.372134:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515440 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ea4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.372145:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515440 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ea4 expref: 5 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.372155:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172487296:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144895.372230:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144895.373640:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172487296:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144895.373659:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eab expref: 44 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.373671:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009334bc00, rc 0) 00000100:00100000:1.0:1746144895.373695:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+44:31579:x1830965175252864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1667us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.373702:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5664 00000100:00100000:0.0:1746144895.375188:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.375262:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175252992 00000100:00100000:1.0:1746144895.375267:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175252992 00010000:00010000:1.0:1746144895.375294:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515440 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ea4 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.375652:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11080 00000100:00100000:1.0:1746144895.375658:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175252992:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.375671:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.375693:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515440 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ea4 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.375704:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515440 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ea4 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.375725:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515440 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ea4 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.375915:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.375917:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.375933:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eab expref: 43 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.375941:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eab expref: 43 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.375970:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eab expref: 43 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144895.375980:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172487424:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.376407:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.378467:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.378558:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172487424:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144895.378576:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144895.378616:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175252992:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2957us (3432us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.378625:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11080 00000100:00100000:3.0:1746144895.379077:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175253248 00000100:00100000:3.0:1746144895.379085:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175253248 00002000:00100000:3.0:1746144895.379126:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258df80 x1830965175253248/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.379135:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258df80 with x1830965175253248 ext(0->4095) 00002000:00010000:3.0:1746144895.379139:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258df80 00000100:00100000:3.0:1746144895.379164:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4122 00000100:00100000:3.0:1746144895.379171:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175253248:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144895.379341:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1984:x1830965175253248:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 170us (882us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.379351:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4122 00002000:00100000:3.0:1746144895.379355:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258df80 x1830965175253248/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.379363:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258df80 with x1830965175253248 ext(0->4095) 00002000:00010000:3.0:1746144895.379366:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258df80 00000100:00100000:2.0:1746144895.382128:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.390499:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175253376 00000100:00100000:1.0:1746144895.390513:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175253376 00000100:00100000:1.0:1746144895.390578:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5665 00000100:00100000:1.0:1746144895.390586:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175253376:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.390603:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.390621:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94eb2 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.390650:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eab expref: 43 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.390656:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.390658:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.390661:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb2 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.390689:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eab expref: 43 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.390699:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eab expref: 43 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.390710:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172487552:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144895.390823:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.395910:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.396417:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172487552:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144895.396452:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb2 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.396478:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009334b800, rc 0) 00000100:00100000:1.0:1746144895.396544:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175253376:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5958us (14423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.396554:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5665 00000100:00100000:2.0:1746144895.396862:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175253504 00000100:00100000:2.0:1746144895.396870:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175253504 00002000:00100000:2.0:1746144895.396916:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009258c380 x1830965175253504/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.396936:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258c380 with x1830965175253504 ext(0->7) 00010000:00010000:2.0:1746144895.396943:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eab expref: 44 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.396956:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eab expref: 44 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.396963:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258c380 00000100:00100000:2.0:1746144895.396979:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2147 00000100:00100000:2.0:1746144895.396987:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+44:1983:x1830965175253504:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144895.398474:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1983:x1830965175253504:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 1481us (2569us total) trans 4294968029 rc 0/0 00000100:00100000:2.0:1746144895.398483:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2147 00002000:00100000:2.0:1746144895.398492:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009258c380 x1830965175253504/t4294968029(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/448 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.398500:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258c380 with x1830965175253504 ext(0->7) 00010000:00010000:2.0:1746144895.398507:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eab expref: 46 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.398519:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eab expref: 46 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.398525:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258c380 00000100:00100000:3.0:1746144895.398873:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.398946:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175253632 00000100:00100000:1.0:1746144895.398951:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175253632 00000100:00100000:1.0:1746144895.398978:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5666 00000100:00100000:1.0:1746144895.398985:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+46:31565:x1830965175253632:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.398994:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.399010:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515455 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94eb9 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.399034:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.399040:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb2 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.399046:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144895.399049:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515455 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb9 expref: 47 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.399082:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb2 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.399091:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515455 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb9 expref: 47 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.399106:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009334be00, rc 0) 00000100:00100000:1.0:1746144895.399139:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+47:31565:x1830965175253632:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 154us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.399143:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5666 00000100:00100000:0.0:1746144895.401153:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.401213:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175253760 00000100:00100000:1.0:1746144895.401220:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175253760 00010000:00010000:1.0:1746144895.401251:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eab expref: 47 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.401289:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11081 00000100:00100000:1.0:1746144895.401297:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+47:1983:x1830965175253760:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.401309:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.401330:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eab expref: 47 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.401342:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eab expref: 47 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.401363:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515447 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eab expref: 47 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.401392:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.401394:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.401402:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb2 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.401414:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb2 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.401447:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb2 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.401457:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb2 expref: 5 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.401468:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172487808:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.401554:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144895.402935:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172487808:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144895.402950:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144895.402976:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1983:x1830965175253760:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1680us (1830us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.402985:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11081 00000100:00100000:0.0:1746144895.403468:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.404054:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175254016 00000100:00100000:3.0:1746144895.404061:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175254016 00002000:00100000:3.0:1746144895.404099:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258d500 x1830965175254016/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.404109:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258d500 with x1830965175254016 ext(0->4095) 00010000:00010000:3.0:1746144895.404118:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb2 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.404131:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb2 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.404137:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258d500 00000100:00100000:3.0:1746144895.404154:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2148 00000100:00100000:3.0:1746144895.404161:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175254016:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144895.404332:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175254016:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 171us (864us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.404338:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2148 00002000:00100000:3.0:1746144895.404343:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009258d500 x1830965175254016/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.404351:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258d500 with x1830965175254016 ext(0->4095) 00010000:00010000:3.0:1746144895.404356:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb2 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.404366:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb2 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.404371:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009258d500 00000100:00100000:2.0:1746144895.407546:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.407614:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175254144 00000100:00100000:1.0:1746144895.407622:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175254144 00010000:00010000:1.0:1746144895.407867:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb2 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.407901:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11082 00000100:00100000:1.0:1746144895.407908:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175254144:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.407921:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.407948:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb2 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.407960:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb2 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.407982:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009334b800/0x4076af672751544e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb2 expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.408005:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.408007:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.408013:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb9 expref: 45 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.408021:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb9 expref: 45 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.408051:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb9 expref: 45 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144895.408062:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172487936:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.408134:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144895.411315:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172487936:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144895.411340:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144895.411542:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175254144:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3632us (4003us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.411552:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11082 00000100:00100000:2.0:1746144895.412453:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.412541:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175254400 00000100:00100000:0.0:1746144895.412548:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175254400 00002000:00100000:0.0:1746144895.412587:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a095500 x1830965175254400/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144895.412595:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a095500 with x1830965175254400 ext(0->4095) 00002000:00010000:0.0:1746144895.412600:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a095500 00000100:00100000:0.0:1746144895.412844:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4123 00000100:00100000:0.0:1746144895.412852:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1985:x1830965175254400:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144895.413232:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1985:x1830965175254400:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 380us (778us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144895.413238:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4123 00002000:00100000:0.0:1746144895.413243:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a095500 x1830965175254400/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144895.413250:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a095500 with x1830965175254400 ext(0->4095) 00002000:00010000:0.0:1746144895.413252:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a095500 00000100:00100000:0.0:1746144895.416400:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.416551:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175254528 00000100:00100000:3.0:1746144895.416560:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175254528 00000100:00100000:3.0:1746144895.417033:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5667 00000100:00100000:3.0:1746144895.417042:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175254528:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.417059:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.417076:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ec0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.417104:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515455 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb9 expref: 45 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.417112:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.417113:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.417117:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec0 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.417149:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb9 expref: 45 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.417165:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb9 expref: 45 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.417178:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172488064:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144895.417266:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.420137:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172488064:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144895.420166:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec0 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.420182:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:3.0:1746144895.420223:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175254528:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3182us (3834us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.420231:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5667 00000100:00100000:0.0:1746144895.421739:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.423593:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175254656 00000100:00100000:1.0:1746144895.423605:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175254656 00010000:00010000:1.0:1746144895.423647:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb9 expref: 46 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.423690:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11083 00000100:00100000:1.0:1746144895.423697:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1985:x1830965175254656:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.423712:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.423733:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515455 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb9 expref: 46 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.423746:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515455 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb9 expref: 46 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.423786:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009334be00/0x4076af6727515455 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eb9 expref: 46 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.423809:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.423811:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.423819:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec0 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.423826:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec0 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.423861:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec0 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144895.423877:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172488192:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.423984:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.424177:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.424308:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175254784 00000100:00100000:3.0:1746144895.424312:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175254784 00000100:00100000:3.0:1746144895.424336:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5668 00000100:00100000:3.0:1746144895.424342:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+46:31565:x1830965175254784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.424356:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.424373:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ec7 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.424389:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec0 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.424399:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.424401:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.424404:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec7 expref: 47 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.424421:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec0 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.424431:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec0 expref: 5 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.424439:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172488320:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144895.424471:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144895.426729:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172488192:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144895.426753:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144895.426845:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+47:1985:x1830965175254656:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3147us (5111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.426856:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11083 00000100:00100000:3.0:1746144895.426953:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172488320:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144895.426973:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec7 expref: 47 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.426991:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:3.0:1746144895.427011:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+47:31565:x1830965175254784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2669us (2834us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.427018:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5668 00000100:00100000:0.0:1746144895.427218:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.427404:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175255040 00000100:00100000:1.0:1746144895.427411:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175255040 00002000:00100000:1.0:1746144895.427445:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230c700 x1830965175255040/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.427454:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230c700 with x1830965175255040 ext(0->4095) 00010000:00010000:1.0:1746144895.427460:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec0 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.427472:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec0 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144895.427478:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230c700 00000100:00100000:1.0:1746144895.427508:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2149 00000100:00100000:1.0:1746144895.427515:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175255040:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144895.427683:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175255040:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 168us (464us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144895.427693:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2149 00002000:00100000:1.0:1746144895.427697:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230c700 x1830965175255040/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.427704:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230c700 with x1830965175255040 ext(0->4095) 00010000:00010000:1.0:1746144895.427709:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec0 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.427718:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec0 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144895.427723:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230c700 00000100:00100000:0.0:1746144895.430007:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.430089:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175255168 00000100:00100000:1.0:1746144895.430096:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175255168 00010000:00010000:1.0:1746144895.430125:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec0 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.430206:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11084 00000100:00100000:1.0:1746144895.430213:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175255168:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.430228:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.430251:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec0 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.430262:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec0 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.430285:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751545c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec0 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.430313:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.430316:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.430323:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec7 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.430332:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec7 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.430364:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec7 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144895.430376:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172488448:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.430615:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144895.433015:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172488448:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144895.433016:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:1.0:1746144895.433036:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144895.433076:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50dc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175255168:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2863us (3077us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.433087:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11084 00000100:00100000:3.0:1746144895.433188:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175255424 00000100:00100000:3.0:1746144895.433194:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175255424 00002000:00100000:3.0:1746144895.433231:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925aaa00 x1830965175255424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.433247:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925aaa00 with x1830965175255424 ext(0->4095) 00002000:00010000:3.0:1746144895.433251:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925aaa00 00000100:00100000:3.0:1746144895.433280:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4124 00000100:00100000:3.0:1746144895.433286:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1984:x1830965175255424:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144895.433464:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1984:x1830965175255424:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 177us (454us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.433469:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4124 00002000:00100000:3.0:1746144895.433475:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925aaa00 x1830965175255424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.433481:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925aaa00 with x1830965175255424 ext(0->4095) 00002000:00010000:3.0:1746144895.433484:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925aaa00 00000100:00100000:2.0:1746144895.437663:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.438111:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175255552 00000100:00100000:3.0:1746144895.438119:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175255552 00000100:00100000:3.0:1746144895.438177:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5669 00000100:00100000:3.0:1746144895.438185:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175255552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.438202:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.438217:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ece expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.438243:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec7 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.438251:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.438252:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.438257:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ece expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.438283:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec7 expref: 45 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.438294:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec7 expref: 45 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.438304:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172488576:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144895.439006:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.442042:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172488576:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144895.442068:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ece expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.442084:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:3.0:1746144895.442132:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175255552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3948us (4477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.442140:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5669 00000100:00100000:0.0:1746144895.442505:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.442672:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175255680 00000100:00100000:1.0:1746144895.442679:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175255680 00002000:00100000:1.0:1746144895.442710:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800925a9500 x1830965175255680/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.442719:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9500 with x1830965175255680 ext(0->7) 00010000:00010000:1.0:1746144895.442725:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec7 expref: 46 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.442740:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec7 expref: 46 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144895.442746:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925a9500 00000100:00100000:1.0:1746144895.442848:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2150 00000100:00100000:1.0:1746144895.442856:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+46:1984:x1830965175255680:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144895.443415:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+48:1984:x1830965175255680:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 559us (910us total) trans 4294968030 rc 0/0 00000100:00100000:1.0:1746144895.443422:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2150 00002000:00100000:1.0:1746144895.443428:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800925a9500 x1830965175255680/t4294968030(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/448 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.443434:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9500 with x1830965175255680 ext(0->7) 00010000:00010000:1.0:1746144895.443439:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec7 expref: 48 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.443448:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec7 expref: 48 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144895.443453:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925a9500 00000100:00100000:0.0:1746144895.453298:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.453623:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175255936 00000100:00100000:3.0:1746144895.453631:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175255936 00000100:00100000:3.0:1746144895.453682:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5670 00000100:00100000:3.0:1746144895.453689:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+48:31565:x1830965175255936:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.453705:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.453720:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ed5 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.453746:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.453751:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ece expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.453756:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144895.453759:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ed5 expref: 49 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.453817:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ece expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.453828:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ed5 expref: 49 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.453837:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:3.0:1746144895.453874:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+49:31565:x1830965175255936:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 186us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.453880:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5670 00000100:00100000:0.0:1746144895.454116:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.454299:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175255808 00000100:00100000:1.0:1746144895.454303:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175255808 00010000:00010000:1.0:1746144895.454318:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec7 expref: 49 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.454341:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11085 00000100:00100000:1.0:1746144895.454346:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+49:1984:x1830965175255808:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.454353:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.454369:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec7 expref: 49 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.454378:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec7 expref: 49 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.454391:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af6727515463 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ec7 expref: 49 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.454403:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.454404:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.454408:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ece expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.454415:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ece expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.454447:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ece expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.454455:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ece expref: 5 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.454464:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172488832:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.454522:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.460174:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.460255:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175256192 00000100:00100000:2.0:1746144895.460263:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175256192 00000100:00100000:1.0:1746144895.460295:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172488832:192.168.202.16@tcp:105: 00002000:00100000:2.0:1746144895.460310:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925aa300 x1830965175256192/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00010000:00010000:1.0:1746144895.460311:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746144895.460319:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925aa300 with x1830965175256192 ext(0->4095) 00010000:00010000:2.0:1746144895.460326:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ece expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.460336:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ece expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.460342:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925aa300 00000100:00100000:1.0:1746144895.460370:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+48:1984:x1830965175255808:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6021us (6251us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.460377:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11085 00000100:00100000:2.0:1746144895.460443:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2151 00000100:00100000:2.0:1746144895.460452:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175256192:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144895.460686:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175256192:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 235us (518us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.460691:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2151 00002000:00100000:2.0:1746144895.460696:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925aa300 x1830965175256192/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.460703:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925aa300 with x1830965175256192 ext(0->4095) 00010000:00010000:2.0:1746144895.460708:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ece expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.460717:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ece expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.460722:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925aa300 00000100:00100000:0.0:1746144895.468018:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.468708:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175256320 00000100:00100000:1.0:1746144895.468719:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175256320 00010000:00010000:1.0:1746144895.468759:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ece expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.469186:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11086 00000100:00100000:1.0:1746144895.469195:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175256320:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.469210:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.469232:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ece expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.469244:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ece expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.469268:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af672751546a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ece expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.469297:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.469299:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.469306:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ed5 expref: 47 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.469314:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ed5 expref: 47 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.469349:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ed5 expref: 47 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144895.469361:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172488960:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.469455:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144895.471868:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172488960:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144895.471887:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144895.471964:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175256320:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2769us (3954us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.471975:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11086 00000100:00100000:0.0:1746144895.472267:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.472344:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175256576 00000100:00100000:3.0:1746144895.472350:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175256576 00002000:00100000:3.0:1746144895.472389:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b033b80 x1830965175256576/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.472399:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033b80 with x1830965175256576 ext(0->4095) 00002000:00010000:3.0:1746144895.472404:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b033b80 00000100:00100000:3.0:1746144895.472420:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4125 00000100:00100000:3.0:1746144895.472426:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+48:1982:x1830965175256576:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:3.0:1746144895.472581:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+48:1982:x1830965175256576:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 156us (315us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.472586:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4125 00002000:00100000:3.0:1746144895.472590:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b033b80 x1830965175256576/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.472597:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033b80 with x1830965175256576 ext(0->4095) 00002000:00010000:3.0:1746144895.472599:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b033b80 00000100:00100000:0.0:1746144895.477082:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.477225:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175256704 00000100:00100000:1.0:1746144895.477236:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175256704 00000100:00100000:1.0:1746144895.477293:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5671 00000100:00100000:1.0:1746144895.477301:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175256704:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.477320:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.477340:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94edc expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.477371:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ed5 expref: 47 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.477379:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.477381:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.477384:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94edc expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.477422:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ed5 expref: 47 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.477434:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ed5 expref: 47 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.477445:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172489088:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144895.477539:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144895.479056:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172489088:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144895.479079:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94edc expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.479093:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009334bc00, rc 0) 00000100:00100000:1.0:1746144895.479135:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175256704:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1835us (2063us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.479143:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5671 00000100:00100000:0.0:1746144895.492721:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.492889:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175256832 00000100:00100000:2.0:1746144895.492899:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175256832 00002000:00100000:2.0:1746144895.492965:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009b032a00 x1830965175256832/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.492975:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b032a00 with x1830965175256832 ext(0->7) 00010000:00010000:2.0:1746144895.492985:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ed5 expref: 48 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.493005:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ed5 expref: 48 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.493011:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b032a00 00000100:00100000:0.0:1746144895.493318:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.493393:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2152 00000100:00100000:2.0:1746144895.493402:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+48:1984:x1830965175256832:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144895.493747:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1984:x1830965175256832:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 346us (1039us total) trans 4294968031 rc 0/0 00000100:00100000:2.0:1746144895.493754:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2152 00002000:00100000:2.0:1746144895.493759:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009b032a00 x1830965175256832/t4294968031(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/448 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.493790:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b032a00 with x1830965175256832 ext(0->7) 00010000:00010000:2.0:1746144895.493796:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ed5 expref: 50 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.493805:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ed5 expref: 50 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.493810:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b032a00 00000100:00100000:1.0:1746144895.493876:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175256960 00000100:00100000:1.0:1746144895.493880:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175256960 00000100:00100000:1.0:1746144895.493914:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5672 00000100:00100000:1.0:1746144895.493919:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+50:31565:x1830965175256960:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.493936:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.493950:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751547f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ee3 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.493971:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.493978:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94edc expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.493983:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144895.493986:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751547f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ee3 expref: 51 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.494020:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94edc expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.494030:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751547f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ee3 expref: 51 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.494040:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea50e00, rc 0) 00000100:00100000:1.0:1746144895.494056:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+51:31565:x1830965175256960:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 137us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.494061:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5672 00000100:00100000:0.0:1746144895.507666:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.507900:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175257088 00000100:00100000:1.0:1746144895.507911:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175257088 00010000:00010000:1.0:1746144895.507961:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ed5 expref: 51 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.509123:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11087 00000100:00100000:1.0:1746144895.509329:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+51:1982:x1830965175257088:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.509348:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.509375:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ed5 expref: 51 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.509394:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ed5 expref: 51 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.509419:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515471 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ed5 expref: 51 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.510781:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.510785:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.510796:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94edc expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.510805:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94edc expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.510848:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94edc expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.510861:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94edc expref: 5 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.510872:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172489344:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.511609:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144895.516552:0:3308:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1830965172489600:0@lo:400:kworker.0 00000100:00100000:1.0:1746144895.516622:0:3308:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144895.516719:0:3306:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746144895.516728:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2566f13b-362a-4e88-b0dd-c558bbe87895:3306:1830965172489472:0@lo:400:kworker.0 00000100:00100000:3.0:1746144895.516783:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144895.516841:0:21078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172489600 00000100:00100000:3.0:1746144895.516849:0:21078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172489600 00000100:00100000:3.0:1746144895.516889:0:21078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1746144895.516896:0:21078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1830965172489600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746144895.516950:0:21078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1830965172489600:12345-0@lo:400:kworker.0 Request processed in 55us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.516956:0:21078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1746144895.516989:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172489472 00000100:00100000:3.0:1746144895.516991:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172489472 00000100:00100000:1.0:1746144895.517282:0:3308:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a094700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1830965172490112:0@lo:400:kworker.0 00000100:00100000:1.0:1746144895.517309:0:3308:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144895.517363:0:3309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a097b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1830965172489728:0@lo:400:kworker.0 00000100:00100000:0.0:1746144895.517390:0:3309:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144895.517411:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1830965172489984:0@lo:400:kworker.0 00000100:00100000:0.0:1746144895.517429:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144895.517440:0:3307:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746144895.517443:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172489856:0@lo:400:kworker.0 00000100:00100000:0.0:1746144895.517460:0:21078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172489728 00000100:00100000:0.0:1746144895.517463:0:21078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172489728 00000100:00100000:0.0:1746144895.517484:0:21078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172489984 00000100:00100000:0.0:1746144895.517486:0:21078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172489984 00000100:00100000:0.0:1746144895.517506:0:21078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1746144895.517511:0:21078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1830965172489728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144895.517539:0:21078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1830965172489728:12345-0@lo:400:kworker.0 Request processed in 29us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144895.517544:0:21078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1746144895.517554:0:21078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1746144895.517557:0:21078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1830965172489984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144895.517573:0:21078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1830965172489984:12345-0@lo:400:kworker.0 Request processed in 16us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144895.517577:0:21078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00080000:0.0:1746144895.517588:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144895.517611:0:3309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a097b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1830965172489728:0@lo:400:kworker.0 00000100:00100000:1.0:1746144895.517678:0:3308:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a097480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1830965172489600:0@lo:400:kworker.0 00000100:00100000:2.0:1746144895.517714:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172490112 00000100:00100000:2.0:1746144895.517717:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172490112 00000100:00100000:2.0:1746144895.517748:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1746144895.517754:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1830965172490112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746144895.517792:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1830965172490112:12345-0@lo:400:kworker.0 Request processed in 39us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.517797:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00080000:1.0:1746144895.517845:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746144895.517856:0:3308:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a094700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1830965172490112:0@lo:400:kworker.0 00000100:00100000:0.0:1746144895.517938:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144895.517954:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a097100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1830965172489984:0@lo:400:kworker.0 00000100:00100000:3.0:1746144895.518002:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1746144895.518009:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2566f13b-362a-4e88-b0dd-c558bbe87895+18:3306:x1830965172489472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746144895.518036:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2566f13b-362a-4e88-b0dd-c558bbe87895+18:3306:x1830965172489472:12345-0@lo:400:kworker.0 Request processed in 28us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.518040:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1746144895.518094:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172489856 00000100:00100000:1.0:1746144895.518097:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172489856 00000100:00100000:1.0:1746144895.518268:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1746144895.518272:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172489856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746144895.518296:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172489856:12345-0@lo:400:kworker.0 Request processed in 24us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.518300:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1746144895.518339:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2566f13b-362a-4e88-b0dd-c558bbe87895:3306:1830965172489472:0@lo:400:kworker.0 00000100:00100000:0.0:1746144895.518353:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172489856:0@lo:400:kworker.0 00000100:00080000:2.0:1746144895.518385:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746144895.519699:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172489344:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144895.519715:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144895.519787:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1982:x1830965175257088:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 10465us (12132us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.519796:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11087 00000100:00100000:0.0:1746144895.519826:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.519980:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175257344 00000100:00100000:3.0:1746144895.519986:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175257344 00002000:00100000:3.0:1746144895.520019:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a2a00 x1830965175257344/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.520029:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a2a00 with x1830965175257344 ext(0->4095) 00010000:00010000:3.0:1746144895.520038:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94edc expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.520050:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94edc expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.520057:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918a2a00 00000100:00100000:3.0:1746144895.520179:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2153 00000100:00100000:3.0:1746144895.520185:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175257344:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144895.520344:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175257344:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 159us (765us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.520348:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2153 00002000:00100000:3.0:1746144895.520352:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a2a00 x1830965175257344/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.520357:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a2a00 with x1830965175257344 ext(0->4095) 00010000:00010000:3.0:1746144895.520360:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94edc expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.520367:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94edc expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.520370:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918a2a00 00000100:00100000:0.0:1746144895.524947:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.525432:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175257472 00000100:00100000:1.0:1746144895.525443:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175257472 00010000:00010000:1.0:1746144895.525482:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94edc expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.525525:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11088 00000100:00100000:1.0:1746144895.525533:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175257472:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.525548:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.525570:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94edc expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.525583:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94edc expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.525608:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009334bc00/0x4076af6727515478 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94edc expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.525642:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.525644:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.525652:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751547f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ee3 expref: 49 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.525660:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751547f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ee3 expref: 49 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.525694:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751547f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ee3 expref: 49 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144895.525707:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172490240:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.527162:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144895.529169:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172490240:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144895.529195:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144895.529278:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175257472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3743us (4339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.529297:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11088 00000100:00100000:0.0:1746144895.530517:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.530647:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175257728 00000100:00100000:3.0:1746144895.530655:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175257728 00002000:00100000:3.0:1746144895.530697:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a1f80 x1830965175257728/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.530707:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a1f80 with x1830965175257728 ext(0->4095) 00002000:00010000:3.0:1746144895.530712:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918a1f80 00000100:00100000:3.0:1746144895.530729:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4126 00000100:00100000:3.0:1746144895.530735:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1984:x1830965175257728:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144895.530948:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1984:x1830965175257728:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 212us (435us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.530955:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4126 00002000:00100000:3.0:1746144895.530960:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918a1f80 x1830965175257728/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.530968:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918a1f80 with x1830965175257728 ext(0->4095) 00002000:00010000:3.0:1746144895.530970:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918a1f80 00000100:00100000:0.0:1746144895.532544:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.532650:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175257856 00000100:00100000:3.0:1746144895.532656:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175257856 00000100:00100000:3.0:1746144895.532699:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5673 00000100:00100000:3.0:1746144895.532706:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175257856:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.532720:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.532737:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515486 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94eea expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.532789:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751547f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ee3 expref: 49 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.532802:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.532804:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.532807:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515486 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eea expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.532844:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751547f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ee3 expref: 49 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.532856:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751547f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ee3 expref: 49 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.532868:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172490368:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144895.533549:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.534933:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172490368:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144895.534962:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515486 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eea expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.534979:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:3.0:1746144895.535012:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175257856:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2306us (2473us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.535020:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5673 00000100:00100000:0.0:1746144895.536004:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.536238:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175257984 00000100:00100000:1.0:1746144895.536246:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175257984 00010000:00010000:1.0:1746144895.536278:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751547f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ee3 expref: 50 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.536313:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11089 00000100:00100000:1.0:1746144895.536319:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1984:x1830965175257984:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.536332:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.536353:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751547f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ee3 expref: 50 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.536363:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751547f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ee3 expref: 50 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.536386:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751547f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ee3 expref: 50 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.536416:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.536418:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.536425:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515486 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eea expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.536433:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515486 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eea expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.536463:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515486 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eea expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144895.536474:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172490496:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.537450:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144895.538075:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172490496:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144895.538087:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144895.538113:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+49:1984:x1830965175257984:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1794us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.538120:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11089 00000100:00100000:0.0:1746144895.538430:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.538563:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175258240 00000100:00100000:1.0:1746144895.538568:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175258240 00002000:00100000:1.0:1746144895.538602:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea9880 x1830965175258240/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.538612:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea9880 with x1830965175258240 ext(0->4095) 00002000:00010000:1.0:1746144895.538617:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea9880 00000100:00100000:1.0:1746144895.538645:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4127 00000100:00100000:1.0:1746144895.538651:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175258240:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144895.539024:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175258240:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 371us (593us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144895.539031:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4127 00002000:00100000:1.0:1746144895.539036:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea9880 x1830965175258240/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.539044:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea9880 with x1830965175258240 ext(0->4095) 00002000:00010000:1.0:1746144895.539047:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea9880 00000100:00100000:0.0:1746144895.540838:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.540947:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175258368 00000100:00100000:3.0:1746144895.540953:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175258368 00000100:00100000:3.0:1746144895.541140:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5674 00000100:00100000:3.0:1746144895.541148:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+49:31579:x1830965175258368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.541164:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.541181:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ef8 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.541208:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515486 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eea expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.541215:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.541216:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.541220:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef8 expref: 50 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.541251:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515486 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eea expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.541262:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515486 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eea expref: 5 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.541273:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172490624:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144895.541349:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.542028:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.542087:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175258496 00000100:00100000:1.0:1746144895.542092:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175258496 00000100:00100000:1.0:1746144895.542114:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5675 00000100:00100000:1.0:1746144895.542119:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+51:31565:x1830965175258496:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.542127:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.542135:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ef1 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.542149:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.542153:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef8 expref: 52 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.542157:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.542160:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef1 expref: 52 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.542181:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef8 expref: 52 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.542190:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef1 expref: 52 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.542200:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094112c00, rc 0) 00000100:00100000:1.0:1746144895.542238:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+52:31565:x1830965175258496:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 117us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.542243:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5675 00000100:00100000:3.0:1746144895.543497:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172490624:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144895.543519:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef8 expref: 51 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.543529:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:3.0:1746144895.543554:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+51:31579:x1830965175258368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2407us (2721us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.543563:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5674 00000100:00100000:0.0:1746144895.545028:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.545140:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175258624 00000100:00100000:1.0:1746144895.545148:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175258624 00010000:00010000:1.0:1746144895.545181:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515486 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eea expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.545215:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11090 00000100:00100000:1.0:1746144895.545223:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175258624:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144895.545235:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144895.545255:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515486 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eea expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.545267:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515486 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eea expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.545289:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515486 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eea expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.545317:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.545319:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.545326:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef8 expref: 50 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.545334:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef8 expref: 50 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.545364:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef8 expref: 50 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.545375:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef8 expref: 50 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.545387:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172490880:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.545463:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144895.548119:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.548191:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172490880:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144895.548211:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144895.548282:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175258880 00000100:00100000:0.0:1746144895.548288:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175258880 00002000:00100000:0.0:1746144895.548328:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f72a00 x1830965175258880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144895.548337:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f72a00 with x1830965175258880 ext(0->4095) 00010000:00010000:0.0:1746144895.548345:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef8 expref: 51 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:0.0:1746144895.548357:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef8 expref: 51 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:0.0:1746144895.548363:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f72a00 00000100:00100000:2.0:1746144895.548426:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175258624:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3202us (3402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.548436:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11090 00000100:00100000:0.0:1746144895.548590:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2154 00000100:00100000:0.0:1746144895.548597:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+51:1985:x1830965175258880:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144895.548759:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+51:1985:x1830965175258880:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 163us (649us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144895.548787:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2154 00002000:00100000:0.0:1746144895.548793:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f72a00 x1830965175258880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144895.548800:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f72a00 with x1830965175258880 ext(0->4095) 00010000:00010000:0.0:1746144895.548804:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef8 expref: 51 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:0.0:1746144895.548813:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef8 expref: 51 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:0.0:1746144895.548818:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f72a00 00000100:00100000:0.0:1746144895.551325:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.551496:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.551619:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175259008 00000100:00100000:3.0:1746144895.551628:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175259008 00000100:00100000:3.0:1746144895.551796:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5676 00000100:00100000:3.0:1746144895.551805:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175259008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.551823:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144895.551844:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94eff expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.551870:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.551876:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef1 expref: 50 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.551882:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144895.551885:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eff expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.551936:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef1 expref: 50 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.551948:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eff expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.551958:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:3.0:1746144895.552000:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175259008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 197us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.552006:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5676 00000100:00100000:2.0:1746144895.552325:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175259136 00000100:00100000:2.0:1746144895.552329:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175259136 00010000:00010000:2.0:1746144895.552352:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef8 expref: 51 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.552369:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11091 00000100:00100000:2.0:1746144895.552374:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a50dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+51:1983:x1830965175259136:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144895.552386:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144895.552406:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef8 expref: 51 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.552416:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef8 expref: 51 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.552435:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751548d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef8 expref: 51 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.552450:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.552452:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.552457:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef1 expref: 50 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.552464:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef1 expref: 50 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.552485:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef1 expref: 50 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.552495:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef1 expref: 50 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.552506:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172491136:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144895.552562:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.555285:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172491136:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144895.555311:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144895.555351:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a50dc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1983:x1830965175259136:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2975us (3854us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.555361:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11091 00000100:00100000:0.0:1746144895.555901:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.556047:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175259392 00000100:00100000:3.0:1746144895.556054:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175259392 00002000:00100000:3.0:1746144895.556089:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b462680 x1830965175259392/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.556098:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b462680 with x1830965175259392 ext(0->4095) 00010000:00010000:3.0:1746144895.556106:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef1 expref: 50 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.556122:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef1 expref: 50 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.556128:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b462680 00000100:00100000:3.0:1746144895.556151:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2155 00000100:00100000:3.0:1746144895.556157:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1984:x1830965175259392:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144895.556425:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1984:x1830965175259392:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 267us (525us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.556431:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2155 00002000:00100000:3.0:1746144895.556436:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b462680 x1830965175259392/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.556442:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b462680 with x1830965175259392 ext(0->4095) 00010000:00010000:3.0:1746144895.556448:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef1 expref: 50 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.556457:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef1 expref: 50 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.556467:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b462680 00000100:00100000:0.0:1746144895.561898:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.562148:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175259648 00000100:00100000:2.0:1746144895.562159:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175259648 00010000:00010000:2.0:1746144895.562201:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef1 expref: 50 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.562242:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11092 00000100:00100000:2.0:1746144895.562249:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1982:x1830965175259648:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144895.562263:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144895.562285:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef1 expref: 50 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.562298:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef1 expref: 50 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.562321:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af6727515494 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ef1 expref: 50 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.562349:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.562351:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.562358:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eff expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.562366:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eff expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.562399:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eff expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144895.562410:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172491264:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144895.562488:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.562538:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.562623:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175259520 00000100:00100000:0.0:1746144895.562626:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175259520 00000100:00100000:0.0:1746144895.562646:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5677 00000100:00100000:0.0:1746144895.562652:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+50:31565:x1830965175259520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144895.562663:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144895.562674:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b2a00/0x4076af67275154a2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f06 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144895.562690:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eff expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144895.562696:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144895.562699:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144895.562702:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2a00/0x4076af67275154a2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f06 expref: 51 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144895.562717:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eff expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144895.562727:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eff expref: 5 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:0.0:1746144895.562735:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093368a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172491392:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144895.562756:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.563983:0:3309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009336a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172491520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746144895.564021:0:3309:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144895.564065:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172491520 00000100:00100000:3.0:1746144895.564069:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172491520 00000100:00100000:3.0:1746144895.564096:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1746144895.564102:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1830965172491520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746144895.564132:0:8434:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 680984576 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1746144895.564169:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1830965172491520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.564175:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1746144895.564192:0:3309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009336a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172491520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746144895.567210:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093368a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172491392:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.567244:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2a00/0x4076af67275154a2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f06 expref: 51 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.567262:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b2a00, rc 0) 00000100:00100000:2.0:1746144895.567519:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+51:31565:x1830965175259520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4865us (4979us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.567528:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5677 00000100:00100000:3.0:1746144895.569436:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172491264:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.569460:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.569515:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1982:x1830965175259648:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7264us (7627us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.569525:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11092 00000100:00100000:0.0:1746144895.569626:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.569963:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175259904 00000100:00100000:3.0:1746144895.569969:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175259904 00002000:00100000:3.0:1746144895.570005:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368000 x1830965175259904/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.570014:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368000 with x1830965175259904 ext(0->4095) 00010000:00010000:3.0:1746144895.570023:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eff expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.570035:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eff expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.570046:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093368000 00000100:00100000:3.0:1746144895.570060:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2156 00000100:00100000:3.0:1746144895.570065:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175259904:12345-192.168.202.16@tcp:3:ldlm_bl.0 00000100:00100000:3.0:1746144895.570228:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175259904:12345-192.168.202.16@tcp:3:ldlm_bl.0 Request processed in 162us (602us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.570233:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2156 00002000:00100000:3.0:1746144895.570238:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368000 x1830965175259904/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.570245:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368000 with x1830965175259904 ext(0->4095) 00010000:00010000:3.0:1746144895.570249:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eff expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.570257:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eff expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.570262:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093368000 00000100:00100000:0.0:1746144895.573441:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.573537:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175260032 00000100:00100000:3.0:1746144895.573544:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175260032 00010000:00010000:3.0:1746144895.573576:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eff expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.573606:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11093 00000100:00100000:3.0:1746144895.573611:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175260032:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.573623:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.573642:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eff expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.573650:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eff expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.573670:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751549b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94eff expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.573692:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.573693:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.573700:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2a00/0x4076af67275154a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f06 expref: 49 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.573706:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2a00/0x4076af67275154a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f06 expref: 49 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.574074:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2a00/0x4076af67275154a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f06 expref: 49 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.574087:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172491648:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.574492:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42240 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.576081:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172491648:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.576100:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.576398:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175260032:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2783us (2966us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.576409:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11093 00000100:00100000:0.0:1746144895.577172:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.577372:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175260288 00000100:00100000:1.0:1746144895.577380:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175260288 00002000:00100000:1.0:1746144895.577422:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368a80 x1830965175260288/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.577432:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368a80 with x1830965175260288 ext(0->4095) 00002000:00010000:1.0:1746144895.577437:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093368a80 00000100:00100000:1.0:1746144895.577727:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4128 00000100:00100000:1.0:1746144895.577734:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1985:x1830965175260288:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144895.578213:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1985:x1830965175260288:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 479us (1041us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144895.578220:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4128 00002000:00100000:1.0:1746144895.578226:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368a80 x1830965175260288/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.578233:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368a80 with x1830965175260288 ext(0->4095) 00002000:00010000:1.0:1746144895.578236:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093368a80 00000100:00100000:3.0:1746144895.581500:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.581570:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175260416 00000100:00100000:2.0:1746144895.581580:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175260416 00000100:00100000:2.0:1746144895.581633:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5678 00000100:00100000:2.0:1746144895.581641:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175260416:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.581660:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.581679:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f0d expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.581711:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2a00/0x4076af67275154a2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f06 expref: 49 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.581719:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.581722:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.581725:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f0d expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.581757:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2a00/0x4076af67275154a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f06 expref: 49 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.581789:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2a00/0x4076af67275154a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f06 expref: 49 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.581806:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172491776:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.581895:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.584133:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172491776:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144895.584133:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1746144895.584165:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f0d expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.586942:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e4600, rc 0) 00000100:00100000:2.0:1746144895.587034:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175260416:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5387us (5541us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.587044:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5678 00000100:00100000:3.0:1746144895.587152:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175260544 00000100:00100000:3.0:1746144895.587159:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175260544 00010000:00010000:3.0:1746144895.587188:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2a00/0x4076af67275154a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f06 expref: 50 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.587220:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11094 00000100:00100000:3.0:1746144895.587226:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1984:x1830965175260544:12345-192.168.202.16@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746144895.587236:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:3.0:1746144895.587239:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.587258:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b2a00/0x4076af67275154a2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f06 expref: 50 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.587269:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b2a00/0x4076af67275154a2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f06 expref: 50 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.587291:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2a00/0x4076af67275154a2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f06 expref: 50 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.587311:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.587313:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.587319:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f0d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.587327:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f0d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.587356:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f0d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.587373:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172491904:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.587428:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.587471:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175260672 00000100:00100000:2.0:1746144895.587474:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175260672 00000100:00100000:2.0:1746144895.587496:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5679 00000100:00100000:2.0:1746144895.587501:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013619b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+50:31565:x1830965175260672:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.587513:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.587524:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f14 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.587539:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f0d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.587545:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.587546:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.587548:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f14 expref: 51 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.587576:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f0d expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.587586:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f0d expref: 5 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.587594:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172492032:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.587615:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.592323:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.592418:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172491904:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.592439:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.592483:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+51:1984:x1830965175260544:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5257us (8356us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.592496:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11094 00000100:00100000:1.0:1746144895.592688:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175260928 00000100:00100000:1.0:1746144895.592696:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175260928 00000100:00100000:2.0:1746144895.592719:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172492032:192.168.202.16@tcp:104: 00002000:00100000:1.0:1746144895.592735:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093854a80 x1830965175260928/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00010000:00010000:2.0:1746144895.592745:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f14 expref: 50 pid: 10401 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746144895.592745:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854a80 with x1830965175260928 ext(0->4095) 00010000:00010000:1.0:1746144895.592753:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f0d expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.592784:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e4400, rc 0) 00010000:00010000:1.0:1746144895.592785:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f0d expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144895.592793:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093854a80 00000100:00100000:1.0:1746144895.592810:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2157 00000100:00100000:2.0:1746144895.592812:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013619b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+50:31565:x1830965175260672:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5310us (5578us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.592817:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175260928:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144895.592819:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5679 00000100:00100000:1.0:1746144895.593483:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175260928:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 663us (1166us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144895.593490:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2157 00002000:00100000:1.0:1746144895.593495:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093854a80 x1830965175260928/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.593504:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854a80 with x1830965175260928 ext(0->4095) 00010000:00010000:1.0:1746144895.593509:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f0d expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.593519:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f0d expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144895.593525:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093854a80 00000100:00100000:0.0:1746144895.596488:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.597000:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175261056 00000100:00100000:3.0:1746144895.597009:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175261056 00010000:00010000:3.0:1746144895.597047:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f0d expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.597084:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11095 00000100:00100000:3.0:1746144895.597093:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175261056:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.597106:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.597128:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f0d expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.597140:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f0d expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.597161:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154a9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f0d expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.597191:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.597193:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.597200:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f14 expref: 49 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.597207:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f14 expref: 49 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.597241:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f14 expref: 49 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.597252:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172492160:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.597337:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.600728:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.600891:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172492160:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.600911:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.600963:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175261056:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3871us (4485us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.600973:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11095 00000100:00100000:1.0:1746144895.601445:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175261312 00000100:00100000:1.0:1746144895.601453:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175261312 00002000:00100000:1.0:1746144895.601497:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5c700 x1830965175261312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.601507:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5c700 with x1830965175261312 ext(0->4095) 00002000:00010000:1.0:1746144895.601512:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5c700 00000100:00100000:1.0:1746144895.601543:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4129 00000100:00100000:1.0:1746144895.601551:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1985:x1830965175261312:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144895.601708:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1985:x1830965175261312:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 158us (990us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144895.601714:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4129 00002000:00100000:1.0:1746144895.601718:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5c700 x1830965175261312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.601725:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5c700 with x1830965175261312 ext(0->4095) 00002000:00010000:1.0:1746144895.601728:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5c700 00000100:00100000:0.0:1746144895.607453:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.607583:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175261440 00000100:00100000:2.0:1746144895.607593:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175261440 00000100:00100000:2.0:1746144895.607886:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5680 00000100:00100000:2.0:1746144895.607896:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175261440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.607915:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.607944:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f1b expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.607978:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f14 expref: 49 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.607986:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.607989:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.607992:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f1b expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.608023:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f14 expref: 49 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.608036:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f14 expref: 49 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.608049:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172492288:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.609070:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00010000:00010000:2.0:1746144895.609086:0:7101:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746144895.611467:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172492288:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.611504:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f1b expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.611522:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e4800, rc 0) 00000100:00100000:2.0:1746144895.611567:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175261440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3673us (4124us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.611575:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5680 00000100:00100000:0.0:1746144895.614526:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.614812:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175261568 00000100:00100000:1.0:1746144895.614822:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175261568 00002000:00100000:1.0:1746144895.614893:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880087c5ed80 x1830965175261568/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.614908:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ed80 with x1830965175261568 ext(0->7) 00010000:00010000:1.0:1746144895.614919:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f14 expref: 50 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.614947:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f14 expref: 50 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144895.614954:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5ed80 00000100:00100000:1.0:1746144895.614994:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2158 00000100:00100000:1.0:1746144895.615007:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+50:1985:x1830965175261568:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144895.615458:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+52:1985:x1830965175261568:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 456us (947us total) trans 4294968032 rc 0/0 00000100:00100000:1.0:1746144895.615469:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2158 00002000:00100000:1.0:1746144895.615475:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880087c5ed80 x1830965175261568/t4294968032(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/448 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.615488:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ed80 with x1830965175261568 ext(0->7) 00010000:00010000:1.0:1746144895.615493:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f14 expref: 52 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.615503:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f14 expref: 52 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144895.615514:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5ed80 00000100:00100000:0.0:1746144895.619349:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.619444:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.619467:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175261696 00000100:00100000:2.0:1746144895.619477:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175261696 00000100:00100000:2.0:1746144895.620007:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5681 00000100:00100000:2.0:1746144895.620017:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+52:31565:x1830965175261696:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.620037:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.620056:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275154be lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f22 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.620068:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175261824 00000100:00100000:3.0:1746144895.620071:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175261824 00010000:00010000:2.0:1746144895.620085:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144895.620089:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f14 expref: 54 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.620091:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f1b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.620096:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144895.620099:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275154be lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f22 expref: 54 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.620120:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11096 00000100:00100000:3.0:1746144895.620125:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+54:1985:x1830965175261824:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.620132:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144895.620136:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f1b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.620148:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275154be lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f22 expref: 54 pid: 10401 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746144895.620149:0:7098:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 1746144895 -> 1746144896 00002000:00010000:3.0:1746144895.620152:0:7098:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 1746144895 -> 1746144896 00010000:00010000:3.0:1746144895.620157:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f14 expref: 54 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.620157:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e5200, rc 0) 00010000:00010000:3.0:1746144895.620167:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f14 expref: 54 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.620182:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af67275154b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f14 expref: 54 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.620196:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.620197:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746144895.620198:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+53:31565:x1830965175261696:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 184us (1344us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144895.620202:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f1b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144895.620203:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5681 00010000:00010000:3.0:1746144895.620208:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f1b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.620227:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f1b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.620237:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f1b expref: 5 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.620248:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172492544:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.620299:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42240 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.621632:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172492544:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.621652:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.621680:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+52:1985:x1830965175261824:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1553us (2234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.621688:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11096 00000100:00100000:0.0:1746144895.622123:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.622181:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175262080 00000100:00100000:2.0:1746144895.622187:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175262080 00002000:00100000:2.0:1746144895.622222:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac86300 x1830965175262080/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.622231:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac86300 with x1830965175262080 ext(0->4095) 00010000:00010000:2.0:1746144895.622239:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f1b expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.622250:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f1b expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.622257:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac86300 00000100:00100000:2.0:1746144895.622457:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2159 00000100:00100000:2.0:1746144895.622466:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175262080:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144895.622874:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175262080:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 409us (751us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.622880:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2159 00002000:00100000:2.0:1746144895.622885:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac86300 x1830965175262080/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.622892:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac86300 with x1830965175262080 ext(0->4095) 00010000:00010000:2.0:1746144895.622897:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f1b expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.622905:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f1b expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.622911:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac86300 00000100:00100000:0.0:1746144895.625078:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.625203:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175262208 00000100:00100000:3.0:1746144895.625211:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175262208 00010000:00010000:3.0:1746144895.625243:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f1b expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.625426:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11097 00000100:00100000:3.0:1746144895.625434:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175262208:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.625450:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.625469:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f1b expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.625481:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f1b expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.625503:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af67275154b7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f1b expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.625517:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.625519:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.625525:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275154be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f22 expref: 51 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.625532:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275154be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f22 expref: 51 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.625569:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275154be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f22 expref: 51 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.625581:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172492672:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.625914:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.628570:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.628658:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172492672:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.628676:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.629099:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175262208:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3663us (4026us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.629110:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11097 00000100:00100000:2.0:1746144895.629345:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175262464 00000100:00100000:2.0:1746144895.629352:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175262464 00002000:00100000:2.0:1746144895.629395:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac84380 x1830965175262464/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.629410:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac84380 with x1830965175262464 ext(0->4095) 00002000:00010000:2.0:1746144895.629415:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac84380 00000100:00100000:2.0:1746144895.629428:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4130 00000100:00100000:2.0:1746144895.629433:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+52:1982:x1830965175262464:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746144895.629590:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+52:1982:x1830965175262464:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 157us (1029us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.629595:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4130 00002000:00100000:2.0:1746144895.629600:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac84380 x1830965175262464/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.629607:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac84380 with x1830965175262464 ext(0->4095) 00002000:00010000:2.0:1746144895.629610:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac84380 00000100:00100000:1.0:1746144895.633177:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.633265:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175262592 00000100:00100000:0.0:1746144895.633275:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175262592 00000100:00100000:0.0:1746144895.633327:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5682 00000100:00100000:0.0:1746144895.633335:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175262592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144895.633355:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144895.633374:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f29 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144895.633404:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275154be lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f22 expref: 51 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144895.633411:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144895.633413:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144895.633416:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f29 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144895.633462:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275154be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f22 expref: 51 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144895.633475:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275154be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f22 expref: 51 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:0.0:1746144895.633487:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a004000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172492800:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144895.633575:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.635958:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a004000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172492800:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.635992:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f29 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.636008:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b3400, rc 0) 00000100:00100000:2.0:1746144895.636962:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175262592:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3622us (3789us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.636971:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5682 00000100:00100000:0.0:1746144895.637116:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.637469:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175262720 00000100:00100000:3.0:1746144895.637477:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175262720 00010000:00010000:3.0:1746144895.637508:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275154be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f22 expref: 52 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.637703:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11098 00000100:00100000:3.0:1746144895.637711:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b412dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+52:1985:x1830965175262720:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.637724:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.637746:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275154be lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f22 expref: 52 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.637758:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275154be lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f22 expref: 52 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.637811:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275154be lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f22 expref: 52 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.638365:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.638367:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.638376:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f29 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.638385:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f29 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.638424:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f29 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.638435:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172492928:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.639055:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.640125:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.640267:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175262848 00000100:00100000:2.0:1746144895.640273:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175262848 00000100:00100000:2.0:1746144895.640329:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5683 00000100:00100000:2.0:1746144895.640337:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+52:31565:x1830965175262848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.640354:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.640371:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f30 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.640395:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f29 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.640402:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.640404:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.640407:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f30 expref: 53 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.640432:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f29 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.640443:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f29 expref: 5 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.640452:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172493056:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144895.640462:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172492928:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.640475:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.640493:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b412dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+53:1985:x1830965175262720:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2783us (3377us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.640503:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.640622:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11098 00000100:00100000:0.0:1746144895.643088:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.643307:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175263104 00000100:00100000:1.0:1746144895.643314:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175263104 00002000:00100000:1.0:1746144895.643355:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a004700 x1830965175263104/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.643365:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a004700 with x1830965175263104 ext(0->4095) 00010000:00010000:1.0:1746144895.643373:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f29 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.643385:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f29 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144895.643392:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a004700 00000100:00100000:1.0:1746144895.643422:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2160 00000100:00100000:1.0:1746144895.643429:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175263104:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144895.643641:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172493056:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.643667:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f30 expref: 52 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.643680:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e4600, rc 0) 00000100:00100000:2.0:1746144895.643727:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+52:31565:x1830965175262848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3391us (3605us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.643738:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5683 00000100:00100000:1.0:1746144895.644934:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a004700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175263104:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1492us (1837us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144895.644942:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2160 00002000:00100000:1.0:1746144895.644948:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a004700 x1830965175263104/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.644956:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a004700 with x1830965175263104 ext(0->4095) 00010000:00010000:1.0:1746144895.644962:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f29 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.644972:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f29 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144895.644977:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a004700 00000100:00100000:0.0:1746144895.648859:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.648943:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175263232 00000100:00100000:3.0:1746144895.648954:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175263232 00010000:00010000:3.0:1746144895.648988:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f29 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.649026:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11099 00000100:00100000:3.0:1746144895.649033:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a004a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175263232:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.649049:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.649069:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f29 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.649081:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f29 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.649104:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af67275154c5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f29 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.649130:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.649132:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.649139:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f30 expref: 51 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.649147:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f30 expref: 51 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.649177:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f30 expref: 51 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.649187:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172493184:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.649319:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.653227:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172493184:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.653248:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.653289:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a004a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175263232:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4256us (4440us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.653303:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11099 00000100:00100000:0.0:1746144895.654024:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.654207:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175263488 00000100:00100000:1.0:1746144895.654215:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175263488 00002000:00100000:1.0:1746144895.654253:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a004e00 x1830965175263488/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.654263:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a004e00 with x1830965175263488 ext(0->4095) 00002000:00010000:1.0:1746144895.654268:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a004e00 00000100:00100000:1.0:1746144895.654296:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4131 00000100:00100000:1.0:1746144895.654303:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+52:1985:x1830965175263488:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144895.654479:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a004e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+52:1985:x1830965175263488:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 176us (456us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144895.654486:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4131 00002000:00100000:1.0:1746144895.654492:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a004e00 x1830965175263488/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.654498:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a004e00 with x1830965175263488 ext(0->4095) 00002000:00010000:1.0:1746144895.654500:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a004e00 00000100:00100000:0.0:1746144895.658896:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.659037:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175263616 00000100:00100000:2.0:1746144895.659046:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175263616 00000100:00100000:2.0:1746144895.659106:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5684 00000100:00100000:2.0:1746144895.659114:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175263616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.659133:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.659152:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f37 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.659181:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f30 expref: 51 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.659189:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.659190:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.659193:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f37 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.659224:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f30 expref: 51 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.659235:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f30 expref: 51 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.659246:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172493312:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.659326:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.660991:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172493312:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.661017:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f37 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.661029:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e4e00, rc 0) 00000100:00100000:2.0:1746144895.661059:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a005180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175263616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1947us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.661066:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5684 00000100:00100000:0.0:1746144895.662540:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.663148:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175263744 00000100:00100000:3.0:1746144895.663156:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175263744 00002000:00100000:3.0:1746144895.663202:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008a005500 x1830965175263744/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.663211:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a005500 with x1830965175263744 ext(0->7) 00010000:00010000:3.0:1746144895.663219:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f30 expref: 52 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.663231:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f30 expref: 52 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.663237:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a005500 00000100:00100000:3.0:1746144895.663272:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2161 00000100:00100000:3.0:1746144895.663280:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+52:1984:x1830965175263744:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144895.664291:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a005500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+54:1984:x1830965175263744:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 1009us (1752us total) trans 4294968033 rc 0/0 00000100:00100000:3.0:1746144895.664300:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2161 00002000:00100000:3.0:1746144895.664307:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008a005500 x1830965175263744/t4294968033(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/448 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.664314:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a005500 with x1830965175263744 ext(0->7) 00010000:00010000:3.0:1746144895.664320:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f30 expref: 54 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.664335:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f30 expref: 54 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.664340:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a005500 00000100:00100000:0.0:1746144895.671589:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.671694:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175263872 00000100:00100000:3.0:1746144895.671704:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175263872 00010000:00010000:3.0:1746144895.671745:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f30 expref: 54 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.672892:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11100 00000100:00100000:3.0:1746144895.672905:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a005880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+54:1985:x1830965175263872:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.672935:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.672961:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f30 expref: 54 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.672974:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f30 expref: 54 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.672998:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af67275154cc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f30 expref: 54 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.673578:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.673581:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.673615:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f37 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.673628:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f37 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.673691:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f37 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.673716:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172493440:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.675072:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.677949:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.678499:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.678588:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175264256 00000100:00100000:3.0:1746144895.678596:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175264256 00002000:00100000:3.0:1746144895.678716:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a005f80 x1830965175264256/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1746144895.678805:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175264000 00000100:00100000:2.0:1746144895.678809:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175264000 00000100:00100000:2.0:1746144895.678853:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5685 00000100:00100000:2.0:1746144895.678861:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+54:31565:x1830965175264000:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.678877:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.678894:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f3e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.678952:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f37 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.678960:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.678962:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.678965:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f3e expref: 55 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.679002:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f37 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.679014:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f37 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.679027:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172493568:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.679117:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00002000:00100000:3.0:1746144895.679174:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a005f80 with x1830965175264256 ext(0->4095) 00010000:00010000:3.0:1746144895.679186:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f37 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.679196:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f37 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.679202:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a005f80 00000100:00100000:3.0:1746144895.679218:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2162 00000100:00100000:3.0:1746144895.679224:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175264256:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144895.679395:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a005f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175264256:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 170us (895us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.679405:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2162 00002000:00100000:3.0:1746144895.679411:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a005f80 x1830965175264256/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.679419:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a005f80 with x1830965175264256 ext(0->4095) 00010000:00010000:3.0:1746144895.679424:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f37 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.679433:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f37 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.679438:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a005f80 00000100:00100000:3.0:1746144895.679479:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172493440:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.679494:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.679513:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a005880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+55:1985:x1830965175263872:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6613us (7937us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.679521:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11100 00000100:00100000:0.0:1746144895.683320:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.683614:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.683687:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175264384 00000100:00100000:2.0:1746144895.683717:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a097100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172493568:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.683752:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f3e expref: 54 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.683789:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e5c00, rc 0) 00000100:00100000:2.0:1746144895.683834:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+54:31565:x1830965175264000:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4972us (5895us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.683842:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5685 00000100:00100000:1.0:1746144895.683909:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175264384 00000100:00100000:1.0:1746144895.684474:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5686 00000100:00100000:1.0:1746144895.684482:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+54:31579:x1830965175264384:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.684496:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.684510:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f45 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.684531:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.684536:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f3e expref: 55 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.684542:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.684545:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f45 expref: 55 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.684576:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f3e expref: 55 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.684749:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f45 expref: 55 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.684757:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea50e00, rc 0) 00000100:00100000:1.0:1746144895.685235:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+55:31579:x1830965175264384:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 754us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.685241:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5686 00000100:00100000:3.0:1746144895.685306:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175264512 00000100:00100000:3.0:1746144895.685311:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175264512 00010000:00010000:3.0:1746144895.685329:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f37 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.685348:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11101 00000100:00100000:3.0:1746144895.685352:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a006300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175264512:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.685361:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.685382:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f37 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.685393:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f37 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.685410:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af67275154d3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f37 expref: 6 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.685435:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.685437:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.685442:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f3e expref: 54 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.685449:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f3e expref: 54 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.685474:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f3e expref: 54 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.685483:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f3e expref: 54 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.685494:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172493824:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.685858:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.690495:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172493824:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.690522:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.690572:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a006300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175264512:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5217us (7365us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.690588:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11101 00000100:00100000:0.0:1746144895.693953:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.694055:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175264768 00000100:00100000:1.0:1746144895.694065:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175264768 00002000:00100000:1.0:1746144895.694118:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a006a00 x1830965175264768/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.694128:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a006a00 with x1830965175264768 ext(0->4095) 00010000:00010000:1.0:1746144895.694137:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f3e expref: 55 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.694152:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f3e expref: 55 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144895.694159:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a006a00 00000100:00100000:1.0:1746144895.694195:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2163 00000100:00100000:1.0:1746144895.694202:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+55:1984:x1830965175264768:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144895.694391:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a006a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+55:1984:x1830965175264768:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 188us (448us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144895.694397:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2163 00002000:00100000:1.0:1746144895.694410:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a006a00 x1830965175264768/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144895.694416:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a006a00 with x1830965175264768 ext(0->4095) 00010000:00010000:1.0:1746144895.694421:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f3e expref: 55 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:1.0:1746144895.694436:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f3e expref: 55 pid: 8430 timeout: 589 lvb_type: 0 00002000:00010000:1.0:1746144895.694441:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a006a00 00000100:00100000:0.0:1746144895.698055:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.698150:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175264896 00000100:00100000:3.0:1746144895.698161:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175264896 00010000:00010000:3.0:1746144895.698198:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f3e expref: 55 pid: 8430 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.698243:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11102 00000100:00100000:3.0:1746144895.698250:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a006d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+55:1983:x1830965175264896:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.698262:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.698279:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f3e expref: 55 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.698289:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f3e expref: 55 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.698306:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af67275154da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f3e expref: 55 pid: 8430 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.699067:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.699070:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.699077:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f45 expref: 54 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.699084:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f45 expref: 54 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.699111:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f45 expref: 54 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.699121:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172493952:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.699193:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.707240:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172493952:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.707261:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.707323:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a006d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+54:1983:x1830965175264896:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 9072us (9279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.707332:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11102 00000100:00100000:0.0:1746144895.707518:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.708586:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175265152 00000100:00100000:3.0:1746144895.708594:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175265152 00002000:00100000:3.0:1746144895.708624:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a007100 x1830965175265152/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.708633:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a007100 with x1830965175265152 ext(0->4095) 00002000:00010000:3.0:1746144895.708636:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a007100 00000100:00100000:3.0:1746144895.708658:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4132 00000100:00100000:3.0:1746144895.708664:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+54:1985:x1830965175265152:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144895.708831:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a007100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+54:1985:x1830965175265152:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 166us (1318us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.708837:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4132 00002000:00100000:3.0:1746144895.708841:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a007100 x1830965175265152/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.708848:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a007100 with x1830965175265152 ext(0->4095) 00002000:00010000:3.0:1746144895.708850:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a007100 00000100:00100000:0.0:1746144895.714048:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.714742:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175265280 00000100:00100000:1.0:1746144895.714752:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175265280 00000100:00100000:1.0:1746144895.714852:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5687 00000100:00100000:1.0:1746144895.714860:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175265280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.714880:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.714899:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099a61a00/0x4076af67275154e8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f4c expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.714940:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f45 expref: 53 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.714947:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.714949:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.714952:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099a61a00/0x4076af67275154e8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f4c expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.714985:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f45 expref: 53 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.714997:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f45 expref: 53 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.715008:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172494080:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144895.715096:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.717646:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.717740:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175265408 00000100:00100000:2.0:1746144895.717752:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175265408 00002000:00100000:2.0:1746144895.717825:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008a007800 x1830965175265408/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.717834:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a007800 with x1830965175265408 ext(0->7) 00010000:00010000:2.0:1746144895.717843:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f45 expref: 54 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.717856:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f45 expref: 54 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.717863:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a007800 00000100:00100000:2.0:1746144895.717900:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2164 00000100:00100000:2.0:1746144895.717909:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+54:1982:x1830965175265408:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144895.718223:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a007800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1982:x1830965175265408:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 315us (584us total) trans 4294968034 rc 0/0 00000100:00100000:2.0:1746144895.718229:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2164 00002000:00100000:2.0:1746144895.718235:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008a007800 x1830965175265408/t4294968034(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/448 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.718242:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a007800 with x1830965175265408 ext(0->7) 00010000:00010000:2.0:1746144895.718246:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f45 expref: 56 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.718255:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f45 expref: 56 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.718261:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a007800 00000100:00100000:1.0:1746144895.718364:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172494080:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144895.718391:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099a61a00/0x4076af67275154e8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f4c expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.718407:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099a61a00, rc 0) 00000100:00100000:1.0:1746144895.718437:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a007480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175265280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3578us (4401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.718445:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5687 00000100:00100000:0.0:1746144895.720984:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.722098:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175265536 00000100:00100000:3.0:1746144895.722109:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175265536 00010000:00010000:3.0:1746144895.722144:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f45 expref: 56 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.722187:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11103 00000100:00100000:3.0:1746144895.722198:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a007b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1982:x1830965175265536:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.722211:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.722230:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f45 expref: 56 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.722240:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f45 expref: 56 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.722259:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af67275154e1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f45 expref: 56 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.722286:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.722287:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.722294:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a61a00/0x4076af67275154e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f4c expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.722301:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099a61a00/0x4076af67275154e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f4c expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.722329:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099a61a00/0x4076af67275154e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f4c expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.722344:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172494208:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.722424:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.726816:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.726991:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172494208:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.727011:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.727072:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a007b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+55:1982:x1830965175265536:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4873us (6095us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.727083:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11103 00000100:00100000:2.0:1746144895.727302:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175265792 00000100:00100000:2.0:1746144895.727312:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175265792 00002000:00100000:2.0:1746144895.727354:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a004000 x1830965175265792/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.727364:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a004000 with x1830965175265792 ext(0->4095) 00002000:00010000:2.0:1746144895.727368:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a004000 00000100:00100000:2.0:1746144895.727396:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4133 00000100:00100000:2.0:1746144895.727401:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175265792:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144895.728348:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a004000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175265792:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 944us (1539us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.728355:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4133 00002000:00100000:2.0:1746144895.728360:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a004000 x1830965175265792/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.728367:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a004000 with x1830965175265792 ext(0->4095) 00002000:00010000:2.0:1746144895.728370:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a004000 00000100:00100000:0.0:1746144895.730519:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.730565:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175265920 00000100:00100000:1.0:1746144895.730573:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175265920 00000100:00100000:1.0:1746144895.730616:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5688 00000100:00100000:1.0:1746144895.730621:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+55:31579:x1830965175265920:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.730637:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.730653:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f53 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.730675:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a61a00/0x4076af67275154e8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f4c expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.730681:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.730682:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.730685:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f53 expref: 56 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.730708:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099a61a00/0x4076af67275154e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f4c expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.730721:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099a61a00/0x4076af67275154e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f4c expref: 5 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.730732:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172494336:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144895.730844:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144895.733944:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172494336:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144895.733978:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f53 expref: 56 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.733995:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea50a00, rc 0) 00000100:00100000:1.0:1746144895.734047:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+56:31579:x1830965175265920:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3425us (3536us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.734056:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5688 00000100:00100000:0.0:1746144895.739329:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.740637:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175266048 00000100:00100000:3.0:1746144895.740649:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175266048 00010000:00010000:3.0:1746144895.740696:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099a61a00/0x4076af67275154e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f4c expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.740745:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11104 00000100:00100000:3.0:1746144895.740752:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175266048:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.740862:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.740885:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099a61a00/0x4076af67275154e8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f4c expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.740899:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099a61a00/0x4076af67275154e8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f4c expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.740932:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099a61a00/0x4076af67275154e8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f4c expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.740960:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.740963:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.740971:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f53 expref: 55 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.740979:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f53 expref: 55 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.741018:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f53 expref: 55 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.741031:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172494464:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.742211:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.746300:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.746363:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175266304 00000100:00100000:0.0:1746144895.746375:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175266304 00000100:00100000:3.0:1746144895.746417:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172494464:192.168.202.16@tcp:105: 00002000:00100000:0.0:1746144895.746430:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a097100 x1830965175266304/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1746144895.746435:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1746144895.746440:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a097100 with x1830965175266304 ext(0->4095) 00002000:00010000:0.0:1746144895.746446:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a097100 00000100:00100000:0.0:1746144895.746469:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4134 00000100:00100000:3.0:1746144895.746482:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175266048:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5730us (7163us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.746492:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11104 00000100:00100000:3.0:1746144895.746894:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1982:x1830965175266304:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:3.0:1746144895.748667:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1982:x1830965175266304:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 2184us (2369us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.748677:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4134 00002000:00100000:3.0:1746144895.748688:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a097100 x1830965175266304/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.748696:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a097100 with x1830965175266304 ext(0->4095) 00002000:00010000:3.0:1746144895.748701:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a097100 00000100:00100000:0.0:1746144895.753011:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.754097:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175266432 00000100:00100000:1.0:1746144895.754108:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175266432 00000100:00100000:1.0:1746144895.754166:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5689 00000100:00100000:1.0:1746144895.754174:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175266432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.754195:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.754215:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275154f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f5a expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.754247:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f53 expref: 55 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.754260:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.754262:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.754265:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275154f6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f5a expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.754298:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f53 expref: 55 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.754310:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f53 expref: 55 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.754322:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172494592:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144895.754418:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.756489:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.756500:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172494592:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144895.756525:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275154f6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f5a expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.756541:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966ce00, rc 0) 00000100:00100000:3.0:1746144895.756545:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175266560 00000100:00100000:3.0:1746144895.756551:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175266560 00002000:00100000:3.0:1746144895.756588:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880091686300 x1830965175266560/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1746144895.756590:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099698450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175266432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2415us (3587us total) trans 0 rc 0/0 00002000:00100000:3.0:1746144895.756597:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091686300 with x1830965175266560 ext(0->7) 00000100:00100000:1.0:1746144895.756599:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5689 00010000:00010000:3.0:1746144895.756603:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f53 expref: 56 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.756614:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f53 expref: 56 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.756620:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091686300 00000100:00100000:3.0:1746144895.756637:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2165 00000100:00100000:3.0:1746144895.756643:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+56:1985:x1830965175266560:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144895.757003:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1985:x1830965175266560:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 359us (521us total) trans 4294968035 rc 0/0 00000100:00100000:3.0:1746144895.757010:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2165 00002000:00100000:3.0:1746144895.757015:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880091686300 x1830965175266560/t4294968035(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/448 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.757023:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091686300 with x1830965175266560 ext(0->7) 00010000:00010000:3.0:1746144895.757028:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f53 expref: 58 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.757037:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f53 expref: 58 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.757047:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091686300 00000100:00100000:0.0:1746144895.760639:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.760755:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175266688 00000100:00100000:3.0:1746144895.760801:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175266688 00010000:00010000:3.0:1746144895.760841:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f53 expref: 58 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.760878:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11105 00000100:00100000:3.0:1746144895.760886:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175266688:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.760900:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.760935:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f53 expref: 58 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.760948:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f53 expref: 58 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.760973:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50a00/0x4076af67275154ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f53 expref: 58 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.761005:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.761008:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.761016:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275154f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f5a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.761024:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275154f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f5a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.761064:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275154f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f5a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.761075:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172494720:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.761162:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.764347:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.764413:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175266944 00000100:00100000:2.0:1746144895.764421:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175266944 00002000:00100000:2.0:1746144895.764468:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091687100 x1830965175266944/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.764478:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091687100 with x1830965175266944 ext(0->4095) 00002000:00010000:2.0:1746144895.764483:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091687100 00000100:00100000:2.0:1746144895.764499:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4135 00000100:00100000:2.0:1746144895.764504:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175266944:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746144895.765101:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175266944:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 595us (763us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.765107:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4135 00002000:00100000:2.0:1746144895.765112:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091687100 x1830965175266944/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.765119:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091687100 with x1830965175266944 ext(0->4095) 00002000:00010000:2.0:1746144895.765121:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091687100 00000100:00100000:3.0:1746144895.765198:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172494720:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.765215:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.765903:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+57:1984:x1830965175266688:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5016us (5276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.765911:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11105 00000100:00100000:0.0:1746144895.772339:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.773510:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175267072 00000100:00100000:1.0:1746144895.773522:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175267072 00000100:00100000:1.0:1746144895.773590:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5690 00000100:00100000:1.0:1746144895.773598:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+57:31579:x1830965175267072:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.773619:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.773637:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f61 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.773668:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275154f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f5a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.773676:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.773678:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.773681:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f61 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.773716:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275154f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f5a expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.773728:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275154f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f5a expref: 5 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.773739:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172494848:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144895.773859:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.783906:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.783981:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.784099:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172494848:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144895.784130:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f61 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.784148:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d200, rc 0) 00000100:00100000:3.0:1746144895.784177:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175267328 00000100:00100000:3.0:1746144895.784186:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175267328 00000100:00100000:1.0:1746144895.784192:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+58:31579:x1830965175267072:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 10595us (11864us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.784205:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5690 00010000:00010000:3.0:1746144895.784218:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275154f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f5a expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.784226:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175267200 00000100:00100000:1.0:1746144895.784228:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175267200 00000100:00100000:3.0:1746144895.784253:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11106 00000100:00100000:3.0:1746144895.784260:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175267328:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.784273:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.784296:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275154f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f5a expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.784307:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275154f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f5a expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.784332:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275154f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f5a expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.784356:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.784358:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.784365:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f61 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.784373:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f61 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.784406:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f61 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.784417:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172494976:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.784467:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144895.785233:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5691 00000100:00100000:1.0:1746144895.785239:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+58:31565:x1830965175267200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.785252:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.785270:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f68 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.785330:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f61 expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.785337:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.785338:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.785341:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f68 expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.785357:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f61 expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.785367:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f61 expref: 59 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:1.0:1746144895.785375:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172495104:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144895.785404:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.794635:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172494976:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.794659:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.795974:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175267328:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 11706us (11984us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.795986:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11106 00000100:00100000:2.0:1746144895.796139:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.796218:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172495104:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144895.796243:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f68 expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.796260:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966c000, rc 0) 00000100:00100000:1.0:1746144895.796284:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+59:31565:x1830965175267200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 11046us (12390us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.796291:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5691 00000100:00100000:3.0:1746144895.796306:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175267584 00000100:00100000:3.0:1746144895.796313:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175267584 00002000:00100000:3.0:1746144895.796347:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094700 x1830965175267584/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.796356:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094700 with x1830965175267584 ext(0->4095) 00010000:00010000:3.0:1746144895.796363:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f61 expref: 59 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.796380:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f61 expref: 59 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.796387:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a094700 00000100:00100000:3.0:1746144895.796403:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2166 00000100:00100000:3.0:1746144895.796409:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1984:x1830965175267584:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144895.796563:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1984:x1830965175267584:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 154us (424us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.796569:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2166 00002000:00100000:3.0:1746144895.796574:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094700 x1830965175267584/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.796581:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094700 with x1830965175267584 ext(0->4095) 00010000:00010000:3.0:1746144895.796586:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f61 expref: 59 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.796595:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f61 expref: 59 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:3.0:1746144895.796600:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a094700 00000100:00100000:0.0:1746144895.798950:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.799082:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175267712 00000100:00100000:1.0:1746144895.799089:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175267712 00000100:00100000:1.0:1746144895.799175:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5692 00000100:00100000:1.0:1746144895.799183:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175267712:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.799264:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.799289:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f6f expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.799322:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.799327:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f68 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.799332:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144895.799348:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f6f expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.799384:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f68 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.799394:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f6f expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.799409:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966dc00, rc 0) 00000100:00100000:1.0:1746144895.799454:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175267712:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 272us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.799459:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5692 00000100:00100000:2.0:1746144895.800696:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.800983:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175267840 00000100:00100000:3.0:1746144895.800990:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175267840 00010000:00010000:3.0:1746144895.801021:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f61 expref: 59 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.801058:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11107 00000100:00100000:3.0:1746144895.801066:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1983:x1830965175267840:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.801077:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.801099:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f61 expref: 59 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.801111:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f61 expref: 59 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.801133:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275154fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f61 expref: 59 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.801162:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.801164:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.801171:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f68 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.801179:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f68 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.801206:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f68 expref: 58 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.801216:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f68 expref: 58 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.801227:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172495360:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.801310:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.803410:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.803462:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175268096 00000100:00100000:2.0:1746144895.803468:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175268096 00002000:00100000:2.0:1746144895.803517:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091686a00 x1830965175268096/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.803526:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091686a00 with x1830965175268096 ext(0->4095) 00010000:00010000:2.0:1746144895.803534:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f68 expref: 59 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.803551:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f68 expref: 59 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.803557:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091686a00 00000100:00100000:3.0:1746144895.803877:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172495360:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.803898:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144895.804665:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2167 00000100:00100000:2.0:1746144895.804678:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1984:x1830965175268096:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144895.804700:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1983:x1830965175267840:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3632us (4006us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.804710:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11107 00000100:00100000:2.0:1746144895.804863:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175268096:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 190us (1461us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.804869:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2167 00002000:00100000:2.0:1746144895.804876:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091686a00 x1830965175268096/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.804884:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091686a00 with x1830965175268096 ext(0->4095) 00010000:00010000:2.0:1746144895.804891:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f68 expref: 58 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.804901:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f68 expref: 58 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.804906:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091686a00 00000100:00100000:0.0:1746144895.810480:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.810539:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.810690:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175268224 00000100:00100000:1.0:1746144895.810700:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175268224 00000100:00100000:1.0:1746144895.810789:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5693 00000100:00100000:1.0:1746144895.810799:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+58:31565:x1830965175268224:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.810818:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.810837:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515512 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f76 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.810864:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.810871:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f6f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.810876:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144895.810879:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515512 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f76 expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.810914:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f6f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.810938:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515512 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f76 expref: 59 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.810953:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966da00, rc 0) 00000100:00100000:1.0:1746144895.811001:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+59:31565:x1830965175268224:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 200us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.811007:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5693 00000100:00100000:3.0:1746144895.811426:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175268352 00000100:00100000:3.0:1746144895.811430:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175268352 00010000:00010000:3.0:1746144895.811448:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f68 expref: 59 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.811538:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11108 00000100:00100000:3.0:1746144895.811545:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1984:x1830965175268352:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.811554:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.811576:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f68 expref: 59 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.811586:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f68 expref: 59 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.811603:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515504 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f68 expref: 59 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.811616:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.811618:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.811623:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f6f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.811630:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f6f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.811650:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f6f expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.811660:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f6f expref: 5 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.811671:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172495616:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.811934:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.814505:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172495616:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.814527:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.814581:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175268352:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3035us (4040us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144895.814723:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.814751:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175268608 00000100:00100000:2.0:1746144895.814758:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175268608 00002000:00100000:2.0:1746144895.814839:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091684000 x1830965175268608/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.814849:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091684000 with x1830965175268608 ext(0->4095) 00010000:00010000:2.0:1746144895.814856:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f6f expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.814873:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f6f expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.814880:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091684000 00000100:00100000:2.0:1746144895.814898:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2168 00000100:00100000:2.0:1746144895.814904:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175268608:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144895.815075:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175268608:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 171us (352us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.815082:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11108 00000100:00100000:2.0:1746144895.815082:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2168 00002000:00100000:2.0:1746144895.815088:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880091684000 x1830965175268608/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.815095:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091684000 with x1830965175268608 ext(0->4095) 00010000:00010000:2.0:1746144895.815099:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f6f expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.815109:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f6f expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.815120:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091684000 00000100:00100000:0.0:1746144895.821504:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.822679:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175268736 00000100:00100000:3.0:1746144895.822690:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175268736 00010000:00010000:3.0:1746144895.822731:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f6f expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.822760:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11109 00000100:00100000:3.0:1746144895.822786:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175268736:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.822800:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.822821:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f6f expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.822838:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f6f expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.822863:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751550b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f6f expref: 6 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.823862:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.823865:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.823875:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f76 expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.823884:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515512 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f76 expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.823934:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515512 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f76 expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.823948:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172495744:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.824849:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.830369:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.830572:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175268992 00000100:00100000:2.0:1746144895.830582:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175268992 00002000:00100000:2.0:1746144895.830635:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093257100 x1830965175268992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.830645:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257100 with x1830965175268992 ext(0->4095) 00002000:00010000:2.0:1746144895.830652:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093257100 00000100:00100000:2.0:1746144895.830671:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4136 00000100:00100000:2.0:1746144895.830678:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1985:x1830965175268992:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144895.830907:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1985:x1830965175268992:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 228us (550us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.830914:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4136 00002000:00100000:2.0:1746144895.830927:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093257100 x1830965175268992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.830935:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257100 with x1830965175268992 ext(0->4095) 00002000:00010000:2.0:1746144895.830938:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093257100 00000100:00100000:3.0:1746144895.831888:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172495744:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.831907:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.831960:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175268736:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 9175us (10468us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.831969:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11109 00000100:00100000:0.0:1746144895.833966:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.834091:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175269120 00000100:00100000:2.0:1746144895.834102:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175269120 00000100:00100000:2.0:1746144895.834172:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5694 00000100:00100000:2.0:1746144895.834181:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175269120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.834196:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.834212:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f7d expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.834244:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515512 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f76 expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.834251:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.834252:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.834256:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f7d expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.834284:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515512 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f76 expref: 57 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.834293:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515512 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f76 expref: 57 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.834304:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172495872:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.834395:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.839881:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.840223:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175269248 00000100:00100000:3.0:1746144895.840232:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175269248 00010000:00010000:3.0:1746144895.840276:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515512 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f76 expref: 58 pid: 10401 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.840310:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11110 00000100:00100000:3.0:1746144895.840318:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175269248:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.840329:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.840346:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515512 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f76 expref: 58 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.840356:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515512 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f76 expref: 58 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.840375:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515512 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f76 expref: 58 pid: 10401 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.840391:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.840393:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.840399:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f7d expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.840405:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f7d expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.840429:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f7d expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.840438:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172496000:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.840496:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42600 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.840584:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172495872:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.840608:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f7d expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.840615:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e4e00, rc 0) 00000100:00100000:0.0:1746144895.840632:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.840636:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175269120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6457us (6678us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.840642:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5694 00000100:00100000:2.0:1746144895.840846:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175269376 00000100:00100000:2.0:1746144895.840849:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175269376 00000100:00100000:2.0:1746144895.840865:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5695 00000100:00100000:2.0:1746144895.840870:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+58:31565:x1830965175269376:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.840879:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.840887:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f84 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.840900:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f7d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.842543:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.842547:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144895.842555:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f84 expref: 59 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.842583:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f7d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.842593:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f7d expref: 5 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:2.0:1746144895.842605:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172496128:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144895.842627:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172496000:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.842639:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.842781:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+59:1984:x1830965175269248:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2463us (2905us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.842789:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11110 00000100:00100000:2.0:1746144895.843171:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.843529:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.843610:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175269632 00000100:00100000:2.0:1746144895.843616:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175269632 00002000:00100000:2.0:1746144895.843648:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358eed80 x1830965175269632/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.843656:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358eed80 with x1830965175269632 ext(0->4095) 00010000:00010000:2.0:1746144895.843662:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f7d expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.843672:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f7d expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.843677:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801358eed80 00000100:00100000:2.0:1746144895.843703:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2169 00000100:00100000:2.0:1746144895.843711:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175269632:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144895.843861:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175269632:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 152us (332us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.843867:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2169 00002000:00100000:2.0:1746144895.843878:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358eed80 x1830965175269632/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.843885:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358eed80 with x1830965175269632 ext(0->4095) 00010000:00010000:2.0:1746144895.843890:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f7d expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:2.0:1746144895.843898:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f7d expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00002000:00010000:2.0:1746144895.843903:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801358eed80 00000100:00100000:2.0:1746144895.844795:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172496128:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.844814:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f84 expref: 58 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.844830:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e4600, rc 0) 00000100:00100000:2.0:1746144895.844852:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+58:31565:x1830965175269376:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3982us (4219us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.844858:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5695 00000100:00100000:0.0:1746144895.849332:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.849396:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175269760 00000100:00100000:3.0:1746144895.849405:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175269760 00010000:00010000:3.0:1746144895.849433:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f7d expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00000100:00100000:3.0:1746144895.849470:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11111 00000100:00100000:3.0:1746144895.849477:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175269760:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.849488:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.849504:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f7d expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.849514:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f7d expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.849533:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515519 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f7d expref: 6 pid: 20722 timeout: 589 lvb_type: 0 00010000:00010000:3.0:1746144895.849556:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.849558:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.849567:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f84 expref: 57 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.849577:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f84 expref: 57 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.849603:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f84 expref: 57 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.849613:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172496256:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.851241:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42600 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.860821:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172496256:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144895.860821:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:3.0:1746144895.860837:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.860881:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175269760:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 11403us (11555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.860890:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11111 00000100:00100000:2.0:1746144895.860894:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175270016 00000100:00100000:2.0:1746144895.860900:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175270016 00002000:00100000:2.0:1746144895.860940:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee68700 x1830965175270016/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.860948:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee68700 with x1830965175270016 ext(0->4095) 00002000:00010000:2.0:1746144895.860952:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee68700 00000100:00100000:2.0:1746144895.860964:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4137 00000100:00100000:2.0:1746144895.860969:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1982:x1830965175270016:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746144895.861335:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1982:x1830965175270016:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 365us (519us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.861341:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4137 00002000:00100000:2.0:1746144895.861346:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008ee68700 x1830965175270016/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.861352:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008ee68700 with x1830965175270016 ext(0->4095) 00002000:00010000:2.0:1746144895.861354:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008ee68700 00000100:00100000:0.0:1746144895.868226:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.868974:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175270144 00000100:00100000:2.0:1746144895.868983:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175270144 00000100:00100000:2.0:1746144895.869368:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5696 00000100:00100000:2.0:1746144895.869377:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175270144:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144895.869394:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144895.869410:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f8b expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.869434:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f84 expref: 57 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.869441:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.869442:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144895.869445:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f8b expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.869468:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f84 expref: 57 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.869478:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f84 expref: 57 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144895.869488:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172496384:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144895.869575:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144895.879628:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a097b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172496384:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144895.879661:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f8b expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144895.879677:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099a60e00, rc 0) 00000100:00100000:2.0:1746144895.879714:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175270144:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 10338us (11494us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144895.879724:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5696 00000100:00100000:0.0:1746144895.882663:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.883080:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175270272 00000100:00100000:2.0:1746144895.883087:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175270272 00002000:00100000:2.0:1746144895.883125:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009b463100 x1830965175270272/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.883135:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463100 with x1830965175270272 ext(0->7) 00010000:00010000:2.0:1746144895.883143:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f84 expref: 58 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144895.883155:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f84 expref: 58 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144895.883162:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b463100 00000100:00100000:2.0:1746144895.883194:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2170 00000100:00100000:2.0:1746144895.883201:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+58:1984:x1830965175270272:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144895.884062:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1984:x1830965175270272:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 859us (1404us total) trans 4294968036 rc 0/0 00000100:00100000:2.0:1746144895.884069:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2170 00002000:00100000:2.0:1746144895.884075:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009b463100 x1830965175270272/t4294968036(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/448 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.884083:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463100 with x1830965175270272 ext(0->7) 00010000:00010000:2.0:1746144895.884088:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f84 expref: 60 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144895.884103:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f84 expref: 60 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144895.884108:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b463100 00000100:00100000:2.0:1746144895.893077:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.893147:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.893242:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175270400 00000100:00100000:0.0:1746144895.893250:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175270400 00000100:00100000:0.0:1746144895.893305:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5697 00000100:00100000:0.0:1746144895.893313:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+60:31565:x1830965175270400:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144895.893330:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144895.893346:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f92 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144895.893369:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144895.893374:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f8b expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144895.893384:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746144895.893386:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f92 expref: 61 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144895.893415:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f8b expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144895.893426:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f92 expref: 61 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144895.893436:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b3c00, rc 0) 00000100:00100000:0.0:1746144895.893472:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+61:31565:x1830965175270400:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 160us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144895.893478:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5697 00000100:00100000:3.0:1746144895.894606:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175270528 00000100:00100000:3.0:1746144895.894612:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175270528 00010000:00010000:3.0:1746144895.894633:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f84 expref: 61 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144895.894695:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11112 00000100:00100000:3.0:1746144895.894702:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1984:x1830965175270528:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.894710:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.894728:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f84 expref: 61 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144895.894741:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f84 expref: 61 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144895.894757:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4600/0x4076af6727515520 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f84 expref: 61 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144895.894807:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.894809:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.894814:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f8b expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.894822:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f8b expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.894843:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f8b expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.894853:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f8b expref: 5 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144895.894865:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172496640:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.894956:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42600 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.899243:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172496640:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.899461:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.900280:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1984:x1830965175270528:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5575us (7129us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.900294:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11112 00000100:00100000:0.0:1746144895.904302:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.904561:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175270784 00000100:00100000:2.0:1746144895.904569:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175270784 00002000:00100000:2.0:1746144895.904608:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b4f9880 x1830965175270784/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.904616:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4f9880 with x1830965175270784 ext(0->4095) 00010000:00010000:2.0:1746144895.904624:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f8b expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144895.904636:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f8b expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144895.904642:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b4f9880 00000100:00100000:2.0:1746144895.904667:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2171 00000100:00100000:2.0:1746144895.904673:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175270784:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144895.904838:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175270784:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 165us (545us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.904844:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2171 00002000:00100000:2.0:1746144895.904849:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b4f9880 x1830965175270784/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.904856:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4f9880 with x1830965175270784 ext(0->4095) 00010000:00010000:2.0:1746144895.904860:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f8b expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144895.904868:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f8b expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144895.904874:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b4f9880 00000100:00100000:0.0:1746144895.909947:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.910167:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175270912 00000100:00100000:3.0:1746144895.910177:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175270912 00010000:00010000:3.0:1746144895.910212:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f8b expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144895.910239:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11113 00000100:00100000:3.0:1746144895.910245:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175270912:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.910257:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.910275:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f8b expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144895.910287:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f8b expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144895.910308:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099a60e00/0x4076af6727515527 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f8b expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144895.910325:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.910326:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.910333:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f92 expref: 59 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.910340:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f92 expref: 59 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.910369:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f92 expref: 59 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.910380:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172496768:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.910454:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.912194:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172496768:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.912212:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.912240:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175270912:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1995us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.912250:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11113 00000100:00100000:0.0:1746144895.913185:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.913271:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175271168 00000100:00100000:2.0:1746144895.913284:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175271168 00002000:00100000:2.0:1746144895.913328:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b033480 x1830965175271168/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.913337:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033480 with x1830965175271168 ext(0->4095) 00002000:00010000:2.0:1746144895.913341:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b033480 00000100:00100000:2.0:1746144895.913374:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4138 00000100:00100000:2.0:1746144895.913382:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1985:x1830965175271168:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144895.913859:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1985:x1830965175271168:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 477us (675us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.913866:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4138 00002000:00100000:2.0:1746144895.913871:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b033480 x1830965175271168/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.913878:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033480 with x1830965175271168 ext(0->4095) 00002000:00010000:2.0:1746144895.913880:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b033480 00000100:00100000:0.0:1746144895.920688:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.920810:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175271296 00000100:00100000:1.0:1746144895.920821:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175271296 00000100:00100000:1.0:1746144895.920863:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5698 00000100:00100000:1.0:1746144895.920871:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175271296:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.920890:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.920908:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af6727515535 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94f99 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.920949:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f92 expref: 59 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.920956:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.920958:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.920961:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af6727515535 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f99 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.920989:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f92 expref: 59 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.920999:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f92 expref: 59 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:1.0:1746144895.921014:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172496896:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144895.921105:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.942042:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.942381:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175271424 00000100:00100000:2.0:1746144895.942390:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175271424 00002000:00100000:2.0:1746144895.942440:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88013619b100 x1830965175271424/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.942451:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013619b100 with x1830965175271424 ext(0->7) 00010000:00010000:2.0:1746144895.942461:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f92 expref: 60 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144895.942475:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f92 expref: 60 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144895.942483:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013619b100 00000100:00100000:1.0:1746144895.942598:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172496896:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144895.942622:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af6727515535 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f99 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.942636:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966dc00, rc 0) 00000100:00100000:2.0:1746144895.944383:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2172 00000100:00100000:2.0:1746144895.945882:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013619b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+60:1984:x1830965175271424:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144895.946485:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175271296:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 25610us (25804us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.946494:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5698 00000100:00100000:2.0:1746144895.947260:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013619b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1984:x1830965175271424:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 1397us (5226us total) trans 4294968037 rc 0/0 00000100:00100000:2.0:1746144895.947269:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2172 00002000:00100000:2.0:1746144895.947279:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88013619b100 x1830965175271424/t4294968037(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 496/448 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.947288:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013619b100 with x1830965175271424 ext(0->7) 00010000:00010000:2.0:1746144895.947343:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f92 expref: 62 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144895.947358:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f92 expref: 62 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144895.947370:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013619b100 00000100:00100000:0.0:1746144895.948941:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.950731:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175271552 00000100:00100000:3.0:1746144895.950743:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175271552 00010000:00010000:3.0:1746144895.950796:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f92 expref: 62 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144895.950829:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11114 00000100:00100000:3.0:1746144895.950836:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a004a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1982:x1830965175271552:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.950848:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.950867:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f92 expref: 62 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144895.950878:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f92 expref: 62 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144895.950901:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af672751552e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f92 expref: 62 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144895.950935:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.950938:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.950945:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af6727515535 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f99 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.950952:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af6727515535 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f99 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.950981:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af6727515535 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f99 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144895.950992:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172497024:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.951076:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.957281:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172497024:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.957303:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144895.957312:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.957355:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a004a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+61:1982:x1830965175271552:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6519us (8422us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.957367:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11114 00000100:00100000:2.0:1746144895.957489:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175271808 00000100:00100000:2.0:1746144895.957497:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175271808 00002000:00100000:2.0:1746144895.957542:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a005880 x1830965175271808/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.957552:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a005880 with x1830965175271808 ext(0->4095) 00002000:00010000:2.0:1746144895.957557:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a005880 00000100:00100000:2.0:1746144895.957573:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4139 00000100:00100000:2.0:1746144895.957579:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175271808:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746144895.957758:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a005880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175271808:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 179us (446us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.957781:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4139 00002000:00100000:2.0:1746144895.957787:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a005880 x1830965175271808/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.957794:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a005880 with x1830965175271808 ext(0->4095) 00002000:00010000:2.0:1746144895.957797:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a005880 00000100:00100000:0.0:1746144895.959320:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.959393:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175271936 00000100:00100000:1.0:1746144895.959398:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175271936 00000100:00100000:1.0:1746144895.959420:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5699 00000100:00100000:1.0:1746144895.959425:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+61:31579:x1830965175271936:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.959436:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.959451:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94fa0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.959476:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af6727515535 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f99 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.959483:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.959485:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.959488:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa0 expref: 62 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.959517:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af6727515535 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f99 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.959528:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af6727515535 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f99 expref: 5 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:1.0:1746144895.959538:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172497152:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144895.962117:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144895.962283:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144895.962514:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175272064 00000100:00100000:1.0:1746144895.962521:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175272064 00000100:00100000:1.0:1746144895.963011:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5700 00000100:00100000:1.0:1746144895.963019:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+63:31565:x1830965175272064:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144895.963033:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.963048:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94fa7 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.963071:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144895.963076:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa0 expref: 64 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.963081:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.963084:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 64 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.963112:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa0 expref: 64 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.963125:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 64 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.963133:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966da00, rc 0) 00000100:00100000:1.0:1746144895.963692:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a006d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+64:31565:x1830965175272064:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 672us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.963698:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5700 00000100:00100000:1.0:1746144895.964076:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093856680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172497152:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144895.964091:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa0 expref: 63 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.964100:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966c000, rc 0) 00000100:00100000:1.0:1746144895.964119:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a006300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+63:31579:x1830965175271936:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4694us (4803us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.964125:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5699 00000100:00100000:0.0:1746144895.966851:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.968971:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175272192 00000100:00100000:3.0:1746144895.968982:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175272192 00010000:00010000:3.0:1746144895.969023:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af6727515535 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f99 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144895.969061:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11115 00000100:00100000:3.0:1746144895.969068:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a007b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175272192:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.969081:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.969100:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af6727515535 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f99 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144895.969116:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af6727515535 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f99 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144895.969138:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af6727515535 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94f99 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144895.969168:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.969170:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.969177:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa0 expref: 62 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.969188:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa0 expref: 62 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.969221:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa0 expref: 62 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.969232:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa0 expref: 62 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144895.969243:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172497408:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144895.969334:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.989045:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172497408:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.989070:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.989125:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a007b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175272192:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 20055us (22280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.989140:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11115 00000100:00100000:2.0:1746144895.989290:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.989397:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175272448 00000100:00100000:3.0:1746144895.989407:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175272448 00002000:00100000:3.0:1746144895.989445:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a097480 x1830965175272448/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.989455:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a097480 with x1830965175272448 ext(0->4095) 00010000:00010000:3.0:1746144895.989463:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa0 expref: 63 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144895.989476:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa0 expref: 63 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144895.989482:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a097480 00000100:00100000:3.0:1746144895.989497:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2173 00000100:00100000:3.0:1746144895.989503:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1984:x1830965175272448:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144895.989686:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1984:x1830965175272448:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 182us (396us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144895.989692:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2173 00002000:00100000:3.0:1746144895.989697:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a097480 x1830965175272448/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144895.989704:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a097480 with x1830965175272448 ext(0->4095) 00010000:00010000:3.0:1746144895.989709:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa0 expref: 63 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144895.989722:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa0 expref: 63 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144895.989728:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a097480 00000100:00100000:0.0:1746144895.991295:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144895.991343:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144895.991399:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175272576 00000100:00100000:3.0:1746144895.991404:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175272576 00010000:00010000:3.0:1746144895.991431:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa0 expref: 63 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:1.0:1746144895.991451:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175272704 00000100:00100000:1.0:1746144895.991463:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175272704 00000100:00100000:3.0:1746144895.991467:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11116 00000100:00100000:3.0:1746144895.991474:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1985:x1830965175272576:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144895.991487:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144895.991506:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa0 expref: 63 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144895.991516:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa0 expref: 63 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:1.0:1746144895.991523:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5701 00000100:00100000:1.0:1746144895.991531:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175272704:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144895.991539:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af672751553c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa0 expref: 63 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144895.991547:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144895.991563:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94fae expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.991566:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.991568:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144895.991575:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.991586:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.991610:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.991618:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.991620:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144895.991622:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fae expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144895.991806:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.991807:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 62 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.991817:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 62 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:1.0:1746144895.991827:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172497664:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144895.992023:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 62 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144895.992034:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172497536:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144895.992490:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.992515:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144895.997376:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172497536:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144895.997403:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144895.997456:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a005180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175272576:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5976us (6106us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144895.997467:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11116 00000100:00100000:1.0:1746144895.997617:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172497664:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144895.997642:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fae expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144895.997656:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ea50e00, rc 0) 00000100:00100000:1.0:1746144895.997714:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a004380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175272704:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6183us (6423us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144895.997721:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5701 00000100:00100000:0.0:1746144895.998829:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144895.998924:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175272960 00000100:00100000:2.0:1746144895.998937:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175272960 00002000:00100000:2.0:1746144895.998991:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a005c00 x1830965175272960/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/0 e 0 to 0 dl 1746144906 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.999005:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a005c00 with x1830965175272960 ext(0->4095) 00010000:00010000:2.0:1746144895.999014:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 62 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144895.999032:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 62 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144895.999038:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a005c00 00000100:00100000:2.0:1746144895.999069:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2174 00000100:00100000:2.0:1746144895.999076:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175272960:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144895.999257:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a005c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175272960:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 181us (431us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144895.999263:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2174 00002000:00100000:2.0:1746144895.999268:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a005c00 x1830965175272960/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:536/0 lens 488/4536 e 0 to 0 dl 1746144906 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144895.999275:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a005c00 with x1830965175272960 ext(0->4095) 00010000:00010000:2.0:1746144895.999280:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 62 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144895.999289:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 62 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144895.999295:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a005c00 00000100:00100000:0.0:1746144896.000587:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.000689:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175273216 00000100:00100000:1.0:1746144896.000699:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175273216 00000100:00100000:1.0:1746144896.000751:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5702 00000100:00100000:1.0:1746144896.000759:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+62:31565:x1830965175273216:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144896.000804:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144896.000820:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af6727515551 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94fb5 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.000840:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144896.000846:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fae expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.000851:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144896.000854:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af6727515551 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fb5 expref: 63 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.000881:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fae expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.000891:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af6727515551 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fb5 expref: 63 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.000899:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966ce00, rc 0) 00000100:00100000:1.0:1746144896.000958:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a006680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+63:31565:x1830965175273216:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 200us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144896.000965:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5702 00000100:00100000:0.0:1746144896.001325:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.001387:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175273088 00000100:00100000:3.0:1746144896.001392:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175273088 00010000:00010000:3.0:1746144896.001413:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 63 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.001430:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11117 00000100:00100000:3.0:1746144896.001435:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a007480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1982:x1830965175273088:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.001445:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.001462:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 63 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.001472:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 63 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.001490:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515543 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fa7 expref: 63 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.001512:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.001514:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.001520:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fae expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.001527:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fae expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.001552:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fae expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.001562:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fae expref: 5 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.001573:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172497920:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.001633:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.003370:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.003442:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175273472 00000100:00100000:2.0:1746144896.003447:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175273472 00002000:00100000:2.0:1746144896.003486:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e81880 x1830965175273472/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.003496:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e81880 with x1830965175273472 ext(0->4095) 00010000:00010000:2.0:1746144896.003505:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fae expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.003517:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fae expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.003523:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e81880 00000100:00100000:2.0:1746144896.003538:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2175 00000100:00100000:2.0:1746144896.003545:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175273472:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144896.003719:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175273472:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 174us (352us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.003725:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2175 00002000:00100000:2.0:1746144896.003730:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e81880 x1830965175273472/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.003738:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e81880 with x1830965175273472 ext(0->4095) 00010000:00010000:2.0:1746144896.003742:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fae expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.003751:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fae expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.003757:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e81880 00000100:00100000:3.0:1746144896.003850:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172497920:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.003868:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.003931:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a007480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1982:x1830965175273088:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2482us (2593us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.003940:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11117 00000100:00100000:0.0:1746144896.007889:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.008001:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175273600 00000100:00100000:3.0:1746144896.008008:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175273600 00010000:00010000:3.0:1746144896.008042:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fae expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.008066:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11118 00000100:00100000:3.0:1746144896.008072:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175273600:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.008084:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.008104:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fae expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.008115:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fae expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.008137:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ea50e00/0x4076af672751554a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fae expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.009664:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.009667:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.009677:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af6727515551 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fb5 expref: 61 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.009685:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af6727515551 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fb5 expref: 61 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.009727:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af6727515551 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fb5 expref: 61 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.009739:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172498048:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.011058:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.015398:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.015522:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172498048:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.015545:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.015591:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175273600:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7518us (7711us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.015604:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11118 00000100:00100000:1.0:1746144896.015727:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175273856 00000100:00100000:1.0:1746144896.015734:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175273856 00002000:00100000:1.0:1746144896.015799:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612fb80 x1830965175273856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.015808:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612fb80 with x1830965175273856 ext(0->4095) 00002000:00010000:1.0:1746144896.015814:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612fb80 00000100:00100000:2.0:1746144896.017343:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4140 00000100:00100000:2.0:1746144896.017363:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1984:x1830965175273856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144896.017572:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1984:x1830965175273856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 218us (2185us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.017579:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4140 00002000:00100000:2.0:1746144896.017585:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612fb80 x1830965175273856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.017593:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612fb80 with x1830965175273856 ext(0->4095) 00002000:00010000:2.0:1746144896.017598:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612fb80 00000100:00100000:0.0:1746144896.020224:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.020312:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175273984 00000100:00100000:1.0:1746144896.020320:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175273984 00000100:00100000:1.0:1746144896.020416:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5703 00000100:00100000:1.0:1746144896.020424:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175273984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144896.020441:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144896.020459:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94fbc expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.020489:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af6727515551 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fb5 expref: 61 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.020497:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144896.020499:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144896.020502:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fbc expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.020532:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af6727515551 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fb5 expref: 61 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.020544:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af6727515551 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fb5 expref: 61 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:1.0:1746144896.020556:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093f44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172498176:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144896.022103:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144896.023257:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093f44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172498176:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144896.023287:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fbc expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.023305:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d200, rc 0) 00000100:00100000:1.0:1746144896.023346:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175273984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2922us (3130us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144896.023353:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5703 00000100:00100000:0.0:1746144896.025161:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.025251:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175274112 00000100:00100000:1.0:1746144896.025261:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175274112 00000100:00100000:2.0:1746144896.026653:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5704 00000100:00100000:2.0:1746144896.026673:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+62:31565:x1830965175274112:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.026692:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.026711:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94fc3 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.026739:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.026744:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fbc expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.026750:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144896.026753:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fc3 expref: 63 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.026808:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fbc expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.026819:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fc3 expref: 63 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.026828:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e4800, rc 0) 00000100:00100000:2.0:1746144896.026885:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+63:31565:x1830965175274112:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 223us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.026890:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5704 00000100:00100000:0.0:1746144896.028435:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.029283:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175274240 00000100:00100000:3.0:1746144896.029292:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175274240 00010000:00010000:3.0:1746144896.029327:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af6727515551 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fb5 expref: 63 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.029350:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11119 00000100:00100000:3.0:1746144896.029358:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1985:x1830965175274240:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.029372:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.029395:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af6727515551 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fb5 expref: 63 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.029406:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af6727515551 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fb5 expref: 63 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.029426:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af6727515551 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fb5 expref: 63 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.030352:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.030355:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.030364:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fbc expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.030372:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fbc expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.030407:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fbc expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.030418:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fbc expref: 5 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.030430:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172498432:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.030521:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42480 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.033108:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172498432:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.033130:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.033171:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175274240:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3813us (4739us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.033183:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11119 00000100:00100000:0.0:1746144896.033881:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.033951:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175274496 00000100:00100000:1.0:1746144896.033958:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175274496 00002000:00100000:1.0:1746144896.033998:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a1f80 x1830965175274496/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.034007:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a1f80 with x1830965175274496 ext(0->4095) 00010000:00010000:1.0:1746144896.034015:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fbc expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.034026:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fbc expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.034032:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a1f80 00000100:00100000:1.0:1746144896.034048:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2176 00000100:00100000:1.0:1746144896.034053:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175274496:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144896.034223:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175274496:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 169us (343us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.034230:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2176 00002000:00100000:1.0:1746144896.034235:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a1f80 x1830965175274496/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.034243:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a1f80 with x1830965175274496 ext(0->4095) 00010000:00010000:1.0:1746144896.034247:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fbc expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.034256:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fbc expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.034262:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a1f80 00000100:00100000:2.0:1746144896.037410:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.037515:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175274624 00000100:00100000:3.0:1746144896.037523:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175274624 00010000:00010000:3.0:1746144896.037556:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fbc expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.037602:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11120 00000100:00100000:3.0:1746144896.037610:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175274624:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.037623:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.037644:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fbc expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.037655:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fbc expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.037677:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515558 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fbc expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.037704:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.037707:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.037715:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fc3 expref: 61 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.037723:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fc3 expref: 61 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.037756:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fc3 expref: 61 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.037788:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172498560:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.037859:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.041914:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172498560:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.041948:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.042006:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175274624:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4395us (4602us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.042017:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11120 00000100:00100000:0.0:1746144896.042114:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.042614:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175274880 00000100:00100000:3.0:1746144896.042622:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175274880 00002000:00100000:3.0:1746144896.042661:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a1500 x1830965175274880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.042670:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a1500 with x1830965175274880 ext(0->4095) 00002000:00010000:3.0:1746144896.042676:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938a1500 00000100:00100000:3.0:1746144896.042705:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4141 00000100:00100000:3.0:1746144896.042713:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1984:x1830965175274880:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.043714:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1984:x1830965175274880:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 999us (1598us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.043723:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4141 00002000:00100000:3.0:1746144896.043729:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a1500 x1830965175274880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.043738:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a1500 with x1830965175274880 ext(0->4095) 00002000:00010000:3.0:1746144896.043741:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938a1500 00000100:00100000:0.0:1746144896.052489:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.052605:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175275008 00000100:00100000:2.0:1746144896.052617:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175275008 00000100:00100000:2.0:1746144896.052731:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5705 00000100:00100000:2.0:1746144896.052741:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175275008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.052761:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.052806:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515566 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94fca expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.052838:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fc3 expref: 61 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.052847:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.052849:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.052853:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515566 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fca expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.052887:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fc3 expref: 61 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.052899:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fc3 expref: 61 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.052912:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a095f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172498688:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.053014:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.061913:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a095f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172498688:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.061963:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515566 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fca expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.061982:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e5c00, rc 0) 00000100:00100000:2.0:1746144896.062033:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175275008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 9293us (9555us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.062043:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5705 00000100:00100000:0.0:1746144896.065363:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.065457:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175275136 00000100:00100000:3.0:1746144896.065467:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175275136 00002000:00100000:3.0:1746144896.065513:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800938a2680 x1830965175275136/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.065523:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a2680 with x1830965175275136 ext(0->7) 00010000:00010000:3.0:1746144896.065534:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fc3 expref: 62 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.065547:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fc3 expref: 62 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.065554:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a2680 00000100:00100000:3.0:1746144896.065622:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2177 00000100:00100000:3.0:1746144896.065630:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+62:1985:x1830965175275136:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144896.067073:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1985:x1830965175275136:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 1439us (1714us total) trans 4294968038 rc 0/0 00000100:00100000:3.0:1746144896.067081:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2177 00002000:00100000:3.0:1746144896.067089:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800938a2680 x1830965175275136/t4294968038(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/448 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.067096:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a2680 with x1830965175275136 ext(0->7) 00010000:00010000:3.0:1746144896.067103:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fc3 expref: 64 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.067114:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fc3 expref: 64 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.067120:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800938a2680 00000100:00100000:0.0:1746144896.069877:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.070163:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175275264 00000100:00100000:3.0:1746144896.070172:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175275264 00010000:00010000:3.0:1746144896.070209:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fc3 expref: 64 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.070251:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11121 00000100:00100000:3.0:1746144896.070258:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1984:x1830965175275264:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.070271:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.070291:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fc3 expref: 64 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.070303:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fc3 expref: 64 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.070325:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4800/0x4076af672751555f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fc3 expref: 64 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.071233:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.071236:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.071247:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515566 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fca expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.071256:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515566 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fca expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.071292:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515566 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fca expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.071305:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172498816:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.072796:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.076088:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.076442:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172498816:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.076461:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.076518:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1984:x1830965175275264:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6260us (6648us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.076529:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11121 00000100:00100000:0.0:1746144896.077213:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.077358:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175275520 00000100:00100000:2.0:1746144896.077366:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175275520 00002000:00100000:2.0:1746144896.077413:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a1c00 x1830965175275520/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.077422:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a1c00 with x1830965175275520 ext(0->4095) 00002000:00010000:2.0:1746144896.077427:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938a1c00 00000100:00100000:2.0:1746144896.077449:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4142 00000100:00100000:2.0:1746144896.077457:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175275520:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144896.077627:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175275520:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 171us (1550us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.077633:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4142 00002000:00100000:2.0:1746144896.077638:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800938a1c00 x1830965175275520/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.077645:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800938a1c00 with x1830965175275520 ext(0->4095) 00002000:00010000:2.0:1746144896.077648:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800938a1c00 00000100:00100000:3.0:1746144896.077893:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175275648 00000100:00100000:3.0:1746144896.077897:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175275648 00000100:00100000:3.0:1746144896.077930:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5706 00000100:00100000:3.0:1746144896.077935:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800938a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+63:31565:x1830965175275648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.077945:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.077961:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94fd1 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.077988:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515566 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fca expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.077995:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.077997:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.078000:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd1 expref: 64 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.078027:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515566 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fca expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.078039:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515566 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fca expref: 5 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.078051:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172498944:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.078099:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.080474:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.080575:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175275776 00000100:00100000:1.0:1746144896.080583:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175275776 00000100:00100000:1.0:1746144896.080634:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5707 00000100:00100000:1.0:1746144896.080642:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+65:31579:x1830965175275776:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144896.080660:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144896.080678:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515574 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94fd8 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.080704:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144896.080710:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd1 expref: 66 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.080716:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144896.080719:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515574 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd8 expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.080753:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd1 expref: 66 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.080800:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515574 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd8 expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.080812:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d200, rc 0) 00000100:00100000:1.0:1746144896.080851:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31579:x1830965175275776:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 210us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144896.080856:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5707 00000100:00100000:3.0:1746144896.080961:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172498944:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.080976:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd1 expref: 65 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.080984:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:3.0:1746144896.082063:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800938a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+65:31565:x1830965175275648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4122us (4845us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.082071:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5706 00000100:00100000:0.0:1746144896.082089:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.082111:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175275904 00000100:00100000:3.0:1746144896.082116:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175275904 00010000:00010000:3.0:1746144896.082136:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515566 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fca expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.082160:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11122 00000100:00100000:3.0:1746144896.082166:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175275904:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.082177:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.082200:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515566 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fca expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.082211:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515566 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fca expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.082232:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515566 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fca expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.082252:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.082254:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.082259:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd1 expref: 64 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.082266:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd1 expref: 64 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.082290:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd1 expref: 64 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.082301:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd1 expref: 64 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.082311:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172499200:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.082355:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.085662:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.085729:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175276160 00000100:00100000:1.0:1746144896.085738:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175276160 00002000:00100000:1.0:1746144896.085964:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5e680 x1830965175276160/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.085974:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5e680 with x1830965175276160 ext(0->4095) 00000100:00100000:3.0:1746144896.085980:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172499200:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144896.085983:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd1 expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.085996:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd1 expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.085997:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1746144896.086001:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5e680 00000100:00100000:3.0:1746144896.086038:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175275904:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3872us (3948us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.086047:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11122 00000100:00100000:1.0:1746144896.086494:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2178 00000100:00100000:1.0:1746144896.086502:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1985:x1830965175276160:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144896.087090:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1985:x1830965175276160:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 587us (1436us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.087096:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2178 00002000:00100000:1.0:1746144896.087103:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5e680 x1830965175276160/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.087110:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5e680 with x1830965175276160 ext(0->4095) 00010000:00010000:1.0:1746144896.087116:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd1 expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.087125:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd1 expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.087131:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5e680 00000100:00100000:0.0:1746144896.089365:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.089469:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175276288 00000100:00100000:3.0:1746144896.089478:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175276288 00010000:00010000:3.0:1746144896.089512:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd1 expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.089543:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11123 00000100:00100000:3.0:1746144896.089550:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1983:x1830965175276288:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.089564:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.089586:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd1 expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.089598:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd1 expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.089622:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751556d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd1 expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.089637:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.089639:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.089647:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515574 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd8 expref: 64 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.089655:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515574 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd8 expref: 64 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.089690:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515574 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd8 expref: 64 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.089701:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172499328:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.090681:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd423c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.091940:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172499328:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.091959:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.091996:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1983:x1830965175276288:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2445us (2638us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.092005:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11123 00000100:00100000:0.0:1746144896.093101:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.093290:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175276544 00000100:00100000:1.0:1746144896.093298:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175276544 00002000:00100000:1.0:1746144896.093334:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5c380 x1830965175276544/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.093343:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5c380 with x1830965175276544 ext(0->4095) 00002000:00010000:1.0:1746144896.093348:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5c380 00000100:00100000:1.0:1746144896.093878:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4143 00000100:00100000:1.0:1746144896.093886:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1985:x1830965175276544:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144896.094995:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1985:x1830965175276544:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1106us (1893us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.095003:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4143 00002000:00100000:1.0:1746144896.095012:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5c380 x1830965175276544/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.095019:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5c380 with x1830965175276544 ext(0->4095) 00002000:00010000:1.0:1746144896.095025:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5c380 00000100:00100000:0.0:1746144896.097095:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.097279:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175276672 00000100:00100000:3.0:1746144896.097288:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175276672 00000100:00100000:3.0:1746144896.097342:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5708 00000100:00100000:3.0:1746144896.097350:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175276672:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.097368:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.097386:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94fdf expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.097416:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515574 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd8 expref: 63 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.097424:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.097425:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.097429:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fdf expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.097461:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515574 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd8 expref: 63 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.097473:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515574 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd8 expref: 63 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.097484:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172499456:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.098293:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.100889:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172499456:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.100929:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fdf expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.100952:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:3.0:1746144896.100998:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175276672:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3649us (3911us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.101006:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5708 00000100:00100000:0.0:1746144896.101388:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.101664:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175276800 00000100:00100000:2.0:1746144896.101671:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175276800 00010000:00010000:2.0:1746144896.101700:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515574 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd8 expref: 64 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.101719:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11124 00000100:00100000:2.0:1746144896.101725:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1984:x1830965175276800:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.101736:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.101755:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515574 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd8 expref: 64 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.101784:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515574 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd8 expref: 64 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.101806:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515574 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fd8 expref: 64 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.101821:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.101822:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.101829:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fdf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.101837:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fdf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.101863:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fdf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.101874:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a095f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172499584:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.101936:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.104138:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.104263:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175276928 00000100:00100000:3.0:1746144896.104269:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175276928 00000100:00100000:3.0:1746144896.104304:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5709 00000100:00100000:3.0:1746144896.104310:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+64:31565:x1830965175276928:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.104327:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.104343:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94fe6 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.104368:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fdf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.104375:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.104376:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.104380:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fe6 expref: 65 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.104405:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fdf expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.104416:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fdf expref: 5 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.104432:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172499712:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.106354:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.107635:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.107985:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a095f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172499584:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.108024:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.108073:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1984:x1830965175276800:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6347us (6686us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.108083:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11124 00000100:00100000:0.0:1746144896.108813:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175277184 00000100:00100000:0.0:1746144896.108827:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175277184 00002000:00100000:0.0:1746144896.108876:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a096300 x1830965175277184/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144896.108912:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a096300 with x1830965175277184 ext(0->4095) 00010000:00010000:0.0:1746144896.108940:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fdf expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:0.0:1746144896.108953:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fdf expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:0.0:1746144896.108959:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a096300 00000100:00100000:0.0:1746144896.108984:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2179 00000100:00100000:0.0:1746144896.108992:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175277184:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:0.0:1746144896.109175:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175277184:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 183us (1559us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144896.109181:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2179 00002000:00100000:0.0:1746144896.109186:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a096300 x1830965175277184/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144896.109193:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a096300 with x1830965175277184 ext(0->4095) 00010000:00010000:0.0:1746144896.109197:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fdf expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:0.0:1746144896.109206:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fdf expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:0.0:1746144896.109212:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a096300 00000100:00100000:1.0:1746144896.113166:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.113422:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175277312 00000100:00100000:0.0:1746144896.113429:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175277312 00000100:00100000:0.0:1746144896.113470:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5710 00000100:00100000:0.0:1746144896.113477:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+65:31579:x1830965175277312:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144896.113495:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144896.113512:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af6727515589 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94fed expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.113525:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172499712:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144896.113536:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144896.113541:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fe6 expref: 66 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.113547:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144896.113550:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af6727515589 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fed expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.113682:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fe6 expref: 66 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.113693:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00010000:00010000:0.0:1746144896.113723:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fe6 expref: 66 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.113731:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31565:x1830965175276928:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 9421us (9601us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144896.113733:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af6727515589 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fed expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.113737:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5709 00010000:00010000:0.0:1746144896.113740:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b3400, rc 0) 00000100:00100000:0.0:1746144896.113752:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+65:31579:x1830965175277312:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 277us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144896.113757:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5710 00000100:00100000:0.0:1746144896.114703:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.114822:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175277440 00000100:00100000:3.0:1746144896.114826:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175277440 00010000:00010000:3.0:1746144896.114847:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fdf expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.114866:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11125 00000100:00100000:3.0:1746144896.114871:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175277440:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.114880:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.114901:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fdf expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.114911:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fdf expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.114942:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751557b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fdf expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.115116:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.115118:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.115125:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fe6 expref: 64 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.115133:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fe6 expref: 64 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.115154:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fe6 expref: 64 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.115164:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fe6 expref: 64 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.115175:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172499968:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.115583:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.118569:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.118657:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172499968:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.118674:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.118868:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175277696 00000100:00100000:2.0:1746144896.118875:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175277696 00002000:00100000:2.0:1746144896.118932:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e54e00 x1830965175277696/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.118942:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e54e00 with x1830965175277696 ext(0->4095) 00010000:00010000:2.0:1746144896.118951:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fe6 expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.118964:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fe6 expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.118970:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e54e00 00000100:00100000:2.0:1746144896.118990:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2180 00000100:00100000:2.0:1746144896.118997:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1984:x1830965175277696:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.119197:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175277440:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4324us (4494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.119206:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11125 00000100:00100000:2.0:1746144896.120152:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1984:x1830965175277696:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 1154us (1589us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.120159:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2180 00002000:00100000:2.0:1746144896.120165:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e54e00 x1830965175277696/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.120173:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e54e00 with x1830965175277696 ext(0->4095) 00010000:00010000:2.0:1746144896.120179:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fe6 expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.120188:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fe6 expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.120193:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e54e00 00000100:00100000:2.0:1746144896.122425:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.122699:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175277824 00000100:00100000:3.0:1746144896.122707:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175277824 00010000:00010000:3.0:1746144896.122741:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fe6 expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.122849:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11126 00000100:00100000:3.0:1746144896.122857:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1982:x1830965175277824:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.122871:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.122893:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fe6 expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.122905:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fe6 expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.122938:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515582 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fe6 expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.123178:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.123180:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.123188:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af6727515589 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fed expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.123196:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af6727515589 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fed expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.123235:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af6727515589 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fed expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.123246:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172500096:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.123681:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.125986:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.126084:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172500096:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.126102:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.126147:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1982:x1830965175277824:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3290us (3729us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.126158:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11126 00000100:00100000:2.0:1746144896.126269:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175278080 00000100:00100000:2.0:1746144896.126275:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175278080 00002000:00100000:2.0:1746144896.126315:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e55180 x1830965175278080/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.126325:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e55180 with x1830965175278080 ext(0->4095) 00002000:00010000:2.0:1746144896.126329:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e55180 00000100:00100000:2.0:1746144896.126345:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4144 00000100:00100000:2.0:1746144896.126352:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1982:x1830965175278080:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:2.0:1746144896.126996:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e55180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1982:x1830965175278080:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 635us (1007us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.127007:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4144 00002000:00100000:2.0:1746144896.127020:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e55180 x1830965175278080/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.127029:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e55180 with x1830965175278080 ext(0->4095) 00002000:00010000:2.0:1746144896.127036:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e55180 00000100:00100000:0.0:1746144896.128971:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.129132:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175278208 00000100:00100000:2.0:1746144896.129142:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175278208 00000100:00100000:2.0:1746144896.129203:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5711 00000100:00100000:2.0:1746144896.129210:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175278208:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.129224:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.129238:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515590 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ff4 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.129264:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af6727515589 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fed expref: 63 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.129270:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.129271:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.129274:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515590 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ff4 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.129299:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af6727515589 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fed expref: 63 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.129309:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af6727515589 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fed expref: 63 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.129319:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172500224:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.129406:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.132372:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172500224:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.132410:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515590 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ff4 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.132428:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e5c00, rc 0) 00000100:00100000:2.0:1746144896.132470:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175278208:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3260us (3506us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.132479:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5711 00000100:00100000:0.0:1746144896.133836:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.133934:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175278336 00000100:00100000:3.0:1746144896.133941:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175278336 00010000:00010000:3.0:1746144896.133971:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af6727515589 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fed expref: 64 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.133993:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11127 00000100:00100000:3.0:1746144896.133998:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1984:x1830965175278336:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.134010:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.134031:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af6727515589 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fed expref: 64 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.134042:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af6727515589 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fed expref: 64 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.134065:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3400/0x4076af6727515589 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94fed expref: 64 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.134092:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.134095:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.134101:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515590 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ff4 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.134109:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515590 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ff4 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.134141:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515590 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ff4 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.134153:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172500352:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.134224:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.135709:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172500352:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.135721:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.135749:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1984:x1830965175278336:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1750us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.135758:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11127 00000100:00100000:0.0:1746144896.137406:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.137546:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175278592 00000100:00100000:2.0:1746144896.137557:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175278592 00002000:00100000:2.0:1746144896.137600:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e55c00 x1830965175278592/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.137609:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e55c00 with x1830965175278592 ext(0->4095) 00002000:00010000:2.0:1746144896.137614:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e55c00 00000100:00100000:2.0:1746144896.137646:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4145 00000100:00100000:2.0:1746144896.137653:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175278592:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144896.137836:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175278592:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 182us (432us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.137842:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4145 00002000:00100000:2.0:1746144896.137847:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e55c00 x1830965175278592/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.137855:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e55c00 with x1830965175278592 ext(0->4095) 00002000:00010000:2.0:1746144896.137857:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e55c00 00000100:00100000:0.0:1746144896.138041:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.138478:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175278720 00000100:00100000:2.0:1746144896.138484:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175278720 00000100:00100000:2.0:1746144896.138526:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5712 00000100:00100000:2.0:1746144896.138533:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+63:31565:x1830965175278720:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.138550:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.138567:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af94ffb expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.138597:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515590 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ff4 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.138604:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.138606:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.138610:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ffb expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.138640:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515590 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ff4 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.138651:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515590 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ff4 expref: 5 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.138662:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172500480:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.138751:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144896.142040:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.142122:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172500480:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.142156:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ffb expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.142174:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e4e00, rc 0) 00000100:00100000:3.0:1746144896.142218:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+64:31565:x1830965175278720:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3685us (4176us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.142230:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5712 00000100:00100000:1.0:1746144896.142389:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.142583:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175278976 00000100:00100000:0.0:1746144896.142588:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175278976 00010000:00010000:0.0:1746144896.142614:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515590 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ff4 expref: 6 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:0.0:1746144896.142642:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11128 00000100:00100000:0.0:1746144896.142648:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175278976:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144896.142659:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144896.142678:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515590 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ff4 expref: 6 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:0.0:1746144896.142688:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515590 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ff4 expref: 6 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:0.0:1746144896.142710:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515590 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ff4 expref: 6 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.142970:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175278848 00000100:00100000:3.0:1746144896.142974:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175278848 00000100:00100000:3.0:1746144896.143005:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5713 00000100:00100000:3.0:1746144896.143011:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+64:31579:x1830965175278848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.143023:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.143033:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751559e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95002 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.143045:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.143049:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ffb expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.143055:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.143058:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751559e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95002 expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.143085:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ffb expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.143094:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751559e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95002 expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.143100:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.143102:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.143107:0:10401:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ffb expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.143117:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ffb expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.143133:0:10401:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ffb expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.143143:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ffb expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.143154:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172500736:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.143214:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746144896.143214:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144896.143231:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175278976:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 583us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144896.143238:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11128 00000100:00100000:3.0:1746144896.145363:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172500736:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.145378:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:3.0:1746144896.145425:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+65:31579:x1830965175278848:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2412us (3392us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.145432:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5713 00000100:00100000:2.0:1746144896.145596:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.145639:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175279232 00000100:00100000:3.0:1746144896.145645:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175279232 00002000:00100000:3.0:1746144896.145679:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a095f80 x1830965175279232/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.145689:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a095f80 with x1830965175279232 ext(0->4095) 00010000:00010000:3.0:1746144896.145696:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ffb expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.145712:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ffb expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.145718:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a095f80 00000100:00100000:3.0:1746144896.145744:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2181 00000100:00100000:3.0:1746144896.145750:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1984:x1830965175279232:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.145949:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1984:x1830965175279232:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 199us (354us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.145956:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2181 00002000:00100000:3.0:1746144896.145961:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a095f80 x1830965175279232/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.145968:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a095f80 with x1830965175279232 ext(0->4095) 00010000:00010000:3.0:1746144896.145973:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ffb expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.145981:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ffb expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.145986:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a095f80 00000100:00100000:0.0:1746144896.148111:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.148214:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175279360 00000100:00100000:2.0:1746144896.148222:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175279360 00010000:00010000:2.0:1746144896.148257:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ffb expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.148296:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11129 00000100:00100000:2.0:1746144896.148303:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1984:x1830965175279360:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.148316:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.148362:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ffb expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.148374:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ffb expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.148398:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515597 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af94ffb expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.148543:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.148545:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.148552:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751559e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95002 expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.148560:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751559e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95002 expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.148592:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751559e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95002 expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.148603:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172500864:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.148688:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.150487:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172500864:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.150505:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.150532:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1984:x1830965175279360:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2229us (2428us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.150544:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11129 00000100:00100000:0.0:1746144896.152005:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.152143:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175279616 00000100:00100000:3.0:1746144896.152151:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175279616 00002000:00100000:3.0:1746144896.152191:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e56680 x1830965175279616/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.152201:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e56680 with x1830965175279616 ext(0->4095) 00002000:00010000:3.0:1746144896.152206:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e56680 00000100:00100000:3.0:1746144896.152224:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4146 00000100:00100000:3.0:1746144896.152241:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1984:x1830965175279616:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.152424:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1984:x1830965175279616:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 193us (423us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.152430:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4146 00002000:00100000:3.0:1746144896.152435:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e56680 x1830965175279616/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.152442:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e56680 with x1830965175279616 ext(0->4095) 00002000:00010000:3.0:1746144896.152445:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e56680 00000100:00100000:0.0:1746144896.154487:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.154661:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175279744 00000100:00100000:3.0:1746144896.154668:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175279744 00000100:00100000:3.0:1746144896.154709:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5714 00000100:00100000:3.0:1746144896.154715:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175279744:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.154730:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.154749:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95009 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.154803:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751559e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95002 expref: 63 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.154810:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.154812:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.154815:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155a5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95009 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.154849:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751559e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95002 expref: 63 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.154861:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751559e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95002 expref: 63 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.154873:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172500992:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.155044:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.156878:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172500992:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.156904:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155a5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95009 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.156932:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:3.0:1746144896.156976:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175279744:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2260us (2494us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.156984:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5714 00000100:00100000:0.0:1746144896.157940:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.158127:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175279872 00000100:00100000:2.0:1746144896.158134:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175279872 00010000:00010000:2.0:1746144896.158167:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751559e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95002 expref: 64 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.158228:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11130 00000100:00100000:2.0:1746144896.158236:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1984:x1830965175279872:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.158248:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.158269:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751559e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95002 expref: 64 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.158281:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751559e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95002 expref: 64 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.158303:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751559e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95002 expref: 64 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.158329:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.158331:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.158338:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95009 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.158346:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95009 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.158374:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95009 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.158386:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172501120:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.158455:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.159814:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172501120:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.159834:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.159863:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+63:1984:x1830965175279872:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1628us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.159872:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11130 00000100:00100000:0.0:1746144896.161134:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.161255:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175280128 00000100:00100000:3.0:1746144896.161262:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175280128 00002000:00100000:3.0:1746144896.161303:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e57100 x1830965175280128/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.161312:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e57100 with x1830965175280128 ext(0->4095) 00002000:00010000:3.0:1746144896.161317:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e57100 00000100:00100000:3.0:1746144896.161343:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4147 00000100:00100000:3.0:1746144896.161349:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175280128:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.162235:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175280128:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 884us (1103us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.162242:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4147 00002000:00100000:3.0:1746144896.162247:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e57100 x1830965175280128/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.162254:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e57100 with x1830965175280128 ext(0->4095) 00002000:00010000:3.0:1746144896.162257:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e57100 00000100:00100000:0.0:1746144896.162525:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.162794:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175280256 00000100:00100000:3.0:1746144896.162798:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175280256 00000100:00100000:3.0:1746144896.162826:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5715 00000100:00100000:3.0:1746144896.162831:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+63:31565:x1830965175280256:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.162842:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.162857:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95010 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.162882:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95009 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.162890:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.162891:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.162895:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95010 expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.162937:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95009 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.162953:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95009 expref: 5 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.162965:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172501248:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.163036:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.165379:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172501248:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.165405:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95010 expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.165422:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:3.0:1746144896.165673:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+64:31565:x1830965175280256:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2840us (3147us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.165682:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5715 00000100:00100000:0.0:1746144896.165877:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.166342:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175280384 00000100:00100000:3.0:1746144896.166348:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175280384 00000100:00100000:3.0:1746144896.166381:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5716 00000100:00100000:3.0:1746144896.166387:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+64:31579:x1830965175280384:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.166401:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.166415:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95017 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.166436:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.166440:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95010 expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.166450:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.166453:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95017 expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.166481:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95010 expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.166491:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95017 expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.166498:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:3.0:1746144896.167127:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e57800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+65:31579:x1830965175280384:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 737us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.167134:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5716 00000100:00100000:0.0:1746144896.167665:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.167752:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175280512 00000100:00100000:2.0:1746144896.167756:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175280512 00010000:00010000:2.0:1746144896.167798:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95009 expref: 6 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.167829:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11131 00000100:00100000:2.0:1746144896.167836:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175280512:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.167846:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.167866:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95009 expref: 6 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.167878:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95009 expref: 6 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.167898:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95009 expref: 6 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.167912:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.167914:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.167932:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95010 expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.167940:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95010 expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.167963:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95010 expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.167973:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95010 expref: 64 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.167984:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172501504:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.168047:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.169268:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172501504:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.169287:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.169313:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175280512:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1478us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.169322:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11131 00000100:00100000:0.0:1746144896.169805:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.170106:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175280768 00000100:00100000:3.0:1746144896.170111:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175280768 00002000:00100000:3.0:1746144896.170146:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e54380 x1830965175280768/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.170156:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e54380 with x1830965175280768 ext(0->4095) 00010000:00010000:3.0:1746144896.170164:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95010 expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.170177:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95010 expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.170184:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e54380 00000100:00100000:3.0:1746144896.170323:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2182 00000100:00100000:3.0:1746144896.170330:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1985:x1830965175280768:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144896.170498:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1985:x1830965175280768:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 168us (693us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.170505:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2182 00002000:00100000:3.0:1746144896.170510:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087e54380 x1830965175280768/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.170517:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e54380 with x1830965175280768 ext(0->4095) 00010000:00010000:3.0:1746144896.170521:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95010 expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.170530:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95010 expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.170535:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087e54380 00000100:00100000:0.0:1746144896.172110:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.172923:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175280896 00000100:00100000:2.0:1746144896.172931:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175280896 00010000:00010000:2.0:1746144896.172968:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95010 expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.173007:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11132 00000100:00100000:2.0:1746144896.173014:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1985:x1830965175280896:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.173121:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.173145:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95010 expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.173161:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95010 expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.173186:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275155ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95010 expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.173365:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.173368:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.173375:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95017 expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.173384:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95017 expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.173419:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95017 expref: 64 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.173431:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172501632:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.173521:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.175481:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172501632:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.175505:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.175555:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e54a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1985:x1830965175280896:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2540us (3448us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.175568:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11132 00000100:00100000:0.0:1746144896.177024:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.177112:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175281152 00000100:00100000:3.0:1746144896.177119:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175281152 00002000:00100000:3.0:1746144896.177168:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d4000 x1830965175281152/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.177179:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d4000 with x1830965175281152 ext(0->4095) 00002000:00010000:3.0:1746144896.177183:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a2d4000 00000100:00100000:3.0:1746144896.177211:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4148 00000100:00100000:3.0:1746144896.177218:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1985:x1830965175281152:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144896.177387:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1985:x1830965175281152:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 169us (368us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.177394:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4148 00002000:00100000:3.0:1746144896.177399:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d4000 x1830965175281152/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.177407:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d4000 with x1830965175281152 ext(0->4095) 00002000:00010000:3.0:1746144896.177409:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a2d4000 00000100:00100000:0.0:1746144896.179046:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.179255:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175281280 00000100:00100000:3.0:1746144896.179260:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175281280 00000100:00100000:3.0:1746144896.179293:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5717 00000100:00100000:3.0:1746144896.179300:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175281280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.179313:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.179331:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275155ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9501e expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.179359:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95017 expref: 63 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.179367:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.179369:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.179372:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275155ba lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9501e expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.179401:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95017 expref: 63 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.179412:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95017 expref: 63 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.179433:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172501760:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.179518:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.181173:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172501760:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.181199:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275155ba lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9501e expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.181298:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:3.0:1746144896.181344:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175281280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2042us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.181352:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5717 00000100:00100000:0.0:1746144896.181598:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.181678:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175281408 00000100:00100000:3.0:1746144896.181684:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175281408 00002000:00100000:3.0:1746144896.181720:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008a2d4700 x1830965175281408/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.181733:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d4700 with x1830965175281408 ext(0->7) 00010000:00010000:3.0:1746144896.181739:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95017 expref: 64 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.181749:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95017 expref: 64 pid: 10401 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.181755:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a2d4700 00000100:00100000:3.0:1746144896.181808:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2183 00000100:00100000:3.0:1746144896.181815:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+64:1985:x1830965175281408:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144896.182141:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1985:x1830965175281408:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 326us (543us total) trans 4294968039 rc 0/0 00000100:00100000:3.0:1746144896.182156:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2183 00002000:00100000:3.0:1746144896.182162:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008a2d4700 x1830965175281408/t4294968039(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/448 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.182169:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d4700 with x1830965175281408 ext(0->7) 00010000:00010000:3.0:1746144896.182174:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95017 expref: 66 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.182187:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95017 expref: 66 pid: 10401 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.182193:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a2d4700 00000100:00100000:0.0:1746144896.183125:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.183188:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175281536 00000100:00100000:2.0:1746144896.183193:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175281536 00010000:00010000:2.0:1746144896.183220:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95017 expref: 66 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:1.0:1746144896.183955:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11133 00000100:00100000:1.0:1746144896.183968:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1983:x1830965175281536:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144896.183981:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144896.183999:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95017 expref: 66 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.184011:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95017 expref: 66 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.184034:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95017 expref: 66 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.184052:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144896.184054:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144896.184061:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275155ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9501e expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.184069:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275155ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9501e expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.184104:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275155ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9501e expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144896.184115:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172501888:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144896.184192:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b5344a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.187212:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.187355:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172501888:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144896.187376:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.187377:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175281792 00000100:00100000:3.0:1746144896.187384:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175281792 00000100:00100000:1.0:1746144896.187419:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1983:x1830965175281536:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3453us (4295us total) trans 0 rc 0/0 00002000:00100000:3.0:1746144896.187423:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d4a80 x1830965175281792/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00000100:00100000:1.0:1746144896.187429:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11133 00002000:00100000:3.0:1746144896.187432:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d4a80 with x1830965175281792 ext(0->4095) 00002000:00010000:3.0:1746144896.187437:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a2d4a80 00000100:00100000:3.0:1746144896.187452:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4149 00000100:00100000:3.0:1746144896.187459:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175281792:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.187699:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175281792:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 240us (495us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.187705:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4149 00002000:00100000:3.0:1746144896.187711:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d4a80 x1830965175281792/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.187717:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d4a80 with x1830965175281792 ext(0->4095) 00002000:00010000:3.0:1746144896.187720:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a2d4a80 00000100:00100000:0.0:1746144896.194094:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.194153:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.194379:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175281920 00000100:00100000:1.0:1746144896.194388:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175281920 00000100:00100000:1.0:1746144896.194437:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175282048 00000100:00100000:1.0:1746144896.194439:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175282048 00000100:00100000:1.0:1746144896.194473:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5718 00000100:00100000:1.0:1746144896.194481:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31565:x1830965175281920:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144896.194500:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144896.194518:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95025 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.194551:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275155ba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9501e expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.194561:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144896.194563:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144896.194567:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95025 expref: 67 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.194574:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5719 00000100:00100000:3.0:1746144896.194593:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+67:31579:x1830965175282048:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144896.194600:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275155ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9501e expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.194610:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144896.194612:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275155ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9501e expref: 5 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:1.0:1746144896.194625:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172502016:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.194626:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9502c expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.194650:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.194655:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95025 expref: 68 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.194661:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.194664:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155c8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9502c expref: 68 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.194697:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95025 expref: 68 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.194706:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155c8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9502c expref: 68 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.194714:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:3.0:1746144896.194799:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+68:31579:x1830965175282048:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 178us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.194807:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5719 00000100:00100000:1.0:1746144896.195156:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.196547:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.196555:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172502016:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144896.196574:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95025 expref: 67 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.196586:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966ce00, rc 0) 00000100:00100000:1.0:1746144896.196613:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+67:31565:x1830965175281920:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2133us (2531us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144896.196619:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5718 00000100:00100000:2.0:1746144896.196629:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175282176 00000100:00100000:2.0:1746144896.196636:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175282176 00010000:00010000:2.0:1746144896.196667:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275155ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9501e expref: 6 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.196706:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11134 00000100:00100000:2.0:1746144896.196713:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175282176:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.196725:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.196746:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275155ba lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9501e expref: 6 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.197073:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275155ba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9501e expref: 6 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.197098:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275155ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9501e expref: 6 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.197122:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.197124:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.197132:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95025 expref: 66 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.197145:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95025 expref: 66 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.197176:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95025 expref: 66 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.197191:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95025 expref: 66 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.197201:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172502272:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.198258:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.202714:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172502272:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.202741:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.202828:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175282176:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6112us (6280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.202837:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11134 00000100:00100000:0.0:1746144896.203115:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.203214:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175282432 00000100:00100000:3.0:1746144896.203220:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175282432 00002000:00100000:3.0:1746144896.203249:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d5880 x1830965175282432/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.203257:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d5880 with x1830965175282432 ext(0->4095) 00010000:00010000:3.0:1746144896.203269:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95025 expref: 67 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.203280:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95025 expref: 67 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.203286:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a2d5880 00000100:00100000:3.0:1746144896.203313:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2184 00000100:00100000:3.0:1746144896.203320:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175282432:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.203469:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175282432:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 149us (354us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.203476:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2184 00002000:00100000:3.0:1746144896.203481:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d5880 x1830965175282432/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.203488:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d5880 with x1830965175282432 ext(0->4095) 00010000:00010000:3.0:1746144896.203492:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95025 expref: 67 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.203506:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95025 expref: 67 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.203511:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a2d5880 00000100:00100000:0.0:1746144896.205747:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.205966:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175282560 00000100:00100000:2.0:1746144896.205974:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175282560 00010000:00010000:2.0:1746144896.206015:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95025 expref: 67 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.206056:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11135 00000100:00100000:2.0:1746144896.206063:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175282560:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.206075:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.206096:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95025 expref: 67 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.206108:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95025 expref: 67 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.206130:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275155c1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95025 expref: 67 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.206158:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.206160:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.206168:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9502c expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.206176:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9502c expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.206206:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9502c expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.206218:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172502400:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.206290:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.208660:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.208750:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172502400:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.208806:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.208975:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175282816 00000100:00100000:3.0:1746144896.208982:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175282816 00002000:00100000:3.0:1746144896.209021:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d5f80 x1830965175282816/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.209032:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d5f80 with x1830965175282816 ext(0->4095) 00002000:00010000:3.0:1746144896.209036:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a2d5f80 00000100:00100000:3.0:1746144896.209059:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4150 00000100:00100000:3.0:1746144896.209066:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175282816:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144896.209268:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175282560:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3204us (3529us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.209277:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11135 00000100:00100000:3.0:1746144896.210011:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175282816:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 944us (1358us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.210019:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4150 00002000:00100000:3.0:1746144896.210026:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d5f80 x1830965175282816/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.210034:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d5f80 with x1830965175282816 ext(0->4095) 00002000:00010000:3.0:1746144896.210036:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a2d5f80 00000100:00100000:0.0:1746144896.211688:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.212161:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175282944 00000100:00100000:1.0:1746144896.212169:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175282944 00000100:00100000:1.0:1746144896.212213:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5720 00000100:00100000:1.0:1746144896.212221:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175282944:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144896.212235:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144896.212250:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275155cf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95033 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.212275:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9502c expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.212280:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144896.212282:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144896.212284:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275155cf lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95033 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.212311:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9502c expref: 65 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.212320:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9502c expref: 65 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:1.0:1746144896.212328:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172502528:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144896.212404:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144896.213321:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172502528:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144896.213339:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275155cf lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95033 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.213351:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966c000, rc 0) 00000100:00100000:1.0:1746144896.213476:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175282944:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1254us (1789us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144896.213484:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5720 00000100:00100000:0.0:1746144896.213874:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.214079:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175283072 00000100:00100000:2.0:1746144896.214084:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175283072 00010000:00010000:2.0:1746144896.214111:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9502c expref: 66 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.214193:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11136 00000100:00100000:2.0:1746144896.214201:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1985:x1830965175283072:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.214213:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.214235:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9502c expref: 66 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.214246:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9502c expref: 66 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.214267:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275155c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9502c expref: 66 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.214463:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.214466:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.214474:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275155cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95033 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.214486:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275155cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95033 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.214513:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275155cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95033 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.214535:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172502656:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.214700:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.216211:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172502656:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.216231:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.216650:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1985:x1830965175283072:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2448us (2774us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.216660:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11136 00000100:00100000:0.0:1746144896.216714:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.216843:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175283328 00000100:00100000:3.0:1746144896.216850:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175283328 00002000:00100000:3.0:1746144896.216886:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d6a00 x1830965175283328/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.216903:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d6a00 with x1830965175283328 ext(0->4095) 00002000:00010000:3.0:1746144896.216907:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a2d6a00 00000100:00100000:3.0:1746144896.216929:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4151 00000100:00100000:3.0:1746144896.216935:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175283328:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.217091:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175283328:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 155us (377us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.217097:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4151 00002000:00100000:3.0:1746144896.217102:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d6a00 x1830965175283328/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.217109:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d6a00 with x1830965175283328 ext(0->4095) 00002000:00010000:3.0:1746144896.217112:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a2d6a00 00000100:00100000:0.0:1746144896.221310:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.221412:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.221501:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175283456 00000100:00100000:3.0:1746144896.221510:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175283456 00000100:00100000:3.0:1746144896.221551:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175283584 00000100:00100000:3.0:1746144896.221553:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175283584 00000100:00100000:3.0:1746144896.221886:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5721 00000100:00100000:1.0:1746144896.221896:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5722 00000100:00100000:3.0:1746144896.221897:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31565:x1830965175283456:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:1.0:1746144896.221906:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31579:x1830965175283584:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.221924:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144896.221927:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.221943:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9503a expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.221944:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95041 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.221974:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275155cf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95033 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.221988:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144896.221990:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144896.221993:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95041 expref: 68 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.222260:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.222267:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95041 expref: 68 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.222278:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.222280:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9503a expref: 68 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.222306:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275155cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95033 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.222310:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95041 expref: 68 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.222319:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275155cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95033 expref: 5 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.222330:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9503a expref: 68 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144896.222331:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172502912:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.222339:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:3.0:1746144896.222384:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+68:31565:x1830965175283456:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 489us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.222390:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5721 00000100:00100000:1.0:1746144896.222856:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.224745:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.225038:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175283712 00000100:00100000:2.0:1746144896.225044:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175283712 00000100:00100000:1.0:1746144896.225077:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172502912:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.225078:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275155cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95033 expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.225099:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95041 expref: 67 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.225113:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966da00, rc 0) 00000100:00100000:2.0:1746144896.225125:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11137 00000100:00100000:2.0:1746144896.225130:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175283712:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.225139:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.225156:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275155cf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95033 expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:1.0:1746144896.225163:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+67:31579:x1830965175283584:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3258us (3750us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144896.225165:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275155cf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95033 expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:1.0:1746144896.225169:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5722 00010000:00010000:2.0:1746144896.225182:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275155cf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95033 expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.225195:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.225197:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.225202:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95041 expref: 66 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.225208:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95041 expref: 66 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.225228:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95041 expref: 66 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.225234:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95041 expref: 66 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.225241:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172503040:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.225289:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.228314:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.228363:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175283968 00000100:00100000:1.0:1746144896.228371:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175283968 00002000:00100000:1.0:1746144896.228412:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d7800 x1830965175283968/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.228428:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d7800 with x1830965175283968 ext(0->4095) 00010000:00010000:1.0:1746144896.228437:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95041 expref: 67 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.228450:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95041 expref: 67 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.228458:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a2d7800 00000100:00100000:1.0:1746144896.228489:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2185 00000100:00100000:1.0:1746144896.228496:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175283968:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144896.228689:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175283968:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 192us (384us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.228695:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2185 00002000:00100000:1.0:1746144896.228701:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a2d7800 x1830965175283968/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.228708:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a2d7800 with x1830965175283968 ext(0->4095) 00010000:00010000:1.0:1746144896.228712:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95041 expref: 67 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.228720:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95041 expref: 67 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.228725:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a2d7800 00000100:00100000:2.0:1746144896.228825:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172503040:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.228849:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.228888:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175283712:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3756us (4148us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.228897:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11137 00000100:00100000:0.0:1746144896.233530:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.233594:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.233682:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175284224 00000100:00100000:1.0:1746144896.233693:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175284224 00000100:00100000:1.0:1746144896.233740:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5723 00000100:00100000:1.0:1746144896.233746:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175284224:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144896.233791:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144896.233809:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95048 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.233837:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144896.233842:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9503a expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.233848:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144896.233851:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95048 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.233891:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9503a expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.233903:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95048 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.233912:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d600, rc 0) 00000100:00100000:1.0:1746144896.233977:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a2d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175284224:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 230us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144896.233983:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5723 00000100:00100000:2.0:1746144896.234009:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175284096 00000100:00100000:2.0:1746144896.234014:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175284096 00010000:00010000:2.0:1746144896.234038:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95041 expref: 67 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.234066:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11138 00000100:00100000:2.0:1746144896.234070:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f384000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1983:x1830965175284096:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.234081:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.234103:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95041 expref: 67 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.234115:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95041 expref: 67 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.234133:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275155d6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95041 expref: 67 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.234156:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.234157:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.234163:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9503a expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.234170:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9503a expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.234190:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9503a expref: 66 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.234201:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9503a expref: 66 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.234212:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172503296:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.234271:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.235803:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172503296:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144896.235816:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1746144896.235821:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.235847:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f384000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1983:x1830965175284096:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1776us (2252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.235857:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11138 00000100:00100000:3.0:1746144896.235911:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175284480 00000100:00100000:3.0:1746144896.235925:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175284480 00002000:00100000:3.0:1746144896.235957:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f384380 x1830965175284480/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.235967:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f384380 with x1830965175284480 ext(0->4095) 00010000:00010000:3.0:1746144896.235973:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9503a expref: 66 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.235984:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9503a expref: 66 pid: 10401 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.235991:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f384380 00000100:00100000:3.0:1746144896.236016:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2186 00000100:00100000:3.0:1746144896.236022:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175284480:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.236966:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f384380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175284480:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 940us (1148us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.236973:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2186 00002000:00100000:3.0:1746144896.236980:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f384380 x1830965175284480/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.236989:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f384380 with x1830965175284480 ext(0->4095) 00010000:00010000:3.0:1746144896.236995:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9503a expref: 66 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.237006:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9503a expref: 66 pid: 10401 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.237012:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f384380 00000100:00100000:0.0:1746144896.238942:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.239294:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175284608 00000100:00100000:1.0:1746144896.239302:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175284608 00000100:00100000:0.0:1746144896.239430:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.239600:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5724 00000100:00100000:1.0:1746144896.239609:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31565:x1830965175284608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144896.239625:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144896.239644:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275155eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9504f expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.239669:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144896.239675:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95048 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.239681:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144896.239684:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275155eb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9504f expref: 67 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.239720:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95048 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.239732:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275155eb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9504f expref: 67 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.239742:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d200, rc 0) 00000100:00100000:1.0:1746144896.239810:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+67:31565:x1830965175284608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 203us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144896.239816:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5724 00000100:00100000:3.0:1746144896.240016:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175284736 00000100:00100000:3.0:1746144896.240020:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175284736 00010000:00010000:3.0:1746144896.240039:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9503a expref: 67 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.240062:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11139 00000100:00100000:3.0:1746144896.240068:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1982:x1830965175284736:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.240076:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.240095:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9503a expref: 67 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.240110:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9503a expref: 67 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.240125:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275155dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9503a expref: 67 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.240341:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.240343:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.240349:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95048 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.240356:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95048 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.240378:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95048 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.240388:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95048 expref: 5 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.240400:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172503552:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.240456:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd423c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.241809:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172503552:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.241825:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.241857:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1982:x1830965175284736:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1788us (2426us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.241870:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11139 00000100:00100000:0.0:1746144896.242067:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.242239:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175284992 00000100:00100000:3.0:1746144896.242244:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175284992 00002000:00100000:3.0:1746144896.242274:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f384e00 x1830965175284992/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.242283:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f384e00 with x1830965175284992 ext(0->4095) 00010000:00010000:3.0:1746144896.242289:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95048 expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.242299:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95048 expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.242305:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f384e00 00000100:00100000:3.0:1746144896.242332:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2187 00000100:00100000:3.0:1746144896.242340:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175284992:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.242518:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f384e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175284992:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 178us (452us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.242524:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2187 00002000:00100000:3.0:1746144896.242529:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f384e00 x1830965175284992/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.242535:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f384e00 with x1830965175284992 ext(0->4095) 00010000:00010000:3.0:1746144896.242540:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95048 expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.242553:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95048 expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.242558:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f384e00 00000100:00100000:0.0:1746144896.245085:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.245182:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175285120 00000100:00100000:3.0:1746144896.245190:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175285120 00010000:00010000:3.0:1746144896.245223:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95048 expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.245249:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11140 00000100:00100000:3.0:1746144896.245256:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175285120:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.245272:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.245292:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95048 expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.245303:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95048 expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.245326:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275155e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95048 expref: 6 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.245360:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.245362:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.245369:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275155eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9504f expref: 65 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.245383:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275155eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9504f expref: 65 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.245416:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275155eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9504f expref: 65 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.245429:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172503680:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.245524:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.247010:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172503680:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.247026:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.247225:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175285120:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1968us (2149us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.247236:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11140 00000100:00100000:0.0:1746144896.247459:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.247510:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175285376 00000100:00100000:3.0:1746144896.247516:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175285376 00002000:00100000:3.0:1746144896.247548:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f385180 x1830965175285376/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.247558:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f385180 with x1830965175285376 ext(0->4095) 00002000:00010000:3.0:1746144896.247562:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f385180 00000100:00100000:3.0:1746144896.247585:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4152 00000100:00100000:3.0:1746144896.247591:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175285376:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.248028:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f385180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175285376:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 435us (568us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.248038:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4152 00002000:00100000:3.0:1746144896.248044:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f385180 x1830965175285376/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.248050:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f385180 with x1830965175285376 ext(0->4095) 00002000:00010000:3.0:1746144896.248053:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f385180 00000100:00100000:0.0:1746144896.249421:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.249474:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175285504 00000100:00100000:2.0:1746144896.249479:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175285504 00000100:00100000:2.0:1746144896.249521:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5725 00000100:00100000:2.0:1746144896.249528:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175285504:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.249540:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.249556:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275155f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95056 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.249582:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275155eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9504f expref: 65 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.249589:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.249591:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.249594:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275155f2 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95056 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.249622:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275155eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9504f expref: 65 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.249633:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275155eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9504f expref: 65 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.249644:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172503808:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.249727:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.251009:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172503808:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.251034:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275155f2 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95056 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.251048:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e5200, rc 0) 00000100:00100000:3.0:1746144896.251120:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f385500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175285504:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1591us (1700us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.251127:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5725 00000100:00100000:0.0:1746144896.251493:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.251537:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175285632 00000100:00100000:3.0:1746144896.251541:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175285632 00010000:00010000:3.0:1746144896.251563:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275155eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9504f expref: 66 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.251597:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11141 00000100:00100000:3.0:1746144896.251603:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f385880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175285632:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.251616:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.251636:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275155eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9504f expref: 66 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.251650:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275155eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9504f expref: 66 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.251670:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275155eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9504f expref: 66 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.251682:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.251684:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.251690:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275155f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95056 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.251698:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275155f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95056 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.251722:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275155f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95056 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.251733:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172503936:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.251797:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.253621:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172503936:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.253637:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.253679:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f385880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1984:x1830965175285632:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2073us (2184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.253687:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11141 00000100:00100000:0.0:1746144896.254484:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.254674:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175285888 00000100:00100000:3.0:1746144896.254680:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175285888 00002000:00100000:3.0:1746144896.254716:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f385c00 x1830965175285888/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.254726:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f385c00 with x1830965175285888 ext(0->4095) 00002000:00010000:3.0:1746144896.254731:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f385c00 00000100:00100000:3.0:1746144896.254758:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4153 00000100:00100000:3.0:1746144896.254784:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175285888:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.254973:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f385c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175285888:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 189us (490us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.254979:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4153 00002000:00100000:3.0:1746144896.254984:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f385c00 x1830965175285888/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.254991:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f385c00 with x1830965175285888 ext(0->4095) 00002000:00010000:3.0:1746144896.254994:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f385c00 00000100:00100000:0.0:1746144896.256375:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.256446:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175286016 00000100:00100000:3.0:1746144896.256451:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175286016 00000100:00100000:3.0:1746144896.256680:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5726 00000100:00100000:3.0:1746144896.256688:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+65:31579:x1830965175286016:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.256703:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.256719:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9505d expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.256746:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275155f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95056 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.256756:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.256757:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.256760:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9505d expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.256801:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275155f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95056 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.256809:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275155f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95056 expref: 5 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.256817:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172504064:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.256892:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.257661:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172504064:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.257678:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9505d expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.257690:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:3.0:1746144896.257714:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31579:x1830965175286016:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1026us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.257721:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5726 00000100:00100000:0.0:1746144896.258084:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.258217:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175286144 00000100:00100000:3.0:1746144896.258222:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175286144 00000100:00100000:3.0:1746144896.258256:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5727 00000100:00100000:3.0:1746144896.258262:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31565:x1830965175286144:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.258273:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.258282:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95064 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.258299:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.258302:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9505d expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.258307:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.258310:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95064 expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.258330:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9505d expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.258339:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95064 expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.258346:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:3.0:1746144896.258492:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f386300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+67:31565:x1830965175286144:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 218us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.258503:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5727 00000100:00100000:0.0:1746144896.258621:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.258708:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175286272 00000100:00100000:3.0:1746144896.258715:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175286272 00010000:00010000:3.0:1746144896.258741:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275155f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95056 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.258801:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11142 00000100:00100000:3.0:1746144896.258808:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f386680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175286272:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.258823:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.258840:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275155f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95056 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.258851:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275155f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95056 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.258869:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af67275155f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95056 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.258892:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.258894:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.258900:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9505d expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.258907:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9505d expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.258948:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9505d expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.258958:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9505d expref: 66 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.258967:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172504320:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.259392:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.261294:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.261353:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175286528 00000100:00100000:1.0:1746144896.261359:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175286528 00002000:00100000:1.0:1746144896.261397:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f386a00 x1830965175286528/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.261407:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f386a00 with x1830965175286528 ext(0->4095) 00010000:00010000:1.0:1746144896.261416:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9505d expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.261427:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9505d expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.261433:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f386a00 00000100:00100000:1.0:1746144896.261464:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2188 00000100:00100000:1.0:1746144896.261472:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175286528:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144896.261641:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f386a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175286528:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 170us (353us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.261647:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2188 00002000:00100000:1.0:1746144896.261652:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f386a00 x1830965175286528/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.261658:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f386a00 with x1830965175286528 ext(0->4095) 00010000:00010000:1.0:1746144896.261668:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9505d expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.261677:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9505d expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.261683:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f386a00 00000100:00100000:3.0:1746144896.261861:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172504320:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.261876:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.261902:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f386680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175286272:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3095us (3281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.261910:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11142 00000100:00100000:0.0:1746144896.262752:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.263370:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.264098:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175286784 00000100:00100000:3.0:1746144896.264105:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175286784 00000100:00100000:3.0:1746144896.264184:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5728 00000100:00100000:3.0:1746144896.264193:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175286784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.264208:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144896.264213:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175286656 00000100:00100000:2.0:1746144896.264218:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175286656 00010000:00010000:3.0:1746144896.264225:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9506b expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.264242:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9505d expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.264250:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.264256:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95064 expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.264260:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11143 00010000:00010000:3.0:1746144896.264262:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00000100:00100000:2.0:1746144896.264265:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f387100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1983:x1830965175286656:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.264266:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9506b expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.264275:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.264294:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9505d expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.264304:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95064 expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.264305:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9505d expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.264322:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275155f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9505d expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.264389:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9506b expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.264398:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.264400:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.264405:0:8430:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95064 expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.264412:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95064 expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.264428:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144896.264429:0:8430:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95064 expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.264440:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95064 expref: 66 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.264452:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172504576:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.264595:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f387100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1983:x1830965175286656:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 329us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.264601:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11143 00000100:00100000:3.0:1746144896.264706:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.267058:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172504576:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144896.267061:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:3.0:1746144896.267075:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:3.0:1746144896.267114:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f386d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175286784:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2921us (4363us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.267121:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5728 00000100:00100000:2.0:1746144896.267269:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175287040 00000100:00100000:2.0:1746144896.267275:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175287040 00002000:00100000:2.0:1746144896.267315:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f387480 x1830965175287040/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.267323:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f387480 with x1830965175287040 ext(0->4095) 00010000:00010000:2.0:1746144896.267332:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95064 expref: 66 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.267342:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95064 expref: 66 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.267347:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f387480 00000100:00100000:2.0:1746144896.267370:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2189 00000100:00100000:2.0:1746144896.267377:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1985:x1830965175287040:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144896.267545:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f387480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1985:x1830965175287040:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 168us (486us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.267667:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2189 00002000:00100000:2.0:1746144896.267673:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f387480 x1830965175287040/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.267681:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f387480 with x1830965175287040 ext(0->4095) 00010000:00010000:2.0:1746144896.267686:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95064 expref: 66 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.267695:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95064 expref: 66 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.267700:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f387480 00000100:00100000:0.0:1746144896.269699:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.269740:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.269759:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175287168 00000100:00100000:3.0:1746144896.269788:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175287168 00000100:00100000:3.0:1746144896.269826:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5729 00000100:00100000:3.0:1746144896.269832:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31565:x1830965175287168:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.269845:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.269860:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751560e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95072 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.269890:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.269896:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9506b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.269902:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144896.269905:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751560e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95072 expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.269952:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9506b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.269963:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751560e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95072 expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.269973:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:2.0:1746144896.269985:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175287296 00000100:00100000:2.0:1746144896.269988:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175287296 00010000:00010000:2.0:1746144896.270008:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95064 expref: 68 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.270016:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f387800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+68:31565:x1830965175287168:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 185us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.270022:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5729 00000100:00100000:2.0:1746144896.270030:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11144 00000100:00100000:2.0:1746144896.270035:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f387b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1985:x1830965175287296:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.270043:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.270176:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95064 expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.270187:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95064 expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.270205:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515600 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95064 expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.270215:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.270216:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.270222:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9506b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.270230:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9506b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.270249:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9506b expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.270259:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9506b expref: 5 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.270275:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172504832:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.271170:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.274662:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.274684:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172504832:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.274711:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.274786:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f387b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1985:x1830965175287296:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4727us (5022us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.274794:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175287552 00000100:00100000:2.0:1746144896.274796:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11144 00000100:00100000:3.0:1746144896.274801:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175287552 00002000:00100000:3.0:1746144896.274837:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f384000 x1830965175287552/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.274846:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f384000 with x1830965175287552 ext(0->4095) 00010000:00010000:3.0:1746144896.274854:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9506b expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.274870:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9506b expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.274875:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f384000 00000100:00100000:3.0:1746144896.274890:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2190 00000100:00100000:3.0:1746144896.274895:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175287552:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.275071:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175287552:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 175us (419us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.275077:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2190 00002000:00100000:3.0:1746144896.275083:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f384000 x1830965175287552/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.275089:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f384000 with x1830965175287552 ext(0->4095) 00010000:00010000:3.0:1746144896.275093:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9506b expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.275101:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9506b expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.275106:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f384000 00000100:00100000:0.0:1746144896.277896:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.277966:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175287680 00000100:00100000:2.0:1746144896.277973:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175287680 00010000:00010000:2.0:1746144896.278011:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9506b expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.278046:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11145 00000100:00100000:2.0:1746144896.278053:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175287680:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.278065:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.278086:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9506b expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.278097:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9506b expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.278120:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af6727515607 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9506b expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.278149:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.278153:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.278164:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751560e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95072 expref: 65 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.278172:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751560e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95072 expref: 65 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.278207:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751560e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95072 expref: 65 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.278222:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172504960:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.278297:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.279961:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172504960:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.279983:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.280026:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175287680:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1973us (2137us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.280036:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11145 00000100:00100000:0.0:1746144896.280945:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.281015:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175287936 00000100:00100000:1.0:1746144896.281021:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175287936 00002000:00100000:1.0:1746144896.281058:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ec000 x1830965175287936/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.281072:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ec000 with x1830965175287936 ext(0->4095) 00002000:00010000:1.0:1746144896.281076:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935ec000 00000100:00100000:1.0:1746144896.281105:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4154 00000100:00100000:1.0:1746144896.281113:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175287936:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144896.281275:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175287936:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 163us (332us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.281281:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4154 00002000:00100000:1.0:1746144896.281286:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ec000 x1830965175287936/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.281292:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ec000 with x1830965175287936 ext(0->4095) 00002000:00010000:1.0:1746144896.281294:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935ec000 00000100:00100000:0.0:1746144896.283436:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.283555:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175288064 00000100:00100000:3.0:1746144896.283561:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175288064 00000100:00100000:3.0:1746144896.283612:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5730 00000100:00100000:3.0:1746144896.283620:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175288064:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.283636:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.283654:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515615 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95079 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.283680:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751560e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95072 expref: 65 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.283687:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.283689:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.283693:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515615 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95079 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.283721:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751560e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95072 expref: 65 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.283733:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751560e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95072 expref: 65 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.283746:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172505088:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.283851:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.285299:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172505088:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.285319:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515615 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95079 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.285331:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:3.0:1746144896.285358:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175288064:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1739us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.285365:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5730 00000100:00100000:0.0:1746144896.286863:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.287383:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175288192 00000100:00100000:2.0:1746144896.287391:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175288192 00010000:00010000:2.0:1746144896.287431:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751560e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95072 expref: 66 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.288025:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11146 00000100:00100000:2.0:1746144896.288036:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1985:x1830965175288192:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.288051:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.288073:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751560e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95072 expref: 66 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.288090:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751560e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95072 expref: 66 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.288115:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751560e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95072 expref: 66 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.288267:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.288270:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.288278:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515615 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95079 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.288285:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515615 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95079 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.288316:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515615 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95079 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.288327:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172505216:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.288406:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.291131:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.291256:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172505216:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.291283:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.291325:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+65:1985:x1830965175288192:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3291us (4468us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.291335:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11146 00000100:00100000:3.0:1746144896.291486:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175288448 00000100:00100000:3.0:1746144896.291494:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175288448 00002000:00100000:3.0:1746144896.291532:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935eca80 x1830965175288448/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.291542:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935eca80 with x1830965175288448 ext(0->4095) 00002000:00010000:3.0:1746144896.291546:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935eca80 00000100:00100000:0.0:1746144896.291678:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.291797:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175288576 00000100:00100000:2.0:1746144896.291801:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175288576 00000100:00100000:2.0:1746144896.291822:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5731 00000100:00100000:2.0:1746144896.291828:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+65:31565:x1830965175288576:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.291841:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.291857:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95080 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.291883:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515615 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95079 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.291890:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.291892:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.291895:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.291935:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515615 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95079 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.291947:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515615 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95079 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.291957:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172505344:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.291970:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2191 00000100:00100000:3.0:1746144896.291975:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175288448:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144896.291998:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.292415:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175288448:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 439us (1293us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.292421:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2191 00002000:00100000:3.0:1746144896.292426:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935eca80 x1830965175288448/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.292434:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935eca80 with x1830965175288448 ext(0->4095) 00010000:00010000:3.0:1746144896.292439:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515615 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95079 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.292449:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515615 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95079 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.292454:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935eca80 00000100:00100000:0.0:1746144896.294737:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.295120:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.295196:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175288832 00000100:00100000:3.0:1746144896.295203:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175288832 00000100:00100000:2.0:1746144896.295218:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172505344:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.295232:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515615 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95079 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.295245:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.295258:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11147 00010000:00010000:2.0:1746144896.295262:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e5c00, rc 0) 00000100:00100000:3.0:1746144896.295264:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175288832:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.295273:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.295294:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515615 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95079 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.295298:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31565:x1830965175288576:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3470us (3620us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144896.295303:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515615 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95079 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.295304:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5731 00000100:00100000:2.0:1746144896.295320:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175288704 00000100:00100000:2.0:1746144896.295322:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175288704 00010000:00010000:3.0:1746144896.295323:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515615 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95079 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.295343:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.295345:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.295352:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.295357:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5732 00010000:00010000:3.0:1746144896.295360:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.295362:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+66:31579:x1830965175288704:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.295373:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.295381:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95087 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.295396:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.295402:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.295403:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.295406:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95087 expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.296061:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.296073:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.296089:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172505472:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.296284:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.296295:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.296309:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172505600:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.296374:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.296378:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.298162:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172505472:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.298177:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.298221:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175288832:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2955us (3099us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.298232:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11147 00000100:00100000:2.0:1746144896.298873:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.299124:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175289088 00000100:00100000:3.0:1746144896.299130:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175289088 00000100:00100000:0.0:1746144896.299162:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008a096d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172505600:192.168.202.16@tcp:104: 00002000:00100000:3.0:1746144896.299176:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925ab800 x1830965175289088/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.299186:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab800 with x1830965175289088 ext(0->4095) 00010000:00010000:0.0:1746144896.299186:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95087 expref: 68 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.299193:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 68 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:0.0:1746144896.299200:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e4400, rc 0) 00010000:00010000:3.0:1746144896.299206:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 68 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.299212:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925ab800 00000100:00100000:0.0:1746144896.299268:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+68:31579:x1830965175288704:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3905us (4539us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144896.299275:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5732 00000100:00100000:3.0:1746144896.299324:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2192 00000100:00100000:3.0:1746144896.299331:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175289088:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.299485:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1984:x1830965175289088:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 154us (612us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.299495:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2192 00002000:00100000:3.0:1746144896.299500:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925ab800 x1830965175289088/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.299507:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab800 with x1830965175289088 ext(0->4095) 00010000:00010000:3.0:1746144896.299512:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.299521:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.299528:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925ab800 00000100:00100000:0.0:1746144896.301601:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.302306:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175289216 00000100:00100000:3.0:1746144896.302314:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175289216 00010000:00010000:3.0:1746144896.302346:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.302379:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11148 00000100:00100000:3.0:1746144896.302385:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1985:x1830965175289216:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.302396:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.302417:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.302429:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.302450:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751561c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95080 expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.302474:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.302477:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.302483:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95087 expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.302490:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95087 expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.302521:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95087 expref: 66 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.302530:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172505728:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.302613:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd423c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.306045:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172505728:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.306067:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.306110:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1985:x1830965175289216:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3723us (4515us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.306121:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11148 00000100:00100000:0.0:1746144896.307508:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.307718:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175289472 00000100:00100000:3.0:1746144896.307727:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175289472 00002000:00100000:3.0:1746144896.307801:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ed880 x1830965175289472/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.307812:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ed880 with x1830965175289472 ext(0->4095) 00002000:00010000:3.0:1746144896.307816:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935ed880 00000100:00100000:3.0:1746144896.307845:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4156 00000100:00100000:3.0:1746144896.307853:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175289472:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.308042:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175289472:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 188us (539us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.308048:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4156 00002000:00100000:3.0:1746144896.308053:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ed880 x1830965175289472/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.308060:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ed880 with x1830965175289472 ext(0->4095) 00002000:00010000:3.0:1746144896.308063:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935ed880 00000100:00100000:0.0:1746144896.313017:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.313205:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175289600 00000100:00100000:2.0:1746144896.313214:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175289600 00000100:00100000:2.0:1746144896.313276:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5733 00000100:00100000:2.0:1746144896.313284:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175289600:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.313301:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.313321:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af672751562a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9508e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.313349:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95087 expref: 65 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.313357:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.313359:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.313363:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af672751562a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9508e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.313392:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95087 expref: 65 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.313405:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95087 expref: 65 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.313416:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172505856:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.313497:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.317659:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.317723:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175289856 00000100:00100000:3.0:1746144896.317733:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175289856 00002000:00100000:3.0:1746144896.317805:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800935edf80 x1830965175289856/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00000100:00100000:2.0:1746144896.317836:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172505856:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.317869:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af672751562a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9508e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.317885:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e5200, rc 0) 00000100:00100000:2.0:1746144896.317940:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175289600:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4656us (4933us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.317949:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5733 00002000:00100000:3.0:1746144896.318564:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935edf80 with x1830965175289856 ext(0->7) 00010000:00010000:3.0:1746144896.318572:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95087 expref: 66 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.318585:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95087 expref: 66 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.318591:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935edf80 00000100:00100000:3.0:1746144896.318622:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2193 00000100:00100000:3.0:1746144896.318628:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+66:1984:x1830965175289856:12345-192.168.202.16@tcp:4:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.318989:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+68:1984:x1830965175289856:12345-192.168.202.16@tcp:4:ptlrpcd_01_00.0 Request processed in 360us (1340us total) trans 4294968040 rc 0/0 00000100:00100000:3.0:1746144896.318998:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2193 00002000:00100000:3.0:1746144896.319005:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800935edf80 x1830965175289856/t4294968040(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/448 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 0/0 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.319012:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935edf80 with x1830965175289856 ext(0->7) 00010000:00010000:3.0:1746144896.319016:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95087 expref: 68 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.319025:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95087 expref: 68 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.319030:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935edf80 00000100:00100000:0.0:1746144896.323962:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.324646:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175289984 00000100:00100000:3.0:1746144896.324657:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175289984 00010000:00010000:3.0:1746144896.324697:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95087 expref: 68 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.324737:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11149 00000100:00100000:3.0:1746144896.324745:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+68:1983:x1830965175289984:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.324783:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.324805:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95087 expref: 68 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.324819:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95087 expref: 68 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.324842:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515623 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95087 expref: 68 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.324874:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.324876:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.324884:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af672751562a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9508e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.324892:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af672751562a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9508e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.324936:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af672751562a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9508e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.324948:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172505984:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.325039:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.329487:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.329677:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172505984:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.329698:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.329744:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+67:1983:x1830965175289984:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4999us (5793us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.329755:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11149 00000100:00100000:1.0:1746144896.330202:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175290240 00000100:00100000:1.0:1746144896.330210:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175290240 00002000:00100000:1.0:1746144896.330251:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880098df4450 x1830965175290240/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.330259:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098df4450 with x1830965175290240 ext(0->4095) 00002000:00010000:1.0:1746144896.330264:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098df4450 00000100:00100000:1.0:1746144896.330291:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4157 00000100:00100000:1.0:1746144896.330297:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098df4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175290240:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:1.0:1746144896.330461:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098df4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175290240:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 164us (986us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.330468:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4157 00002000:00100000:1.0:1746144896.330473:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880098df4450 x1830965175290240/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.330479:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098df4450 with x1830965175290240 ext(0->4095) 00002000:00010000:1.0:1746144896.330482:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098df4450 00000100:00100000:0.0:1746144896.335476:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.335569:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175290368 00000100:00100000:2.0:1746144896.335582:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175290368 00000100:00100000:2.0:1746144896.335635:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5734 00000100:00100000:2.0:1746144896.335643:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+67:31579:x1830965175290368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.335659:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.335672:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95095 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.335697:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af672751562a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9508e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.335703:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.335704:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.335707:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95095 expref: 68 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.335733:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af672751562a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9508e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.335747:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af672751562a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9508e expref: 5 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.335756:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172506112:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.335872:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.338702:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172506112:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.338741:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95095 expref: 68 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.338758:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e5c00, rc 0) 00000100:00100000:2.0:1746144896.340395:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+68:31579:x1830965175290368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4743us (4920us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.340407:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5734 00000100:00100000:0.0:1746144896.340742:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.341800:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.342127:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175290624 00000100:00100000:2.0:1746144896.342135:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175290624 00010000:00010000:2.0:1746144896.342172:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af672751562a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9508e expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.342195:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11150 00000100:00100000:2.0:1746144896.342201:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175290624:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.342211:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.342231:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af672751562a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9508e expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.342247:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af672751562a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9508e expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.342272:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af672751562a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9508e expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.342302:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.342304:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.342311:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95095 expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.342318:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95095 expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.342351:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95095 expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.342362:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172506240:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.342430:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.342798:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175290496 00000100:00100000:3.0:1746144896.342803:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175290496 00000100:00100000:3.0:1746144896.342837:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5735 00000100:00100000:3.0:1746144896.342843:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+68:31565:x1830965175290496:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.342856:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.342867:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9509c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.342891:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95095 expref: 69 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.342897:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.342898:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.342901:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9509c expref: 69 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.342930:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95095 expref: 69 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.342941:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95095 expref: 69 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.342950:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172506368:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.342982:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.345567:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172506368:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.345594:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9509c expref: 69 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.345609:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:3.0:1746144896.345649:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+69:31565:x1830965175290496:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2806us (4908us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.345657:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5735 00000100:00100000:2.0:1746144896.345993:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172506240:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.346010:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.346030:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175290624:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3829us (4233us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.346038:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11150 00000100:00100000:0.0:1746144896.346262:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.346654:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175290880 00000100:00100000:2.0:1746144896.346662:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175290880 00002000:00100000:2.0:1746144896.346698:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ef100 x1830965175290880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.346708:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ef100 with x1830965175290880 ext(0->4095) 00010000:00010000:2.0:1746144896.346715:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95095 expref: 69 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.346728:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95095 expref: 69 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.346734:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935ef100 00000100:00100000:2.0:1746144896.346967:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2194 00000100:00100000:2.0:1746144896.346976:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+69:1984:x1830965175290880:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144896.347170:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+69:1984:x1830965175290880:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 195us (908us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.347176:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2194 00002000:00100000:2.0:1746144896.347182:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ef100 x1830965175290880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.347188:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ef100 with x1830965175290880 ext(0->4095) 00010000:00010000:2.0:1746144896.347192:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95095 expref: 69 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.347201:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95095 expref: 69 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.347206:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935ef100 00000100:00100000:0.0:1746144896.350567:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.350753:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175291008 00000100:00100000:3.0:1746144896.350777:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175291008 00000100:00100000:3.0:1746144896.350822:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5736 00000100:00100000:3.0:1746144896.350829:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175291008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.350844:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.350858:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af950a3 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.350880:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.350885:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9509c expref: 68 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.350890:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144896.350894:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950a3 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.350934:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9509c expref: 68 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.350944:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950a3 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144896.351149:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.351730:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175291136 00000100:00100000:2.0:1746144896.351735:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175291136 00010000:00010000:2.0:1746144896.351753:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95095 expref: 69 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.351798:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11151 00000100:00100000:2.0:1746144896.351805:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+69:1983:x1830965175291136:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.351813:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.351831:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95095 expref: 69 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.351846:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95095 expref: 69 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.351862:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515631 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95095 expref: 69 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.351877:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.351879:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.351884:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9509c expref: 68 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.351890:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9509c expref: 68 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.351924:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9509c expref: 68 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.351936:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9509c expref: 68 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.351946:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172506624:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.352006:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00010000:00010000:3.0:1746144896.352064:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:3.0:1746144896.352085:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175291008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1257us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.352091:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5736 00000100:00100000:2.0:1746144896.356736:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172506624:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.356758:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.357271:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+68:1983:x1830965175291136:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5465us (6120us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.357280:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11151 00000100:00100000:0.0:1746144896.359509:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.359669:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175291392 00000100:00100000:2.0:1746144896.359677:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175291392 00002000:00100000:2.0:1746144896.359714:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ef800 x1830965175291392/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.359723:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ef800 with x1830965175291392 ext(0->4095) 00010000:00010000:2.0:1746144896.359732:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9509c expref: 68 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.359744:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9509c expref: 68 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.359750:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935ef800 00000100:00100000:2.0:1746144896.359807:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2195 00000100:00100000:2.0:1746144896.359814:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+68:1984:x1830965175291392:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144896.359973:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+68:1984:x1830965175291392:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 159us (468us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.359979:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2195 00002000:00100000:2.0:1746144896.359985:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ef800 x1830965175291392/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.359992:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ef800 with x1830965175291392 ext(0->4095) 00010000:00010000:2.0:1746144896.359997:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9509c expref: 68 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.360005:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9509c expref: 68 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.360011:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935ef800 00000100:00100000:0.0:1746144896.364620:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.364726:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.364814:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175291520 00000100:00100000:2.0:1746144896.364826:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175291520 00000100:00100000:3.0:1746144896.364996:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175291648 00000100:00100000:2.0:1746144896.364999:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5737 00000100:00100000:3.0:1746144896.365005:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175291648 00000100:00100000:2.0:1746144896.365008:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+68:31565:x1830965175291520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.365024:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.365035:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9509c expref: 69 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.365039:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af950aa expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.365061:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746144896.365067:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11152 00010000:00010000:2.0:1746144896.365067:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950a3 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.365073:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00000100:00100000:3.0:1746144896.365074:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1984:x1830965175291648:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.365076:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950aa expref: 70 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.365086:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.365107:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950a3 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.365108:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9509c expref: 70 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.365121:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9509c expref: 70 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.365215:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950aa expref: 70 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.365229:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515638 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9509c expref: 70 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.365234:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.365235:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.365240:0:8430:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950a3 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.365246:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950a3 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.365260:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144896.365291:0:8430:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950a3 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.365301:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950a3 expref: 5 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.365312:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172506880:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.365333:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+69:1984:x1830965175291648:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 259us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.365340:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11152 00000100:00100000:2.0:1746144896.365569:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.368580:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172506880:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.368607:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e5200, rc 0) 00000100:00100000:2.0:1746144896.369471:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+68:31565:x1830965175291520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4461us (4859us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.369481:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5737 00000100:00100000:1.0:1746144896.369805:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.369928:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175291904 00000100:00100000:2.0:1746144896.369935:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175291904 00002000:00100000:2.0:1746144896.369976:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5f800 x1830965175291904/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.369987:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5f800 with x1830965175291904 ext(0->4095) 00010000:00010000:2.0:1746144896.369995:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950a3 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.370009:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950a3 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.370015:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5f800 00000100:00100000:2.0:1746144896.370043:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2196 00000100:00100000:2.0:1746144896.370050:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175291904:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144896.370219:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175291904:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 170us (416us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.370225:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2196 00002000:00100000:2.0:1746144896.370230:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5f800 x1830965175291904/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.370237:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5f800 with x1830965175291904 ext(0->4095) 00010000:00010000:2.0:1746144896.370241:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950a3 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.370254:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950a3 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.370259:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5f800 00000100:00100000:0.0:1746144896.372607:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.372694:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175292032 00000100:00100000:2.0:1746144896.372701:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175292032 00010000:00010000:2.0:1746144896.372734:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950a3 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.373015:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11153 00000100:00100000:3.0:1746144896.373024:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175292032:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.373038:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.373058:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950a3 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.373070:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950a3 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.373098:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af672751563f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950a3 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.373127:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.373129:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.373137:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950aa expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.373146:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950aa expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.373178:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950aa expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.373191:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172507008:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.373269:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42180 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.374600:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172507008:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.374615:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.374644:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175292032:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1621us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.374652:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11153 00000100:00100000:0.0:1746144896.375528:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.376207:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175292288 00000100:00100000:3.0:1746144896.376214:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175292288 00002000:00100000:3.0:1746144896.376256:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ed180 x1830965175292288/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.376267:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ed180 with x1830965175292288 ext(0->4095) 00002000:00010000:3.0:1746144896.376272:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935ed180 00000100:00100000:3.0:1746144896.376490:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4158 00000100:00100000:3.0:1746144896.376500:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+68:1985:x1830965175292288:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144896.377531:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+68:1985:x1830965175292288:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1029us (2002us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.377539:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4158 00002000:00100000:3.0:1746144896.377547:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ed180 x1830965175292288/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.377555:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ed180 with x1830965175292288 ext(0->4095) 00002000:00010000:3.0:1746144896.377559:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935ed180 00000100:00100000:0.0:1746144896.388090:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.389624:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175292416 00000100:00100000:2.0:1746144896.389637:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175292416 00000100:00100000:2.0:1746144896.389700:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5738 00000100:00100000:2.0:1746144896.390842:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175292416:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.390882:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.390901:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af950b1 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.390942:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950aa expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.390950:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.390952:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.390956:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b1 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.390990:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950aa expref: 67 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.391003:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950aa expref: 67 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.391014:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172507136:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.391121:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.392694:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172507136:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.392722:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b1 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.392736:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e4400, rc 0) 00000100:00100000:2.0:1746144896.393485:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175292416:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2651us (5401us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.393494:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5738 00000100:00100000:0.0:1746144896.403835:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.404054:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175292544 00000100:00100000:3.0:1746144896.404065:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175292544 00002000:00100000:3.0:1746144896.404114:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800935ee680 x1830965175292544/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.404124:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ee680 with x1830965175292544 ext(0->7) 00010000:00010000:3.0:1746144896.404134:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950aa expref: 68 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.404147:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950aa expref: 68 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.404154:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935ee680 00000100:00100000:3.0:1746144896.404184:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2197 00000100:00100000:3.0:1746144896.404191:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+68:1983:x1830965175292544:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144896.404527:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1983:x1830965175292544:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 335us (706us total) trans 4294968041 rc 0/0 00000100:00100000:3.0:1746144896.404533:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2197 00002000:00100000:3.0:1746144896.404538:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800935ee680 x1830965175292544/t4294968041(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/448 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.404551:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ee680 with x1830965175292544 ext(0->7) 00010000:00010000:3.0:1746144896.404555:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950aa expref: 70 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.404563:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950aa expref: 70 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.404569:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935ee680 00000100:00100000:0.0:1746144896.413575:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.413658:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175292672 00000100:00100000:2.0:1746144896.413668:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175292672 00010000:00010000:2.0:1746144896.413713:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950aa expref: 70 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.413743:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11154 00000100:00100000:2.0:1746144896.413751:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1982:x1830965175292672:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.413788:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.413812:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950aa expref: 70 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.413825:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950aa expref: 70 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.413849:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515646 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950aa expref: 70 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.413882:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.413885:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.413891:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.413899:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.413955:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.413967:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172507264:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.414044:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.420087:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.420197:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175292800 00000100:00100000:2.0:1746144896.420208:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175292800 00000100:00100000:2.0:1746144896.420277:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5739 00000100:00100000:2.0:1746144896.420287:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+70:31565:x1830965175292800:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.420316:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.420338:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af950b8 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.420368:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.420376:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.420378:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.420382:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b8 expref: 71 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.420415:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b1 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.420427:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b1 expref: 5 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.420439:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172507392:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.420522:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.422496:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.422592:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172507392:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144896.422625:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b8 expref: 71 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.422640:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e5200, rc 0) 00000100:00100000:3.0:1746144896.422746:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175293056 00000100:00100000:3.0:1746144896.422753:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175293056 00002000:00100000:3.0:1746144896.422820:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ec000 x1830965175293056/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.422829:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ec000 with x1830965175293056 ext(0->4095) 00010000:00010000:3.0:1746144896.422835:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b1 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.422845:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b1 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.422851:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935ec000 00000100:00100000:3.0:1746144896.422868:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2198 00000100:00100000:3.0:1746144896.422875:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175293056:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144896.423155:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172507264:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.423167:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144896.424366:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+71:31565:x1830965175292800:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4074us (4285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144896.424376:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5739 00000100:00100000:3.0:1746144896.424490:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175293056:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1613us (2000us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.424496:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2198 00002000:00100000:3.0:1746144896.424505:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ec000 x1830965175293056/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.424513:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ec000 with x1830965175293056 ext(0->4095) 00010000:00010000:3.0:1746144896.424520:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b1 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.424532:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b1 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.424538:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935ec000 00000100:00100000:2.0:1746144896.425091:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1982:x1830965175292672:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 11339us (11524us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.425100:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11154 00000100:00100000:0.0:1746144896.428911:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.429557:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175293184 00000100:00100000:2.0:1746144896.429568:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175293184 00010000:00010000:2.0:1746144896.429617:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b1 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.429802:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11155 00000100:00100000:2.0:1746144896.429812:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175293184:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.429826:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.429848:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b1 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.429862:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b1 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.429885:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af672751564d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b1 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.431385:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.431391:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.431403:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b8 expref: 69 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.431414:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b8 expref: 69 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.431459:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b8 expref: 69 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.431474:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172507520:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.431580:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.434498:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.434653:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175293440 00000100:00100000:3.0:1746144896.434662:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175293440 00002000:00100000:3.0:1746144896.434705:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ed880 x1830965175293440/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.434715:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ed880 with x1830965175293440 ext(0->4095) 00002000:00010000:3.0:1746144896.434720:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935ed880 00000100:00100000:3.0:1746144896.434738:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4159 00000100:00100000:3.0:1746144896.434744:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1985:x1830965175293440:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144896.434976:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1985:x1830965175293440:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 230us (486us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.434983:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4159 00002000:00100000:3.0:1746144896.434988:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ed880 x1830965175293440/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.434995:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ed880 with x1830965175293440 ext(0->4095) 00002000:00010000:3.0:1746144896.434998:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935ed880 00000100:00100000:2.0:1746144896.435092:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172507520:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.435116:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.435137:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175293184:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5328us (6239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.435144:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11155 00000100:00100000:0.0:1746144896.442264:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.442367:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175293568 00000100:00100000:2.0:1746144896.442376:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175293568 00000100:00100000:2.0:1746144896.442434:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5740 00000100:00100000:2.0:1746144896.442443:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175293568:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.442461:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.442479:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751565b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af950bf expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.442509:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b8 expref: 69 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.442516:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.442518:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.442521:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751565b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950bf expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.442549:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b8 expref: 69 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.442561:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b8 expref: 69 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.442571:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172507648:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.445205:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.445245:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172507648:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.445279:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751565b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950bf expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.445295:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e5c00, rc 0) 00000100:00100000:2.0:1746144896.445337:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175293568:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2894us (3085us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.445346:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5740 00000100:00100000:0.0:1746144896.448201:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.448384:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175293696 00000100:00100000:1.0:1746144896.448394:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175293696 00002000:00100000:1.0:1746144896.448438:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800935ec700 x1830965175293696/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.448449:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ec700 with x1830965175293696 ext(0->7) 00010000:00010000:1.0:1746144896.448457:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b8 expref: 70 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.448471:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b8 expref: 70 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.448477:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935ec700 00000100:00100000:1.0:1746144896.448735:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2199 00000100:00100000:1.0:1746144896.448743:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+70:1985:x1830965175293696:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144896.449240:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1985:x1830965175293696:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 496us (1048us total) trans 4294968042 rc 0/0 00000100:00100000:1.0:1746144896.449246:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2199 00002000:00100000:1.0:1746144896.449251:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800935ec700 x1830965175293696/t4294968042(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/448 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.449258:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ec700 with x1830965175293696 ext(0->7) 00010000:00010000:1.0:1746144896.449263:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b8 expref: 72 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.449271:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b8 expref: 72 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.449277:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935ec700 00000100:00100000:0.0:1746144896.452474:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.452685:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175293824 00000100:00100000:2.0:1746144896.452694:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175293824 00010000:00010000:2.0:1746144896.452736:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b8 expref: 72 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.452788:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11156 00000100:00100000:2.0:1746144896.452798:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1985:x1830965175293824:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.452812:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.452833:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b8 expref: 72 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.452845:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b8 expref: 72 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.452867:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5200/0x4076af6727515654 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950b8 expref: 72 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.452904:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.452906:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.452923:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751565b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950bf expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.452931:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751565b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950bf expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.452965:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751565b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950bf expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.452976:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172507776:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.453063:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.458231:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.458383:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172507776:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.458409:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.458451:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+71:1985:x1830965175293824:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5655us (5986us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.458463:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11156 00000100:00100000:1.0:1746144896.458537:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175294080 00000100:00100000:1.0:1746144896.458544:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175294080 00002000:00100000:1.0:1746144896.458578:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ee300 x1830965175294080/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.458588:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ee300 with x1830965175294080 ext(0->4095) 00002000:00010000:1.0:1746144896.458593:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935ee300 00000100:00100000:1.0:1746144896.458947:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4160 00000100:00100000:1.0:1746144896.458954:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175294080:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144896.459122:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175294080:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 169us (902us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.459128:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4160 00002000:00100000:1.0:1746144896.459133:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ee300 x1830965175294080/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.459140:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ee300 with x1830965175294080 ext(0->4095) 00002000:00010000:1.0:1746144896.459143:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935ee300 00000100:00100000:0.0:1746144896.463401:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.463674:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175294208 00000100:00100000:2.0:1746144896.463684:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175294208 00000100:00100000:2.0:1746144896.463745:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5741 00000100:00100000:2.0:1746144896.463753:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+71:31565:x1830965175294208:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.463799:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.463816:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af950c6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.463848:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751565b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950bf expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.463855:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.463857:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.463860:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950c6 expref: 72 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.463889:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751565b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950bf expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.463901:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751565b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950bf expref: 5 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.463927:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172507904:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.464012:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.464070:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.464194:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175294336 00000100:00100000:3.0:1746144896.464198:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175294336 00000100:00100000:3.0:1746144896.464220:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5742 00000100:00100000:3.0:1746144896.464225:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+73:31579:x1830965175294336:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.464231:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.464237:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515669 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af950cd expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.464249:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.464254:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950c6 expref: 74 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.464259:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.464262:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515669 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950cd expref: 74 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.464282:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950c6 expref: 74 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.464293:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515669 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950cd expref: 74 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.464302:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:3.0:1746144896.464328:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+74:31579:x1830965175294336:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 102us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.464333:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5742 00000100:00100000:2.0:1746144896.466878:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172507904:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.466922:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950c6 expref: 73 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.466937:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e4e00, rc 0) 00000100:00100000:2.0:1746144896.466978:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+73:31565:x1830965175294208:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3225us (3586us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.466986:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5741 00000100:00100000:0.0:1746144896.468110:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.468388:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175294464 00000100:00100000:2.0:1746144896.468396:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175294464 00010000:00010000:2.0:1746144896.468426:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751565b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950bf expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.468459:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11157 00000100:00100000:2.0:1746144896.468466:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175294464:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.468479:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.468501:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751565b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950bf expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.468511:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751565b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950bf expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.468535:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af672751565b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950bf expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.468566:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.468568:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.468576:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950c6 expref: 72 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.468585:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950c6 expref: 72 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.468615:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950c6 expref: 72 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.468625:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950c6 expref: 72 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.468636:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172508160:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.468712:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.470606:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172508160:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.470899:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.471414:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175294464:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2945us (3301us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.471425:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11157 00000100:00100000:0.0:1746144896.471887:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.472068:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175294720 00000100:00100000:3.0:1746144896.472075:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175294720 00002000:00100000:3.0:1746144896.472116:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ece00 x1830965175294720/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.472124:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ece00 with x1830965175294720 ext(0->4095) 00010000:00010000:3.0:1746144896.472133:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950c6 expref: 73 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.472144:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950c6 expref: 73 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.472150:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935ece00 00000100:00100000:3.0:1746144896.472353:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2200 00000100:00100000:3.0:1746144896.472361:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+73:1984:x1830965175294720:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.472518:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+73:1984:x1830965175294720:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 158us (632us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.472523:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2200 00002000:00100000:3.0:1746144896.472528:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800935ece00 x1830965175294720/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.472534:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935ece00 with x1830965175294720 ext(0->4095) 00010000:00010000:3.0:1746144896.472539:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950c6 expref: 73 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.472547:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950c6 expref: 73 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.472552:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800935ece00 00000100:00100000:0.0:1746144896.476472:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.477062:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175294848 00000100:00100000:2.0:1746144896.477072:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175294848 00010000:00010000:2.0:1746144896.477114:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950c6 expref: 73 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.477726:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11158 00000100:00100000:2.0:1746144896.477735:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+73:1982:x1830965175294848:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.477749:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.477792:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950c6 expref: 73 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.477805:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950c6 expref: 73 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.477829:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4e00/0x4076af6727515662 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950c6 expref: 73 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.477989:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.477991:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.477999:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515669 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950cd expref: 72 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.478007:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515669 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950cd expref: 72 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.478040:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515669 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950cd expref: 72 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.478052:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172508288:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.478145:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.481013:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.481092:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175295104 00000100:00100000:1.0:1746144896.481100:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175295104 00002000:00100000:1.0:1746144896.481142:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094000 x1830965175295104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.481157:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094000 with x1830965175295104 ext(0->4095) 00002000:00010000:1.0:1746144896.481162:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a094000 00000100:00100000:1.0:1746144896.481192:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4161 00000100:00100000:1.0:1746144896.481199:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+73:1984:x1830965175295104:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144896.481376:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+73:1984:x1830965175295104:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 177us (371us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.481383:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4161 00002000:00100000:1.0:1746144896.481389:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094000 x1830965175295104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.481395:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094000 with x1830965175295104 ext(0->4095) 00002000:00010000:1.0:1746144896.481398:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a094000 00000100:00100000:2.0:1746144896.482005:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172508288:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.482030:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.482065:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1982:x1830965175294848:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4332us (5605us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.482073:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11158 00000100:00100000:0.0:1746144896.485373:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.485545:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175295232 00000100:00100000:2.0:1746144896.485555:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175295232 00000100:00100000:2.0:1746144896.485616:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5743 00000100:00100000:2.0:1746144896.485625:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175295232:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.485643:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.485660:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af950d4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.485690:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515669 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950cd expref: 71 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.485703:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.485705:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.485708:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950d4 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.485738:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515669 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950cd expref: 71 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.485750:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515669 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950cd expref: 71 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.485795:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172508416:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.485891:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.487684:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172508416:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.487713:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950d4 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.487726:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e4400, rc 0) 00000100:00100000:2.0:1746144896.487785:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175295232:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2138us (2400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.487793:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5743 00000100:00100000:0.0:1746144896.489138:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.489248:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175295360 00000100:00100000:2.0:1746144896.489255:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175295360 00010000:00010000:2.0:1746144896.489287:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515669 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950cd expref: 72 pid: 10401 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.489328:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11159 00000100:00100000:2.0:1746144896.489336:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1984:x1830965175295360:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.489349:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.489372:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515669 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950cd expref: 72 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.489383:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515669 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950cd expref: 72 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.489407:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515669 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950cd expref: 72 pid: 10401 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.489439:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.489441:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.489448:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950d4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.489456:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950d4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.489487:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950d4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.489568:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172508544:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.489982:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.491187:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.491410:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175295488 00000100:00100000:2.0:1746144896.491416:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175295488 00000100:00100000:2.0:1746144896.491455:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5744 00000100:00100000:2.0:1746144896.491462:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+72:31565:x1830965175295488:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.491476:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.491490:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af950db expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.491515:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950d4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.491521:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.491523:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.491527:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950db expref: 73 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.491550:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950d4 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.491561:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950d4 expref: 5 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.491570:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172508672:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.492288:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.492361:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172508544:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.492381:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.492405:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+73:1984:x1830965175295360:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3070us (3270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.492414:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11159 00000100:00100000:0.0:1746144896.494154:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.494289:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172508672:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.494319:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950db expref: 72 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.494341:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e5c00, rc 0) 00000100:00100000:2.0:1746144896.494377:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+72:31565:x1830965175295488:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2916us (3192us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.494385:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5744 00000100:00100000:3.0:1746144896.494456:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175295744 00000100:00100000:3.0:1746144896.494461:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175295744 00002000:00100000:3.0:1746144896.494500:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a097800 x1830965175295744/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.494509:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a097800 with x1830965175295744 ext(0->4095) 00010000:00010000:3.0:1746144896.494516:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950d4 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.494528:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950d4 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.494535:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a097800 00000100:00100000:3.0:1746144896.495361:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2201 00000100:00100000:3.0:1746144896.495369:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175295744:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144896.495541:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175295744:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 172us (1393us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.495546:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2201 00002000:00100000:3.0:1746144896.495552:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a097800 x1830965175295744/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.495560:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a097800 with x1830965175295744 ext(0->4095) 00010000:00010000:3.0:1746144896.495566:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950d4 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.495576:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950d4 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.495581:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a097800 00000100:00100000:0.0:1746144896.499999:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.500103:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175295872 00000100:00100000:3.0:1746144896.500113:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175295872 00010000:00010000:3.0:1746144896.500151:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950d4 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.500710:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11160 00000100:00100000:3.0:1746144896.500720:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175295872:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.500737:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.500759:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950d4 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.500807:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950d4 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.500832:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e4400/0x4076af6727515670 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950d4 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.500894:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.500896:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.500904:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950db expref: 71 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.500924:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950db expref: 71 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.500960:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950db expref: 71 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.500972:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172508800:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.501057:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.503627:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172508800:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.503648:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144896.504313:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.504347:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175295872:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3629us (4357us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.504357:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11160 00000100:00100000:1.0:1746144896.504694:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175296128 00000100:00100000:1.0:1746144896.504701:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175296128 00002000:00100000:1.0:1746144896.504740:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094380 x1830965175296128/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.504750:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094380 with x1830965175296128 ext(0->4095) 00002000:00010000:1.0:1746144896.504755:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a094380 00000100:00100000:1.0:1746144896.504804:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4162 00000100:00100000:1.0:1746144896.504811:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1984:x1830965175296128:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144896.505001:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+72:1984:x1830965175296128:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 190us (688us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.505006:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4162 00002000:00100000:1.0:1746144896.505012:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a094380 x1830965175296128/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.505018:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a094380 with x1830965175296128 ext(0->4095) 00002000:00010000:1.0:1746144896.505021:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a094380 00000100:00100000:0.0:1746144896.515672:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.522158:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175296256 00000100:00100000:2.0:1746144896.522173:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175296256 00000100:00100000:2.0:1746144896.522258:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5745 00000100:00100000:2.0:1746144896.522266:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175296256:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.522283:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.522302:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af950e2 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.522331:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950db expref: 71 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.522338:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.522340:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.522343:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e2 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.522371:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950db expref: 71 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.522381:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950db expref: 71 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.522396:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172508928:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.522474:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.545657:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172508928:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.545697:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e2 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.545716:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094112c00, rc 0) 00000100:00100000:2.0:1746144896.545802:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175296256:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 23535us (30139us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.545811:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5745 00000100:00100000:0.0:1746144896.545926:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.545990:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175296384 00000100:00100000:2.0:1746144896.545996:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175296384 00000100:00100000:2.0:1746144896.546030:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5746 00000100:00100000:2.0:1746144896.546038:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+72:31565:x1830965175296384:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.546052:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.546066:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af950e9 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.546088:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.546093:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e2 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.546099:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144896.546102:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e9 expref: 73 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.546134:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e2 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.546144:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e9 expref: 73 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.546151:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094112200, rc 0) 00000100:00100000:2.0:1746144896.546176:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+73:31565:x1830965175296384:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 139us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.546181:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5746 00000100:00100000:0.0:1746144896.549837:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.551205:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175296512 00000100:00100000:3.0:1746144896.551218:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175296512 00002000:00100000:3.0:1746144896.551270:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008a095500 x1830965175296512/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.551281:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a095500 with x1830965175296512 ext(0->7) 00010000:00010000:3.0:1746144896.551292:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950db expref: 73 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.551307:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950db expref: 73 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.551314:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a095500 00000100:00100000:3.0:1746144896.551354:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2202 00000100:00100000:3.0:1746144896.551362:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+73:1985:x1830965175296512:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144896.551736:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+75:1985:x1830965175296512:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 374us (1908us total) trans 4294968043 rc 0/0 00000100:00100000:3.0:1746144896.551743:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2202 00002000:00100000:3.0:1746144896.551749:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008a095500 x1830965175296512/t4294968043(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/448 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.551757:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a095500 with x1830965175296512 ext(0->7) 00010000:00010000:3.0:1746144896.551777:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950db expref: 75 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.551786:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950db expref: 75 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.551792:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a095500 00000100:00100000:0.0:1746144896.554871:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.555090:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175296640 00000100:00100000:3.0:1746144896.555098:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175296640 00010000:00010000:3.0:1746144896.555136:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950db expref: 75 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.555175:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11161 00000100:00100000:3.0:1746144896.555184:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+75:1984:x1830965175296640:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.555202:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.555222:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950db expref: 75 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.555239:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950db expref: 75 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.555263:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800941e5c00/0x4076af6727515677 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950db expref: 75 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.555283:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.555285:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.555293:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e2 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.555301:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e2 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.555407:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e2 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.555417:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e2 expref: 5 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.555428:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172509184:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.560461:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.562060:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.562156:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172509184:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.562177:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.562222:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+74:1984:x1830965175296640:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7038us (7360us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.562233:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11161 00000100:00100000:3.0:1746144896.562338:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175296896 00000100:00100000:3.0:1746144896.562345:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175296896 00002000:00100000:3.0:1746144896.562384:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a097100 x1830965175296896/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.562393:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a097100 with x1830965175296896 ext(0->4095) 00010000:00010000:3.0:1746144896.562403:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e2 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.562416:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e2 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.562423:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a097100 00000100:00100000:1.0:1746144896.564032:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2203 00000100:00100000:1.0:1746144896.564048:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175296896:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144896.564242:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175296896:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 199us (2190us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.564248:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2203 00002000:00100000:1.0:1746144896.564255:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a097100 x1830965175296896/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.564263:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a097100 with x1830965175296896 ext(0->4095) 00010000:00010000:1.0:1746144896.564269:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e2 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.564281:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e2 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.564287:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a097100 00000100:00100000:0.0:1746144896.568508:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.570478:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175297024 00000100:00100000:2.0:1746144896.570491:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175297024 00010000:00010000:2.0:1746144896.570540:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e2 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.570585:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11162 00000100:00100000:2.0:1746144896.570593:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175297024:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.570610:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.570630:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e2 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.570643:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e2 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.570667:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094112c00/0x4076af672751567e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e2 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.570687:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.570689:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.570696:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e9 expref: 73 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.570703:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e9 expref: 73 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.570736:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e9 expref: 73 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.570747:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172509312:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.570850:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.573932:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.574375:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172509312:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.574403:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.574487:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175297280 00000100:00100000:3.0:1746144896.574494:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175297280 00002000:00100000:3.0:1746144896.574532:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a097480 x1830965175297280/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.574541:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a097480 with x1830965175297280 ext(0->4095) 00002000:00010000:3.0:1746144896.574545:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a097480 00000100:00100000:2.0:1746144896.575133:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175297024:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4537us (6634us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.575143:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11162 00000100:00100000:3.0:1746144896.575247:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4163 00000100:00100000:3.0:1746144896.575255:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+74:1983:x1830965175297280:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:3.0:1746144896.575423:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+74:1983:x1830965175297280:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 169us (1511us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.575429:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4163 00002000:00100000:3.0:1746144896.575433:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a097480 x1830965175297280/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.575440:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a097480 with x1830965175297280 ext(0->4095) 00002000:00010000:3.0:1746144896.575443:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a097480 00000100:00100000:0.0:1746144896.577091:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.577210:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175297408 00000100:00100000:2.0:1746144896.577218:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175297408 00000100:00100000:2.0:1746144896.577270:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5747 00000100:00100000:2.0:1746144896.577278:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175297408:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.577291:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.577308:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af672751568c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af950f0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.577441:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e9 expref: 73 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.577451:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.577453:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.577456:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af672751568c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f0 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.577490:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e9 expref: 73 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.577502:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e9 expref: 73 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.577514:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172509440:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.577592:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.578905:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172509440:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.578945:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af672751568c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f0 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.578963:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009930b600, rc 0) 00000100:00100000:2.0:1746144896.578994:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175297408:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1717us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.579002:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5747 00000100:00100000:0.0:1746144896.579530:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.579601:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175297536 00000100:00100000:1.0:1746144896.579606:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175297536 00002000:00100000:1.0:1746144896.579637:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008a095f80 x1830965175297536/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.579646:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a095f80 with x1830965175297536 ext(0->7) 00010000:00010000:1.0:1746144896.579652:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e9 expref: 74 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.579664:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e9 expref: 74 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.579670:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a095f80 00000100:00100000:1.0:1746144896.579694:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2204 00000100:00100000:1.0:1746144896.579700:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+74:1985:x1830965175297536:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144896.580050:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1985:x1830965175297536:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 350us (520us total) trans 4294968044 rc 0/0 00000100:00100000:1.0:1746144896.580056:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2204 00002000:00100000:1.0:1746144896.580061:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88008a095f80 x1830965175297536/t4294968044(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/448 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.580068:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a095f80 with x1830965175297536 ext(0->7) 00010000:00010000:1.0:1746144896.580073:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e9 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.580081:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e9 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.580087:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008a095f80 00000100:00100000:0.0:1746144896.586203:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.586370:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175297664 00000100:00100000:2.0:1746144896.586379:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175297664 00010000:00010000:2.0:1746144896.586420:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e9 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.586457:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11163 00000100:00100000:2.0:1746144896.586464:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965175297664:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.586477:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746144896.586495:0:7097:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 1746144896 -> 1746144897 00002000:00010000:2.0:1746144896.586498:0:7097:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 1746144896 -> 1746144897 00010000:00010000:2.0:1746144896.586504:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e9 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.586516:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e9 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.586540:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094112200/0x4076af6727515685 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950e9 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.586609:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.586611:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.586619:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af672751568c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f0 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.586627:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af672751568c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f0 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.586662:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af672751568c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f0 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.586674:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172509568:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.588073:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.590530:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.590665:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172509568:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.590690:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.590736:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+75:1984:x1830965175297664:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4272us (4544us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.590746:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11163 00000100:00100000:3.0:1746144896.590834:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175297920 00000100:00100000:3.0:1746144896.590840:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175297920 00002000:00100000:3.0:1746144896.590876:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a097b80 x1830965175297920/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.591002:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a097b80 with x1830965175297920 ext(0->4095) 00002000:00010000:3.0:1746144896.591006:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a097b80 00000100:00100000:3.0:1746144896.591028:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4164 00000100:00100000:3.0:1746144896.591034:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175297920:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144896.592459:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a097b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175297920:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1420us (1932us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.592467:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4164 00002000:00100000:3.0:1746144896.592473:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008a097b80 x1830965175297920/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.592481:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008a097b80 with x1830965175297920 ext(0->4095) 00002000:00010000:3.0:1746144896.592485:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008a097b80 00000100:00100000:2.0:1746144896.593850:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.594190:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175298048 00000100:00100000:3.0:1746144896.594198:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175298048 00000100:00100000:3.0:1746144896.594274:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5748 00000100:00100000:3.0:1746144896.594281:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+75:31565:x1830965175298048:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.594296:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.594310:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af950f7 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.594334:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af672751568c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f0 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.594341:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.594342:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.594346:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.594369:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af672751568c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f0 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.594379:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af672751568c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f0 expref: 5 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.594745:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172509696:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.594831:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.597536:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.598155:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.598248:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175298176 00000100:00100000:2.0:1746144896.598256:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175298176 00000100:00100000:2.0:1746144896.598299:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5749 00000100:00100000:2.0:1746144896.598305:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+77:31579:x1830965175298176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.598320:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.598333:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009930a400/0x4076af672751569a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af950fe expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.598353:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.598358:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.598364:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.598368:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009930a400/0x4076af672751569a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950fe expref: 78 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.598397:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.598407:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009930a400/0x4076af672751569a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950fe expref: 78 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.598416:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009930a400, rc 0) 00000100:00100000:2.0:1746144896.598461:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+78:31579:x1830965175298176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 155us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.598466:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5749 00000100:00100000:0.0:1746144896.598794:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175298304 00000100:00100000:0.0:1746144896.598808:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175298304 00010000:00010000:0.0:1746144896.598825:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af672751568c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f0 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:0.0:1746144896.598841:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11164 00000100:00100000:0.0:1746144896.598846:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175298304:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144896.598853:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144896.598875:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af672751568c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f0 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:0.0:1746144896.598884:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af672751568c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f0 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:0.0:1746144896.598898:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144896.598899:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144896.598904:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.598909:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.598940:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.598949:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 78 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:0.0:1746144896.598958:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135eaa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172509952:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144896.599005:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b30c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746144896.600230:0:8430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af672751568c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f0 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.600256:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172509696:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.600272:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.600280:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.600289:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:3.0:1746144896.600329:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:31565:x1830965175298048:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6048us (6485us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.600334:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5748 00000100:00100000:2.0:1746144896.601374:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135eaa680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172509952:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.601393:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.601427:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175298304:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2581us (3272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.601436:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11164 00000100:00100000:0.0:1746144896.603603:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.603668:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175298560 00000100:00100000:3.0:1746144896.603679:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175298560 00002000:00100000:3.0:1746144896.603722:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea8a80 x1830965175298560/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.603731:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8a80 with x1830965175298560 ext(0->4095) 00010000:00010000:3.0:1746144896.603740:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.603751:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.603757:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea8a80 00000100:00100000:3.0:1746144896.603813:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2205 00000100:00100000:3.0:1746144896.603820:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1983:x1830965175298560:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:3.0:1746144896.603990:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1983:x1830965175298560:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 170us (396us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.603996:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2205 00002000:00100000:3.0:1746144896.604001:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea8a80 x1830965175298560/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.604007:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8a80 with x1830965175298560 ext(0->4095) 00010000:00010000:3.0:1746144896.604011:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.604019:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.604024:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135ea8a80 00000100:00100000:0.0:1746144896.608895:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.609071:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175298688 00000100:00100000:2.0:1746144896.609111:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175298688 00010000:00010000:2.0:1746144896.609155:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.609183:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11165 00000100:00100000:2.0:1746144896.609191:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1983:x1830965175298688:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.609207:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.609229:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.609241:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.609263:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515693 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950f7 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.609299:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.609301:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.609308:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009930a400/0x4076af672751569a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950fe expref: 76 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.609316:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009930a400/0x4076af672751569a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950fe expref: 76 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.609564:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009930a400/0x4076af672751569a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950fe expref: 76 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.609576:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172510080:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.610087:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00010000:00010000:3.0:1746144896.610481:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746144896.611963:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172510080:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.612038:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.612206:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1983:x1830965175298688:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3013us (3320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.612220:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11165 00000100:00100000:0.0:1746144896.613188:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.613245:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175298944 00000100:00100000:1.0:1746144896.613253:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175298944 00002000:00100000:1.0:1746144896.613292:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea9f80 x1830965175298944/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.613301:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea9f80 with x1830965175298944 ext(0->4095) 00002000:00010000:1.0:1746144896.613307:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea9f80 00000100:00100000:1.0:1746144896.613335:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4165 00000100:00100000:1.0:1746144896.613341:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1985:x1830965175298944:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144896.613507:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1985:x1830965175298944:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 166us (323us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.613512:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4165 00002000:00100000:1.0:1746144896.613518:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea9f80 x1830965175298944/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.613524:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea9f80 with x1830965175298944 ext(0->4095) 00002000:00010000:1.0:1746144896.613527:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea9f80 00000100:00100000:0.0:1746144896.616291:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.616485:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175299072 00000100:00100000:3.0:1746144896.616493:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175299072 00000100:00100000:3.0:1746144896.616582:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5750 00000100:00100000:3.0:1746144896.616590:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175299072:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.616608:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.616627:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275156a1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95105 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.616655:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009930a400/0x4076af672751569a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950fe expref: 75 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.616663:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.616664:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.616668:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275156a1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95105 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.616700:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009930a400/0x4076af672751569a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950fe expref: 75 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.616711:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009930a400/0x4076af672751569a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950fe expref: 75 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.616722:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172510208:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.616836:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd423c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.619287:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.619389:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172510208:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.619418:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275156a1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95105 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.619436:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:3.0:1746144896.619478:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175299072:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2888us (3195us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.619485:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5750 00000100:00100000:2.0:1746144896.619655:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175299200 00000100:00100000:2.0:1746144896.619662:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175299200 00010000:00010000:2.0:1746144896.619695:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009930a400/0x4076af672751569a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950fe expref: 76 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.620027:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11166 00000100:00100000:2.0:1746144896.620035:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965175299200:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.620049:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.620072:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009930a400/0x4076af672751569a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950fe expref: 76 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.620084:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009930a400/0x4076af672751569a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950fe expref: 76 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.620196:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009930a400/0x4076af672751569a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af950fe expref: 76 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.620222:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.620224:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.620231:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275156a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95105 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.620240:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275156a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95105 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.620269:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275156a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95105 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.620281:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172510336:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.620370:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.623252:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172510336:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.623284:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.623341:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+75:1984:x1830965175299200:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3305us (4061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.623351:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11166 00000100:00100000:0.0:1746144896.623561:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.624128:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.624281:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175299456 00000100:00100000:3.0:1746144896.624289:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175299456 00002000:00100000:3.0:1746144896.624330:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea8380 x1830965175299456/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.624339:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8380 with x1830965175299456 ext(0->4095) 00002000:00010000:3.0:1746144896.624343:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea8380 00000100:00100000:3.0:1746144896.624361:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4166 00000100:00100000:3.0:1746144896.624367:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175299456:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144896.624479:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175299584 00000100:00100000:2.0:1746144896.624483:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175299584 00000100:00100000:2.0:1746144896.624513:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5751 00000100:00100000:2.0:1746144896.624519:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+75:31565:x1830965175299584:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.624528:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746144896.624659:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175299456:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 291us (1099us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.624664:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4166 00002000:00100000:3.0:1746144896.624670:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea8380 x1830965175299456/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.624676:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8380 with x1830965175299456 ext(0->4095) 00002000:00010000:3.0:1746144896.624679:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea8380 00010000:00010000:2.0:1746144896.624831:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9510c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.624856:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275156a1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95105 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.624864:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.624865:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.624869:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9510c expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.624892:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275156a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95105 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.624906:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275156a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95105 expref: 5 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.624925:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172510464:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.624987:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.627362:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.627601:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175299712 00000100:00100000:1.0:1746144896.627608:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175299712 00000100:00100000:1.0:1746144896.627661:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5752 00000100:00100000:1.0:1746144896.627669:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+77:31579:x1830965175299712:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144896.627684:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144896.627700:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156af lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95113 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.627727:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144896.627733:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9510c expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.627739:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144896.627742:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156af lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95113 expref: 78 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.627831:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9510c expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.627844:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156af lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95113 expref: 78 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.627854:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966c000, rc 0) 00000100:00100000:1.0:1746144896.627898:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+78:31579:x1830965175299712:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 230us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144896.627904:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5752 00000100:00100000:2.0:1746144896.629351:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172510464:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.629683:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9510c expref: 77 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144896.629694:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1746144896.629697:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009930b600, rc 0) 00000100:00100000:2.0:1746144896.629737:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:31565:x1830965175299584:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5218us (5609us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.629744:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5751 00000100:00100000:3.0:1746144896.629888:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175299840 00000100:00100000:3.0:1746144896.629894:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175299840 00010000:00010000:3.0:1746144896.629927:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275156a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95105 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.629966:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11167 00000100:00100000:3.0:1746144896.629972:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175299840:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.629985:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.630053:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275156a1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95105 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.630066:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275156a1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95105 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.630087:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275156a1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95105 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.630111:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.630112:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.630120:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9510c expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.630127:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9510c expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.630157:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9510c expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.630168:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9510c expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.630188:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172510720:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.630506:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.636358:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.636427:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175300096 00000100:00100000:2.0:1746144896.636436:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175300096 00002000:00100000:2.0:1746144896.636487:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135eaa680 x1830965175300096/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.636496:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135eaa680 with x1830965175300096 ext(0->4095) 00010000:00010000:2.0:1746144896.636505:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9510c expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.636518:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9510c expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.636529:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135eaa680 00000100:00100000:2.0:1746144896.636563:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2206 00000100:00100000:2.0:1746144896.636571:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1984:x1830965175300096:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144896.636796:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1984:x1830965175300096:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 225us (446us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.636803:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2206 00002000:00100000:2.0:1746144896.636809:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135eaa680 x1830965175300096/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.636820:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135eaa680 with x1830965175300096 ext(0->4095) 00010000:00010000:2.0:1746144896.636825:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9510c expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.636834:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9510c expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.636840:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135eaa680 00000100:00100000:3.0:1746144896.637068:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172510720:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.637083:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.637121:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175299840:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7149us (7426us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.637130:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11167 00000100:00100000:0.0:1746144896.641726:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.641834:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175300224 00000100:00100000:3.0:1746144896.641843:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175300224 00010000:00010000:3.0:1746144896.641873:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9510c expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.641999:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11168 00000100:00100000:3.0:1746144896.642008:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1984:x1830965175300224:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.642019:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.642036:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9510c expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.642046:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9510c expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.642063:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009930b600/0x4076af67275156a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9510c expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.642083:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.642086:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.642091:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95113 expref: 76 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.642098:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95113 expref: 76 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.642123:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95113 expref: 76 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.642133:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172510848:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.642200:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.647656:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172510848:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.647680:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.647724:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965175300224:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5716us (6004us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.647734:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11168 00000100:00100000:0.0:1746144896.648410:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.648538:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175300480 00000100:00100000:2.0:1746144896.648546:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175300480 00002000:00100000:2.0:1746144896.648591:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea8700 x1830965175300480/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.648601:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8700 with x1830965175300480 ext(0->4095) 00002000:00010000:2.0:1746144896.648605:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea8700 00000100:00100000:2.0:1746144896.648622:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4167 00000100:00100000:2.0:1746144896.648629:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965175300480:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144896.648815:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965175300480:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 186us (406us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.648821:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4167 00002000:00100000:2.0:1746144896.648827:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea8700 x1830965175300480/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.648834:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea8700 with x1830965175300480 ext(0->4095) 00002000:00010000:2.0:1746144896.648837:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea8700 00000100:00100000:0.0:1746144896.652139:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.652256:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175300608 00000100:00100000:2.0:1746144896.652264:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175300608 00000100:00100000:2.0:1746144896.652868:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5753 00000100:00100000:2.0:1746144896.652877:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175300608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.652895:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.652923:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af67275156b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9511a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.652953:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95113 expref: 75 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.652960:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.652962:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.652965:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af67275156b6 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9511a expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.652998:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95113 expref: 75 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.653014:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95113 expref: 75 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.653026:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172510976:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.653126:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.654902:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172510976:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.654944:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af67275156b6 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9511a expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.654959:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbbd000, rc 0) 00000100:00100000:2.0:1746144896.655000:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175300608:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2124us (2869us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.655007:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5753 00000100:00100000:1.0:1746144896.655216:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.655360:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175300736 00000100:00100000:3.0:1746144896.655366:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175300736 00010000:00010000:3.0:1746144896.655394:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95113 expref: 76 pid: 20722 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.655426:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11169 00000100:00100000:3.0:1746144896.655433:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1985:x1830965175300736:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.655445:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.655466:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95113 expref: 76 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.655482:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95113 expref: 76 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.655504:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95113 expref: 76 pid: 20722 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.655529:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.655531:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.655539:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af67275156b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9511a expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.655546:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af67275156b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9511a expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.655576:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af67275156b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9511a expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.655590:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172511104:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.655650:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.656889:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172511104:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.656902:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.656951:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+75:1985:x1830965175300736:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1516us (1734us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.656960:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11169 00000100:00100000:0.0:1746144896.657061:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.657160:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175300992 00000100:00100000:2.0:1746144896.657165:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175300992 00002000:00100000:2.0:1746144896.657198:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea9880 x1830965175300992/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.657207:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea9880 with x1830965175300992 ext(0->4095) 00002000:00010000:2.0:1746144896.657212:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea9880 00000100:00100000:2.0:1746144896.657225:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4168 00000100:00100000:2.0:1746144896.657231:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175300992:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144896.657697:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175300992:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 464us (635us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.657706:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4168 00002000:00100000:2.0:1746144896.657712:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880135ea9880 x1830965175300992/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.657719:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea9880 with x1830965175300992 ext(0->4095) 00002000:00010000:2.0:1746144896.657722:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea9880 00000100:00100000:0.0:1746144896.658999:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.659070:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.659149:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175301120 00000100:00100000:2.0:1746144896.659155:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175301120 00000100:00100000:2.0:1746144896.659186:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175301248 00000100:00100000:2.0:1746144896.659188:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175301248 00000100:00100000:2.0:1746144896.659213:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5754 00000100:00100000:2.0:1746144896.659219:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:31565:x1830965175301120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:1.0:1746144896.659229:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5755 00010000:00010000:2.0:1746144896.659233:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144896.659238:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+76:31579:x1830965175301248:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144896.659246:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.659249:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95121 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.659257:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95128 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.659355:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af67275156b6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9511a expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.659366:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144896.659367:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144896.659371:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95128 expref: 78 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.659379:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.659384:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95128 expref: 78 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.659390:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.659393:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95121 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.659420:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af67275156b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9511a expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.659424:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95128 expref: 78 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.659433:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af67275156b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9511a expref: 5 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.659444:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95121 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144896.659445:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172511360:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.659454:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbbd800, rc 0) 00000100:00100000:2.0:1746144896.659510:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+78:31565:x1830965175301120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 290us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.659521:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5754 00000100:00100000:1.0:1746144896.660051:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144896.661862:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172511360:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144896.661890:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95128 expref: 77 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.661905:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d200, rc 0) 00000100:00100000:1.0:1746144896.661966:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+77:31579:x1830965175301248:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2728us (2894us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144896.661974:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5755 00000100:00100000:0.0:1746144896.663347:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.663447:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175301376 00000100:00100000:3.0:1746144896.663455:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175301376 00010000:00010000:3.0:1746144896.663485:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af67275156b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9511a expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.663515:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11170 00000100:00100000:3.0:1746144896.663520:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175301376:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.663532:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.663551:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af67275156b6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9511a expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.663562:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af67275156b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9511a expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.663586:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af67275156b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9511a expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.663610:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.663613:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.663620:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95128 expref: 76 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.663628:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95128 expref: 76 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.663661:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95128 expref: 76 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.663672:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95128 expref: 76 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.663707:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172511488:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.663834:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.665879:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172511488:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.665897:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.665941:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175301376:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2419us (2597us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.665951:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11170 00000100:00100000:0.0:1746144896.666370:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.666588:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175301632 00000100:00100000:2.0:1746144896.666595:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175301632 00002000:00100000:2.0:1746144896.666642:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70380 x1830965175301632/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.666651:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70380 with x1830965175301632 ext(0->4095) 00010000:00010000:2.0:1746144896.666659:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95128 expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.666671:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95128 expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.666676:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f70380 00000100:00100000:2.0:1746144896.666705:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2207 00000100:00100000:2.0:1746144896.666713:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1985:x1830965175301632:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144896.666928:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1985:x1830965175301632:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 216us (559us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.666935:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2207 00002000:00100000:2.0:1746144896.666940:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70380 x1830965175301632/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.666952:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70380 with x1830965175301632 ext(0->4095) 00010000:00010000:2.0:1746144896.666957:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95128 expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.666967:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95128 expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.666971:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f70380 00000100:00100000:0.0:1746144896.672741:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.673595:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.673678:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175301760 00000100:00100000:1.0:1746144896.673689:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175301760 00000100:00100000:1.0:1746144896.673746:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5756 00000100:00100000:1.0:1746144896.673754:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175301760:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144896.673789:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144896.673808:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9512f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.673835:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144896.673841:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95121 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.673852:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144896.673856:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9512f expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.673892:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95121 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.673904:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9512f expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.673927:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966ce00, rc 0) 00000100:00100000:1.0:1746144896.673974:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175301760:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 221us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144896.673980:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5756 00000100:00100000:3.0:1746144896.674175:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175301888 00000100:00100000:3.0:1746144896.674179:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175301888 00010000:00010000:3.0:1746144896.674198:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95128 expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.674217:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11171 00000100:00100000:3.0:1746144896.674222:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1984:x1830965175301888:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.674231:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.674252:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95128 expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.674262:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95128 expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.674280:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275156c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95128 expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.674299:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.674302:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.674309:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95121 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.674316:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95121 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.674336:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95121 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.674347:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95121 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.674358:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172511744:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.674429:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.677320:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172511744:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.677343:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.677397:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965175301888:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3173us (3801us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.677408:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11171 00000100:00100000:0.0:1746144896.678809:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.678898:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175302144 00000100:00100000:2.0:1746144896.678904:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175302144 00002000:00100000:2.0:1746144896.678956:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70700 x1830965175302144/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.678966:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70700 with x1830965175302144 ext(0->4095) 00010000:00010000:2.0:1746144896.678975:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95121 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.678987:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95121 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.678993:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f70700 00000100:00100000:2.0:1746144896.679011:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2208 00000100:00100000:2.0:1746144896.679018:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965175302144:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144896.679428:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965175302144:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 409us (621us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.679434:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2208 00002000:00100000:2.0:1746144896.679440:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f70700 x1830965175302144/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.679448:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70700 with x1830965175302144 ext(0->4095) 00010000:00010000:2.0:1746144896.679452:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95121 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.679460:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95121 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.679465:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f70700 00000100:00100000:0.0:1746144896.681199:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.681277:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.681456:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175302400 00000100:00100000:3.0:1746144896.681464:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175302400 00010000:00010000:3.0:1746144896.681493:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95121 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.681527:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11172 00000100:00100000:3.0:1746144896.681533:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1982:x1830965175302400:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.681547:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.681567:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95121 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.681577:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95121 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.681598:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af67275156bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95121 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.681615:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.681617:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.681625:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9512f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.681633:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9512f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.681663:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9512f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.681673:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172511872:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.681741:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.681848:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175302272 00000100:00100000:2.0:1746144896.681852:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175302272 00000100:00100000:2.0:1746144896.681878:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5757 00000100:00100000:2.0:1746144896.681883:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:31565:x1830965175302272:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.681894:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.681907:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd400/0x4076af67275156d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95136 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.681937:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9512f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.681942:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.681943:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.681946:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd400/0x4076af67275156d2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95136 expref: 77 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.681962:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9512f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.681977:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9512f expref: 5 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.681986:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172512000:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.682018:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.686548:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172511872:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.686573:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.686621:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1982:x1830965175302400:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5087us (5343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.686635:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11172 00000100:00100000:2.0:1746144896.686990:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172512000:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.687020:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd400/0x4076af67275156d2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95136 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.687036:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbbd400, rc 0) 00000100:00100000:2.0:1746144896.687073:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:31565:x1830965175302272:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5189us (5879us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.687080:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5757 00000100:00100000:0.0:1746144896.688123:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.689180:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175302656 00000100:00100000:2.0:1746144896.689189:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175302656 00002000:00100000:2.0:1746144896.689232:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f72a00 x1830965175302656/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.689243:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f72a00 with x1830965175302656 ext(0->4095) 00010000:00010000:2.0:1746144896.689252:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9512f expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.689264:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9512f expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.689275:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f72a00 00000100:00100000:2.0:1746144896.689296:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2209 00000100:00100000:2.0:1746144896.689302:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175302656:12345-192.168.202.16@tcp:3:ldlm_bl.0 00000100:00100000:2.0:1746144896.689475:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175302656:12345-192.168.202.16@tcp:3:ldlm_bl.0 Request processed in 173us (1354us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.689481:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2209 00002000:00100000:2.0:1746144896.689486:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092f72a00 x1830965175302656/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.689493:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f72a00 with x1830965175302656 ext(0->4095) 00010000:00010000:2.0:1746144896.689497:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9512f expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.689505:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9512f expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00002000:00010000:2.0:1746144896.689510:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092f72a00 00000100:00100000:0.0:1746144896.691942:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.692231:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175302784 00000100:00100000:3.0:1746144896.692238:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175302784 00010000:00010000:3.0:1746144896.692272:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9512f expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.692312:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11173 00000100:00100000:3.0:1746144896.692319:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175302784:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.692332:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.692352:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9512f expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.692364:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9512f expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.692696:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156cb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9512f expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.692728:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.692731:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.692738:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd400/0x4076af67275156d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95136 expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.692745:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd400/0x4076af67275156d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95136 expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.692809:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd400/0x4076af67275156d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95136 expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.692823:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172512128:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.692918:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.694924:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172512128:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.694945:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.694993:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175302784:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2673us (3058us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.695003:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11173 00000100:00100000:0.0:1746144896.695954:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.696012:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175303040 00000100:00100000:1.0:1746144896.696019:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175303040 00002000:00100000:1.0:1746144896.696059:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093854000 x1830965175303040/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.696069:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854000 with x1830965175303040 ext(0->4095) 00002000:00010000:1.0:1746144896.696073:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093854000 00000100:00100000:1.0:1746144896.696103:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4169 00000100:00100000:1.0:1746144896.696109:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965175303040:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144896.696276:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965175303040:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 167us (324us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.696285:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4169 00002000:00100000:1.0:1746144896.696290:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093854000 x1830965175303040/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.696297:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854000 with x1830965175303040 ext(0->4095) 00002000:00010000:1.0:1746144896.696300:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093854000 00000100:00100000:0.0:1746144896.697903:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.698108:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175303168 00000100:00100000:2.0:1746144896.698114:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175303168 00000100:00100000:2.0:1746144896.698347:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5758 00000100:00100000:2.0:1746144896.698356:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175303168:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.698369:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.698386:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af67275156d9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9513d expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.698418:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd400/0x4076af67275156d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95136 expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.698426:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.698428:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.698432:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af67275156d9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9513d expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.698461:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd400/0x4076af67275156d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95136 expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.698472:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd400/0x4076af67275156d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95136 expref: 75 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.698482:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172512256:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.698813:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.700699:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172512256:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.700732:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af67275156d9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9513d expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.700748:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbbd200, rc 0) 00000100:00100000:2.0:1746144896.700824:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175303168:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2469us (2923us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.700831:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5758 00000100:00100000:0.0:1746144896.702313:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.702620:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175303296 00000100:00100000:3.0:1746144896.702627:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175303296 00010000:00010000:3.0:1746144896.702658:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd400/0x4076af67275156d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95136 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.703074:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11174 00000100:00100000:3.0:1746144896.703082:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965175303296:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.703097:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.703118:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd400/0x4076af67275156d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95136 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.703131:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd400/0x4076af67275156d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95136 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.703154:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd400/0x4076af67275156d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95136 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.703179:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.703182:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.703189:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af67275156d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9513d expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.703196:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af67275156d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9513d expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.703228:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af67275156d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9513d expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.703240:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172512384:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.703316:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.706260:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172512384:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.706282:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.706329:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+75:1984:x1830965175303296:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3246us (4019us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.706341:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11174 00000100:00100000:0.0:1746144896.707059:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.707167:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.707555:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175303680 00000100:00100000:3.0:1746144896.707566:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175303680 00000100:00100000:1.0:1746144896.707613:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175303552 00000100:00100000:3.0:1746144896.707615:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5759 00000100:00100000:1.0:1746144896.707618:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175303552 00000100:00100000:3.0:1746144896.707623:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+75:31565:x1830965175303680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.707637:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:1.0:1746144896.707646:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093857480 x1830965175303552/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1746144896.707654:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95144 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746144896.707657:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093857480 with x1830965175303552 ext(0->4095) 00002000:00010000:1.0:1746144896.707661:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093857480 00000100:00100000:1.0:1746144896.707682:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4170 00010000:00010000:3.0:1746144896.707683:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af67275156d9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9513d expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144896.707687:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175303552:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00010000:00010000:3.0:1746144896.707695:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.707697:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.707701:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95144 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.707735:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af67275156d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9513d expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.707747:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af67275156d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9513d expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.707757:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172512512:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.707834:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144896.707856:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093857480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175303552:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 168us (798us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.707863:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4170 00002000:00100000:1.0:1746144896.707872:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093857480 x1830965175303552/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.707878:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093857480 with x1830965175303552 ext(0->4095) 00010000:00010000:1.0:1746144896.707883:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af67275156d9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9513d expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.707892:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af67275156d9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9513d expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.707899:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093857480 00000100:00100000:3.0:1746144896.710536:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172512512:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.710564:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95144 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.710581:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:3.0:1746144896.710634:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:31565:x1830965175303680:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3010us (3465us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.710642:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5759 00000100:00100000:0.0:1746144896.714900:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.714970:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.714993:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175303808 00000100:00100000:3.0:1746144896.715002:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175303808 00000100:00100000:3.0:1746144896.715067:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5760 00000100:00100000:3.0:1746144896.715075:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:31579:x1830965175303808:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.715098:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.715116:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275156e7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9514b expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.715149:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.715156:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95144 expref: 77 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.715161:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.715165:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275156e7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9514b expref: 77 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.715203:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95144 expref: 77 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.715215:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275156e7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9514b expref: 77 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.715224:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:3.0:1746144896.715270:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:31579:x1830965175303808:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 196us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.715277:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5760 00000100:00100000:2.0:1746144896.715689:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175303936 00000100:00100000:2.0:1746144896.715694:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175303936 00010000:00010000:2.0:1746144896.715718:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af67275156d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9513d expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.715748:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11175 00000100:00100000:2.0:1746144896.715755:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175303936:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.715792:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.715815:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af67275156d9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9513d expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.715826:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af67275156d9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9513d expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.715844:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af67275156d9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9513d expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.715858:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.715860:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.715865:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95144 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.715872:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95144 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.715892:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95144 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.715902:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95144 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.715940:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172512768:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.716010:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099f30780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.718959:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.719070:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172512768:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.719095:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.719145:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175303936:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3390us (4173us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.719156:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11175 00000100:00100000:1.0:1746144896.719657:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175304192 00000100:00100000:1.0:1746144896.719664:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175304192 00002000:00100000:1.0:1746144896.719700:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093856300 x1830965175304192/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.719709:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093856300 with x1830965175304192 ext(0->4095) 00010000:00010000:1.0:1746144896.719717:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95144 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.719729:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95144 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.719735:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093856300 00000100:00100000:1.0:1746144896.719759:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2210 00000100:00100000:1.0:1746144896.719783:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1983:x1830965175304192:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144896.719965:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1983:x1830965175304192:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 182us (1016us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.719972:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2210 00002000:00100000:1.0:1746144896.719977:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093856300 x1830965175304192/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.719983:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093856300 with x1830965175304192 ext(0->4095) 00010000:00010000:1.0:1746144896.719987:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95144 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.719999:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95144 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.720004:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093856300 00000100:00100000:0.0:1746144896.723715:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.723854:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175304320 00000100:00100000:2.0:1746144896.723864:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175304320 00010000:00010000:2.0:1746144896.723902:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95144 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.723938:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11176 00000100:00100000:2.0:1746144896.723944:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1985:x1830965175304320:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.723958:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.723977:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95144 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.723989:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95144 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.724011:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275156e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95144 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.724033:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.724036:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.724044:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275156e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9514b expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.724052:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275156e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9514b expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.724086:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275156e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9514b expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.724098:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172512896:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.724181:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.725977:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172512896:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.725999:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.726047:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1985:x1830965175304320:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2102us (2341us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.726057:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11176 00000100:00100000:0.0:1746144896.726699:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.726751:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175304576 00000100:00100000:1.0:1746144896.726757:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175304576 00002000:00100000:1.0:1746144896.726843:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093856d80 x1830965175304576/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.726852:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093856d80 with x1830965175304576 ext(0->4095) 00002000:00010000:1.0:1746144896.726857:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093856d80 00000100:00100000:1.0:1746144896.726884:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4171 00000100:00100000:1.0:1746144896.726891:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965175304576:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144896.727069:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965175304576:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 178us (371us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.727075:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4171 00002000:00100000:1.0:1746144896.727080:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093856d80 x1830965175304576/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.727086:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093856d80 with x1830965175304576 ext(0->4095) 00002000:00010000:1.0:1746144896.727089:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093856d80 00000100:00100000:0.0:1746144896.729982:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.730166:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175304704 00000100:00100000:1.0:1746144896.730174:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175304704 00000100:00100000:1.0:1746144896.730472:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5761 00000100:00100000:1.0:1746144896.730482:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175304704:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144896.730500:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144896.730518:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156ee lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95152 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.730547:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275156e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9514b expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.730554:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144896.730556:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144896.730559:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156ee lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95152 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.730591:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275156e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9514b expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.730604:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275156e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9514b expref: 75 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:1.0:1746144896.730616:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172513024:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144896.730702:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144896.732112:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172513024:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144896.732133:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156ee lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95152 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.732147:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966c000, rc 0) 00000100:00100000:1.0:1746144896.732185:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175304704:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1704us (2212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144896.732197:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5761 00000100:00100000:0.0:1746144896.732938:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.733028:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175304832 00000100:00100000:2.0:1746144896.733034:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175304832 00010000:00010000:2.0:1746144896.733065:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275156e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9514b expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.733095:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11177 00000100:00100000:2.0:1746144896.733102:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093857b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1985:x1830965175304832:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.733113:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.733134:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275156e7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9514b expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.733149:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275156e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9514b expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.733171:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275156e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9514b expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.733197:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.733199:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.733207:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95152 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.733214:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95152 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.733240:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95152 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.733250:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172513152:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.733705:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.734645:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172513152:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.734661:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.734691:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093857b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+75:1985:x1830965175304832:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1589us (1754us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.734701:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11177 00000100:00100000:0.0:1746144896.735431:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.735479:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175305088 00000100:00100000:3.0:1746144896.735485:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175305088 00002000:00100000:3.0:1746144896.735520:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093857100 x1830965175305088/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.735527:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093857100 with x1830965175305088 ext(0->4095) 00002000:00010000:3.0:1746144896.735532:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093857100 00000100:00100000:3.0:1746144896.735569:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4172 00000100:00100000:3.0:1746144896.735574:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175305088:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.735720:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175305088:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 146us (291us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.735726:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4172 00002000:00100000:3.0:1746144896.735731:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093857100 x1830965175305088/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.735738:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093857100 with x1830965175305088 ext(0->4095) 00002000:00010000:3.0:1746144896.735741:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093857100 00000100:00100000:0.0:1746144896.737079:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.737280:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175305216 00000100:00100000:1.0:1746144896.737285:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175305216 00000100:00100000:1.0:1746144896.737358:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5762 00000100:00100000:1.0:1746144896.737365:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+75:31579:x1830965175305216:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144896.737377:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144896.737394:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95159 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.737422:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156ee lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95152 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.737430:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144896.737432:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144896.737436:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95159 expref: 76 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.737465:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95152 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.737477:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95152 expref: 5 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:1.0:1746144896.737487:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172513280:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144896.737554:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.737829:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.737844:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175305344 00000100:00100000:3.0:1746144896.737848:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175305344 00000100:00100000:3.0:1746144896.737874:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5763 00000100:00100000:3.0:1746144896.737879:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:31565:x1830965175305344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.737885:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.737892:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95160 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.737903:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.737907:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95159 expref: 78 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.737923:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.737927:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95160 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.737952:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95159 expref: 78 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.737963:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95160 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.737972:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:3.0:1746144896.737997:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+78:31565:x1830965175305344:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 117us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.738003:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5763 00000100:00100000:1.0:1746144896.739249:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172513280:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144896.739269:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95159 expref: 77 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.739278:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966ce00, rc 0) 00000100:00100000:1.0:1746144896.739318:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+77:31579:x1830965175305216:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1952us (2242us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144896.739324:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5762 00000100:00100000:0.0:1746144896.739574:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.739784:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175305472 00000100:00100000:2.0:1746144896.739790:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175305472 00010000:00010000:2.0:1746144896.739813:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95152 expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.739991:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11178 00000100:00100000:2.0:1746144896.739998:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175305472:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.740008:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.740027:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156ee lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95152 expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.740037:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156ee lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95152 expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.740054:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275156ee lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95152 expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.740077:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.740079:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.740084:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95159 expref: 76 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.740092:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95159 expref: 76 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.740114:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95159 expref: 76 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.740123:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95159 expref: 76 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.740133:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172513536:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.740860:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.741828:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172513536:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.741841:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.741864:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175305472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1868us (2290us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.741871:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11178 00000100:00100000:0.0:1746144896.742454:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.742533:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175305728 00000100:00100000:1.0:1746144896.742538:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175305728 00002000:00100000:1.0:1746144896.742568:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093256d80 x1830965175305728/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.742577:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256d80 with x1830965175305728 ext(0->4095) 00010000:00010000:1.0:1746144896.742584:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95159 expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.742594:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95159 expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.742599:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093256d80 00000100:00100000:1.0:1746144896.742624:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2211 00000100:00100000:1.0:1746144896.742630:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1984:x1830965175305728:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144896.742820:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1984:x1830965175305728:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 189us (366us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.742826:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2211 00002000:00100000:1.0:1746144896.742831:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093256d80 x1830965175305728/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.742839:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256d80 with x1830965175305728 ext(0->4095) 00010000:00010000:1.0:1746144896.742843:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95159 expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.742852:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95159 expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.742857:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093256d80 00000100:00100000:0.0:1746144896.744180:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.744543:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175305856 00000100:00100000:1.0:1746144896.744549:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175305856 00000100:00100000:1.0:1746144896.744587:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5764 00000100:00100000:1.0:1746144896.744593:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175305856:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144896.744605:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144896.744621:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95167 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.744643:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144896.744648:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95160 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.744653:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144896.744657:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.744686:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95160 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.744700:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.744708:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d200, rc 0) 00000100:00100000:1.0:1746144896.744746:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175305856:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 153us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144896.744752:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5764 00000100:00100000:2.0:1746144896.747026:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.747100:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175305984 00000100:00100000:0.0:1746144896.747106:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175305984 00010000:00010000:0.0:1746144896.747138:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95159 expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:0.0:1746144896.747698:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11179 00000100:00100000:0.0:1746144896.747707:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1984:x1830965175305984:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144896.747719:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144896.747743:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95159 expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:0.0:1746144896.747757:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95159 expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:0.0:1746144896.747814:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275156f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95159 expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:0.0:1746144896.747842:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144896.747844:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144896.747851:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95160 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.747858:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95160 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.747969:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95160 expref: 76 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.747984:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95160 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:0.0:1746144896.748000:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093257800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172513792:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144896.748159:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.750562:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.750619:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175306240 00000100:00100000:3.0:1746144896.750627:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175306240 00002000:00100000:3.0:1746144896.750670:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093256300 x1830965175306240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.750680:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256300 with x1830965175306240 ext(0->4095) 00010000:00010000:3.0:1746144896.750688:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95160 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.750699:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95160 expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.750705:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093256300 00000100:00100000:2.0:1746144896.750822:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093257800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172513792:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.750842:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.750881:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1984:x1830965175305984:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3175us (3862us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.750891:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11179 00000100:00100000:1.0:1746144896.750956:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2212 00000100:00100000:1.0:1746144896.750965:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1985:x1830965175306240:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144896.751173:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1985:x1830965175306240:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 209us (618us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.751180:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2212 00002000:00100000:1.0:1746144896.751185:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093256300 x1830965175306240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.751193:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256300 with x1830965175306240 ext(0->4095) 00010000:00010000:1.0:1746144896.751197:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95160 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.751206:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95160 expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.751212:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093256300 00000100:00100000:0.0:1746144896.752637:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.752781:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175306368 00000100:00100000:3.0:1746144896.752788:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175306368 00000100:00100000:3.0:1746144896.752834:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5765 00000100:00100000:3.0:1746144896.752841:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:31565:x1830965175306368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.752855:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.752872:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751570a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9516e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144896.753018:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.753091:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175306496 00000100:00100000:2.0:1746144896.753104:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175306496 00010000:00010000:2.0:1746144896.753125:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95160 expref: 78 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.753145:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11180 00000100:00100000:2.0:1746144896.753150:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1985:x1830965175306496:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.753158:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.753178:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95160 expref: 78 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.753193:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95160 expref: 78 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.753211:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275156fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95160 expref: 78 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.753239:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.753305:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.753463:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.753467:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751570a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9516e expref: 77 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.753476:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.753478:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.753485:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.753493:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.753543:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.753554:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 5 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.753563:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 5 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.753565:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172514048:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.753570:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 5 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.753578:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172513920:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.753749:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.753756:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.755671:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172514048:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.755694:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751570a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9516e expref: 77 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.755707:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:3.0:1746144896.755742:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:31565:x1830965175306368:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2898us (3105us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.755753:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5765 00000100:00100000:2.0:1746144896.757056:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172513920:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144896.757058:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1746144896.757076:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.757103:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093255c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1985:x1830965175306496:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3952us (4085us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.757114:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11180 00000100:00100000:1.0:1746144896.757133:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175306752 00000100:00100000:1.0:1746144896.757139:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175306752 00002000:00100000:1.0:1746144896.757177:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093255f80 x1830965175306752/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.757186:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093255f80 with x1830965175306752 ext(0->4095) 00010000:00010000:1.0:1746144896.757194:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.757205:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.757211:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093255f80 00000100:00100000:1.0:1746144896.757238:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2213 00000100:00100000:1.0:1746144896.757245:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175306752:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144896.757397:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093255f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175306752:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 152us (339us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.757402:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2213 00002000:00100000:1.0:1746144896.757406:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093255f80 x1830965175306752/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.757413:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093255f80 with x1830965175306752 ext(0->4095) 00010000:00010000:1.0:1746144896.757416:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.757424:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00002000:00010000:1.0:1746144896.757428:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093255f80 00000100:00100000:0.0:1746144896.760493:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.760622:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175306880 00000100:00100000:2.0:1746144896.760630:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175306880 00010000:00010000:2.0:1746144896.760668:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.760693:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11181 00000100:00100000:2.0:1746144896.760700:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175306880:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.760712:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.760733:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.760745:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.760788:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515703 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95167 expref: 6 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.760811:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.760813:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.760820:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751570a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9516e expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.760828:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751570a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9516e expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.760953:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751570a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9516e expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.760968:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172514176:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.761033:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.762817:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172514176:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.762835:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.762877:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175306880:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2177us (2391us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.762887:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11181 00000100:00100000:0.0:1746144896.763272:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.763372:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175307136 00000100:00100000:3.0:1746144896.763378:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175307136 00002000:00100000:3.0:1746144896.763410:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093255180 x1830965175307136/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.763419:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093255180 with x1830965175307136 ext(0->4095) 00002000:00010000:3.0:1746144896.763423:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093255180 00000100:00100000:3.0:1746144896.763448:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4173 00000100:00100000:3.0:1746144896.763455:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1985:x1830965175307136:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144896.763885:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093255180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1985:x1830965175307136:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 430us (613us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.763891:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4173 00002000:00100000:3.0:1746144896.763895:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093255180 x1830965175307136/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.763907:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093255180 with x1830965175307136 ext(0->4095) 00002000:00010000:3.0:1746144896.763918:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093255180 00000100:00100000:0.0:1746144896.768628:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.768737:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175307264 00000100:00100000:3.0:1746144896.768747:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175307264 00000100:00100000:3.0:1746144896.768821:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5766 00000100:00100000:3.0:1746144896.768829:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175307264:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.768845:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.768863:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95175 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.768893:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751570a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9516e expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.768900:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.768902:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.768906:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95175 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.768945:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751570a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9516e expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.768956:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751570a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9516e expref: 75 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.768967:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172514304:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.769833:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd423c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.772581:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172514304:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.772613:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95175 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.772629:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:3.0:1746144896.772668:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175307264:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3840us (4049us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.772677:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5766 00000100:00100000:0.0:1746144896.773727:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.774088:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.774147:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175307520 00000100:00100000:2.0:1746144896.774155:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175307520 00000100:00100000:2.0:1746144896.774203:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5767 00000100:00100000:2.0:1746144896.774210:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:31565:x1830965175307520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.774224:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.774238:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9517c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.774374:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175307392 00000100:00100000:3.0:1746144896.774379:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175307392 00010000:00010000:3.0:1746144896.774395:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751570a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9516e expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.774429:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11182 00000100:00100000:3.0:1746144896.774434:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1984:x1830965175307392:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.774445:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.774465:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751570a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9516e expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.774476:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751570a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9516e expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.774496:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af672751570a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9516e expref: 77 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.774675:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.774681:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95175 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.774687:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.774691:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9517c expref: 77 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.774726:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95175 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.774737:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9517c expref: 77 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.774745:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.774746:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.774752:0:8430:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95175 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.774759:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95175 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.774805:0:8430:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95175 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.774816:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95175 expref: 5 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.774827:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172514560:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.774888:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00010000:00010000:3.0:1746144896.775315:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.775337:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1984:x1830965175307392:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 903us (1618us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.775345:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11182 00000100:00100000:2.0:1746144896.776968:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172514560:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.776987:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbbc200, rc 0) 00000100:00100000:2.0:1746144896.777029:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+76:31565:x1830965175307520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2818us (2940us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.777036:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5767 00000100:00100000:0.0:1746144896.778485:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.778657:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175307776 00000100:00100000:3.0:1746144896.778665:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175307776 00002000:00100000:3.0:1746144896.778706:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093256680 x1830965175307776/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.778716:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256680 with x1830965175307776 ext(0->4095) 00010000:00010000:3.0:1746144896.778724:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95175 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.778737:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95175 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.778744:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093256680 00000100:00100000:3.0:1746144896.779316:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2214 00000100:00100000:3.0:1746144896.779325:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175307776:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144896.779501:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093256680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175307776:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 177us (1021us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.779507:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2214 00002000:00100000:3.0:1746144896.779513:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093256680 x1830965175307776/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.779520:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093256680 with x1830965175307776 ext(0->4095) 00010000:00010000:3.0:1746144896.779525:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95175 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.779538:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95175 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.779543:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093256680 00000100:00100000:0.0:1746144896.782544:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.783259:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175307904 00000100:00100000:3.0:1746144896.783269:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175307904 00010000:00010000:3.0:1746144896.783309:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95175 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.783671:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11183 00000100:00100000:3.0:1746144896.783681:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175307904:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.783696:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.783717:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95175 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.783729:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95175 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.783752:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515711 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95175 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.783805:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.783807:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.783814:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9517c expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.783825:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9517c expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.783857:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9517c expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.783867:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172514688:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.784292:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42180 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.786085:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172514688:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.786103:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.786161:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175307904:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2480us (3627us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.786170:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11183 00000100:00100000:0.0:1746144896.786997:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.787359:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175308160 00000100:00100000:1.0:1746144896.787366:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175308160 00002000:00100000:1.0:1746144896.787409:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093257100 x1830965175308160/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.787419:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257100 with x1830965175308160 ext(0->4095) 00002000:00010000:1.0:1746144896.787424:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093257100 00000100:00100000:1.0:1746144896.787450:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4174 00000100:00100000:1.0:1746144896.787458:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1985:x1830965175308160:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144896.787643:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1985:x1830965175308160:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 185us (646us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.787649:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4174 00002000:00100000:1.0:1746144896.787654:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093257100 x1830965175308160/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.787662:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257100 with x1830965175308160 ext(0->4095) 00002000:00010000:1.0:1746144896.787665:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093257100 00000100:00100000:0.0:1746144896.789893:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.790170:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175308288 00000100:00100000:3.0:1746144896.790178:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175308288 00000100:00100000:3.0:1746144896.790461:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5768 00000100:00100000:3.0:1746144896.790468:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175308288:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.790504:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.790521:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751571f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95183 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.790549:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9517c expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.790557:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.790559:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.790562:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751571f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95183 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.790592:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9517c expref: 75 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.790601:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9517c expref: 75 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.790611:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172514816:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.790698:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42180 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.792874:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172514816:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.792900:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751571f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95183 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.792923:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:3.0:1746144896.792959:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175308288:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2491us (3074us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.792967:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5768 00000100:00100000:0.0:1746144896.793172:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.793626:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175308416 00000100:00100000:3.0:1746144896.793632:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175308416 00002000:00100000:3.0:1746144896.793668:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880093254700 x1830965175308416/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.793678:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254700 with x1830965175308416 ext(0->7) 00010000:00010000:3.0:1746144896.793684:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9517c expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.793701:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9517c expref: 76 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.793707:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093254700 00000100:00100000:3.0:1746144896.793992:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2215 00000100:00100000:3.0:1746144896.794000:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+76:1984:x1830965175308416:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144896.794497:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1984:x1830965175308416:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 497us (1325us total) trans 4294968045 rc 0/0 00000100:00100000:3.0:1746144896.794505:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2215 00002000:00100000:3.0:1746144896.794511:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880093254700 x1830965175308416/t4294968045(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/448 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.794518:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254700 with x1830965175308416 ext(0->7) 00010000:00010000:3.0:1746144896.794523:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9517c expref: 78 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.794532:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9517c expref: 78 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.794537:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093254700 00000100:00100000:0.0:1746144896.796361:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.796452:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175308544 00000100:00100000:3.0:1746144896.796459:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175308544 00010000:00010000:3.0:1746144896.796490:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9517c expref: 78 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.796521:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11184 00000100:00100000:3.0:1746144896.796528:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1984:x1830965175308544:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.796541:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.796559:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9517c expref: 78 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.796570:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9517c expref: 78 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.796591:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af6727515718 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9517c expref: 78 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.796621:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.796623:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.796631:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751571f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95183 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.796639:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751571f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95183 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.796674:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751571f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95183 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.796732:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172514944:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.797026:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42180 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.800418:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172514944:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.800439:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.800491:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1984:x1830965175308544:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3962us (4136us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.800502:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11184 00000100:00100000:0.0:1746144896.800802:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.800884:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175308800 00000100:00100000:2.0:1746144896.800892:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175308800 00002000:00100000:2.0:1746144896.800946:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358efb80 x1830965175308800/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.800956:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358efb80 with x1830965175308800 ext(0->4095) 00002000:00010000:2.0:1746144896.800960:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801358efb80 00000100:00100000:2.0:1746144896.800988:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4175 00000100:00100000:2.0:1746144896.800996:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175308800:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144896.804190:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175308800:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 3184us (3377us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.804204:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4175 00002000:00100000:2.0:1746144896.804213:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358efb80 x1830965175308800/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.804222:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358efb80 with x1830965175308800 ext(0->4095) 00002000:00010000:2.0:1746144896.804227:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801358efb80 00000100:00100000:0.0:1746144896.806712:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.806892:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175308928 00000100:00100000:3.0:1746144896.806901:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175308928 00000100:00100000:3.0:1746144896.806955:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5769 00000100:00100000:3.0:1746144896.806963:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:31579:x1830965175308928:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.806979:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.806997:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9518a expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.807031:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751571f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95183 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.807038:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.807039:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.807042:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9518a expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.807071:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751571f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95183 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.807081:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751571f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95183 expref: 5 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.807092:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172515072:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144896.807308:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.807785:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42180 going to sleep for 11 seconds 00000100:00100000:1.0:1746144896.808098:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175309056 00000100:00100000:1.0:1746144896.808103:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175309056 00000100:00100000:1.0:1746144896.808208:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5770 00000100:00100000:1.0:1746144896.808215:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+79:31565:x1830965175309056:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144896.808223:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144896.808231:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95191 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.808247:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144896.808251:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9518a expref: 80 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.808258:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144896.808260:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95191 expref: 80 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.808281:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9518a expref: 80 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.808290:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95191 expref: 80 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.808299:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d600, rc 0) 00000100:00100000:1.0:1746144896.808638:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+80:31565:x1830965175309056:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 423us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144896.808644:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5770 00000100:00100000:3.0:1746144896.809272:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172515072:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.809290:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9518a expref: 79 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.809300:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:3.0:1746144896.809320:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+79:31579:x1830965175308928:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2359us (2616us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.809325:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5769 00000100:00100000:0.0:1746144896.809480:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.809758:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175309184 00000100:00100000:3.0:1746144896.809787:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175309184 00010000:00010000:3.0:1746144896.809805:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751571f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95183 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.809826:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11185 00000100:00100000:3.0:1746144896.809831:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175309184:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.809839:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.809859:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751571f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95183 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.809870:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751571f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95183 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.809889:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751571f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95183 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.809922:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.809924:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.809930:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9518a expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.809938:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9518a expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.809957:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9518a expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.809965:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9518a expref: 78 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.809975:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172515328:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.810027:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42180 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.811597:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172515328:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.811610:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.811651:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175309184:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1818us (2170us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.811659:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11185 00000100:00100000:0.0:1746144896.812713:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.812784:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175309440 00000100:00100000:3.0:1746144896.812789:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175309440 00002000:00100000:3.0:1746144896.812825:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358edc00 x1830965175309440/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.812834:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358edc00 with x1830965175309440 ext(0->4095) 00010000:00010000:3.0:1746144896.812841:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9518a expref: 79 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.812852:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9518a expref: 79 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.812859:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801358edc00 00000100:00100000:3.0:1746144896.812878:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2216 00000100:00100000:3.0:1746144896.812884:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+79:1984:x1830965175309440:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.813670:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+79:1984:x1830965175309440:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 783us (956us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.813678:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2216 00002000:00100000:3.0:1746144896.813685:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358edc00 x1830965175309440/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.813692:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358edc00 with x1830965175309440 ext(0->4095) 00010000:00010000:3.0:1746144896.813697:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9518a expref: 79 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.813707:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9518a expref: 79 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.813712:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801358edc00 00000100:00100000:0.0:1746144896.815652:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.815707:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175309568 00000100:00100000:3.0:1746144896.815714:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175309568 00000100:00100000:3.0:1746144896.815880:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5771 00000100:00100000:3.0:1746144896.815889:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175309568:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.815907:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.815948:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95198 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.815976:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.815982:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95191 expref: 78 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.815987:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144896.815990:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95198 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.816025:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95191 expref: 78 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.816036:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95198 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.816045:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:3.0:1746144896.816082:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175309568:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 196us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.816088:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5771 00000100:00100000:0.0:1746144896.816594:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.816854:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175309696 00000100:00100000:1.0:1746144896.816859:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175309696 00010000:00010000:1.0:1746144896.816880:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9518a expref: 79 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:1.0:1746144896.816908:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11186 00000100:00100000:1.0:1746144896.816921:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+79:1984:x1830965175309696:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144896.816930:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144896.816948:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9518a expref: 79 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.816959:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9518a expref: 79 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.816979:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515726 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9518a expref: 79 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:1.0:1746144896.816995:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144896.816996:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144896.817002:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95191 expref: 78 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.817009:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95191 expref: 78 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.817054:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95191 expref: 78 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.817065:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95191 expref: 78 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:1.0:1746144896.817075:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172515584:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144896.817137:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144896.818749:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172515584:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144896.818794:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144896.818889:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1984:x1830965175309696:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1910us (2237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144896.818901:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11186 00000100:00100000:0.0:1746144896.819394:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.819801:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175309952 00000100:00100000:3.0:1746144896.819807:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175309952 00002000:00100000:3.0:1746144896.819840:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358eed80 x1830965175309952/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.819849:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358eed80 with x1830965175309952 ext(0->4095) 00010000:00010000:3.0:1746144896.819856:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95191 expref: 78 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.819873:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95191 expref: 78 pid: 8432 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.819879:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801358eed80 00000100:00100000:3.0:1746144896.819908:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2217 00000100:00100000:3.0:1746144896.819924:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1984:x1830965175309952:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.820099:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1984:x1830965175309952:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 175us (705us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.820106:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2217 00002000:00100000:3.0:1746144896.820111:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8801358eed80 x1830965175309952/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.820118:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801358eed80 with x1830965175309952 ext(0->4095) 00010000:00010000:3.0:1746144896.820122:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95191 expref: 78 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.820131:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95191 expref: 78 pid: 8432 timeout: 590 lvb_type: 0 00002000:00010000:3.0:1746144896.820137:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8801358eed80 00000100:00100000:0.0:1746144896.821989:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.822079:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144896.822172:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175310080 00000100:00100000:1.0:1746144896.822179:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175310080 00000100:00100000:1.0:1746144896.822231:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5772 00000100:00100000:1.0:1746144896.822239:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+78:31565:x1830965175310080:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144896.822254:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144896.822272:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af672751573b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9519f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.822297:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144896.822302:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95198 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.822307:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144896.822310:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af672751573b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9519f expref: 79 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.822345:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95198 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.822356:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af672751573b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9519f expref: 79 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144896.822366:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966ce00, rc 0) 00000100:00100000:1.0:1746144896.822405:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+79:31565:x1830965175310080:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 167us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144896.822411:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5772 00000100:00100000:2.0:1746144896.823005:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175310208 00000100:00100000:2.0:1746144896.823009:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175310208 00010000:00010000:2.0:1746144896.823033:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95191 expref: 79 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.823175:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11187 00000100:00100000:2.0:1746144896.823184:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+79:1985:x1830965175310208:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.823193:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.823215:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95191 expref: 79 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.823226:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95191 expref: 79 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.823244:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751572d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95191 expref: 79 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.823259:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.823260:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.823266:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95198 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.823277:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95198 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.823299:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95198 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.823309:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95198 expref: 5 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.823320:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172515840:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.823378:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.825617:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172515840:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.825644:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.825695:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1985:x1830965175310208:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2511us (3614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.825705:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11187 00000100:00100000:0.0:1746144896.826758:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.827154:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175310464 00000100:00100000:2.0:1746144896.827161:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175310464 00002000:00100000:0.0:1746144896.827318:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b460a80 x1830965175310464/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144896.827328:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460a80 with x1830965175310464 ext(0->4095) 00010000:00010000:0.0:1746144896.827337:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95198 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:0.0:1746144896.827351:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95198 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:0.0:1746144896.827357:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b460a80 00000100:00100000:0.0:1746144896.827385:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2218 00000100:00100000:0.0:1746144896.827392:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175310464:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144896.827566:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175310464:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 173us (810us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144896.827572:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2218 00002000:00100000:0.0:1746144896.827577:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b460a80 x1830965175310464/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144896.827585:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460a80 with x1830965175310464 ext(0->4095) 00010000:00010000:0.0:1746144896.827589:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95198 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:0.0:1746144896.827599:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95198 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00002000:00010000:0.0:1746144896.827605:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b460a80 00000100:00100000:0.0:1746144896.832853:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.832931:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175310592 00000100:00100000:2.0:1746144896.832940:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175310592 00010000:00010000:2.0:1746144896.832983:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95198 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.833022:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11188 00000100:00100000:2.0:1746144896.833031:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175310592:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.833051:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.833073:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95198 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.833086:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95198 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.833110:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515734 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95198 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:2.0:1746144896.833140:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.833142:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.833149:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af672751573b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9519f expref: 77 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.833157:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af672751573b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9519f expref: 77 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.833190:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af672751573b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9519f expref: 77 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.833202:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172515968:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.833289:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880093aba300 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.836709:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172515968:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.836741:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.836827:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175310592:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3796us (3983us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.836842:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11188 00000100:00100000:0.0:1746144896.839004:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.839104:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175310848 00000100:00100000:3.0:1746144896.839112:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175310848 00002000:00100000:3.0:1746144896.839248:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b461f80 x1830965175310848/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.839258:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b461f80 with x1830965175310848 ext(0->4095) 00002000:00010000:3.0:1746144896.839263:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b461f80 00000100:00100000:3.0:1746144896.839283:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4176 00000100:00100000:3.0:1746144896.839290:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1984:x1830965175310848:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.839698:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1984:x1830965175310848:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 407us (700us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.839704:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4176 00002000:00100000:3.0:1746144896.839709:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b461f80 x1830965175310848/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.839716:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b461f80 with x1830965175310848 ext(0->4095) 00002000:00010000:3.0:1746144896.839719:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b461f80 00000100:00100000:0.0:1746144896.841818:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.842019:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175310976 00000100:00100000:3.0:1746144896.842026:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175310976 00000100:00100000:3.0:1746144896.842061:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5773 00000100:00100000:3.0:1746144896.842067:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175310976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.842083:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.842103:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515742 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af951a6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.842131:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af672751573b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9519f expref: 77 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.842138:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.842140:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.842143:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515742 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951a6 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.842326:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af672751573b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9519f expref: 77 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.842338:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af672751573b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9519f expref: 77 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.842348:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172516096:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.842888:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.844756:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172516096:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.844811:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515742 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951a6 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.844828:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:3.0:1746144896.844868:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175310976:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2799us (3055us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.844877:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5773 00000100:00100000:0.0:1746144896.845050:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.845301:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175311104 00000100:00100000:3.0:1746144896.845306:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175311104 00010000:00010000:3.0:1746144896.845331:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af672751573b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9519f expref: 78 pid: 8432 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.845352:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11189 00000100:00100000:3.0:1746144896.845359:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801309a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1985:x1830965175311104:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.845370:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.845394:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af672751573b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9519f expref: 78 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.845404:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af672751573b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9519f expref: 78 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.845426:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af672751573b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9519f expref: 78 pid: 8432 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.845461:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.845749:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.845757:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515742 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951a6 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.845837:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515742 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951a6 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.845904:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515742 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951a6 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144896.845925:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b460380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172516224:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144896.846239:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.848495:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.848556:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175311360 00000100:00100000:3.0:1746144896.848563:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175311360 00000100:00100000:2.0:1746144896.848596:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b460380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172516224:192.168.202.16@tcp:105: 00002000:00100000:3.0:1746144896.848608:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b460e00 x1830965175311360/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.848617:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460e00 with x1830965175311360 ext(0->4095) 00010000:00010000:2.0:1746144896.848617:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:3.0:1746144896.848622:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b460e00 00000100:00100000:3.0:1746144896.848642:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4177 00000100:00100000:3.0:1746144896.848649:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175311360:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144896.848657:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801309a5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+77:1985:x1830965175311104:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3298us (3608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.848668:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11189 00000100:00100000:3.0:1746144896.848848:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175311360:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 199us (358us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.848856:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4177 00002000:00100000:3.0:1746144896.848860:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b460e00 x1830965175311360/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.848866:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460e00 with x1830965175311360 ext(0->4095) 00002000:00010000:3.0:1746144896.848868:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b460e00 00000100:00100000:0.0:1746144896.849934:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.850087:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175311488 00000100:00100000:2.0:1746144896.850092:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175311488 00000100:00100000:2.0:1746144896.850130:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5774 00000100:00100000:2.0:1746144896.850137:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+77:31565:x1830965175311488:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.850149:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.850165:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af951ad expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.850191:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515742 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951a6 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.850199:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.850200:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.850204:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ad expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.850234:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515742 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951a6 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.850245:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515742 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951a6 expref: 5 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:2.0:1746144896.850257:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172516352:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.851018:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.851464:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.851522:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175311616 00000100:00100000:2.0:1746144896.851526:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175311616 00000100:00100000:2.0:1746144896.851553:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5775 00000100:00100000:2.0:1746144896.851559:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+79:31579:x1830965175311616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.851569:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.851581:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4ce3e00/0x4076af6727515750 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af951b4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.851963:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.851970:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ad expref: 80 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.851976:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.851980:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ce3e00/0x4076af6727515750 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951b4 expref: 80 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.852011:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ad expref: 80 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.852025:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ce3e00/0x4076af6727515750 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951b4 expref: 80 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.852034:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4ce3e00, rc 0) 00000100:00100000:2.0:1746144896.852064:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+80:31579:x1830965175311616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 504us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.852072:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5775 00000100:00100000:3.0:1746144896.852329:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172516352:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.852352:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ad expref: 79 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.852360:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbbd000, rc 0) 00000100:00100000:3.0:1746144896.852385:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+79:31565:x1830965175311488:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2249us (2453us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.852391:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5774 00000100:00100000:0.0:1746144896.852696:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.852786:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175311744 00000100:00100000:3.0:1746144896.852790:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175311744 00010000:00010000:3.0:1746144896.852812:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515742 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951a6 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00000100:00100000:3.0:1746144896.852843:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11190 00000100:00100000:3.0:1746144896.852848:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175311744:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.852858:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.852878:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515742 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951a6 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.852894:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515742 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951a6 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.852928:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515742 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951a6 expref: 6 pid: 8430 timeout: 590 lvb_type: 0 00010000:00010000:3.0:1746144896.852954:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.852956:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.852961:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ad expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.852968:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ad expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.852990:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ad expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.852999:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ad expref: 78 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144896.853008:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172516608:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.853064:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.855101:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172516608:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.855120:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.855164:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175311744:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2314us (2467us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.855177:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11190 00000100:00100000:0.0:1746144896.855577:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.855988:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175312000 00000100:00100000:2.0:1746144896.855996:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175312000 00002000:00100000:2.0:1746144896.856039:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b461500 x1830965175312000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.856048:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b461500 with x1830965175312000 ext(0->4095) 00010000:00010000:2.0:1746144896.856056:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ad expref: 79 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.856067:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ad expref: 79 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144896.856073:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b461500 00000100:00100000:2.0:1746144896.856533:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2219 00000100:00100000:2.0:1746144896.856541:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+79:1984:x1830965175312000:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144896.856703:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+79:1984:x1830965175312000:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 163us (1126us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144896.856708:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2219 00002000:00100000:2.0:1746144896.856714:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b461500 x1830965175312000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144896.856721:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b461500 with x1830965175312000 ext(0->4095) 00010000:00010000:2.0:1746144896.856725:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ad expref: 79 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.856738:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ad expref: 79 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144896.856742:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b461500 00000100:00100000:0.0:1746144896.860100:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.860312:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175312128 00000100:00100000:3.0:1746144896.860321:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175312128 00010000:00010000:3.0:1746144896.860355:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ad expref: 79 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144896.860384:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11191 00000100:00100000:3.0:1746144896.860391:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+79:1983:x1830965175312128:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144896.860404:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144896.860433:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ad expref: 79 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144896.860446:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ad expref: 79 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144896.860469:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515749 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ad expref: 79 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144896.860486:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.860488:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.860495:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ce3e00/0x4076af6727515750 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951b4 expref: 78 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.860502:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ce3e00/0x4076af6727515750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951b4 expref: 78 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.860536:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4ce3e00/0x4076af6727515750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951b4 expref: 78 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144896.861157:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172516736:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144896.861250:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.864516:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172516736:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144896.864539:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.865274:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1983:x1830965175312128:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4878us (5180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.865287:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11191 00000100:00100000:0.0:1746144896.865546:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.865663:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175312384 00000100:00100000:3.0:1746144896.865669:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175312384 00002000:00100000:3.0:1746144896.865704:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b463100 x1830965175312384/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.865714:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463100 with x1830965175312384 ext(0->4095) 00002000:00010000:3.0:1746144896.865718:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b463100 00000100:00100000:3.0:1746144896.865746:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4178 00000100:00100000:3.0:1746144896.865753:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1985:x1830965175312384:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144896.866133:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1985:x1830965175312384:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 380us (587us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.866140:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4178 00002000:00100000:3.0:1746144896.866146:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b463100 x1830965175312384/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.866153:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463100 with x1830965175312384 ext(0->4095) 00002000:00010000:3.0:1746144896.866156:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b463100 00000100:00100000:0.0:1746144896.868163:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.868336:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175312512 00000100:00100000:3.0:1746144896.868343:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175312512 00000100:00100000:3.0:1746144896.868391:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5776 00000100:00100000:3.0:1746144896.868398:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175312512:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.868412:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.868430:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af951bb expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.868457:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ce3e00/0x4076af6727515750 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951b4 expref: 77 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.868465:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.868467:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.868470:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951bb expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.868500:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4ce3e00/0x4076af6727515750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951b4 expref: 77 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.868512:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4ce3e00/0x4076af6727515750 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951b4 expref: 77 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144896.868524:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172516864:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144896.869372:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144896.872535:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172516864:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144896.872541:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.872604:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175312640 00000100:00100000:2.0:1746144896.872611:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175312640 00010000:00010000:2.0:1746144896.872647:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4ce3e00/0x4076af6727515750 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951b4 expref: 78 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144896.872674:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11192 00000100:00100000:2.0:1746144896.872681:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1985:x1830965175312640:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.872692:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.872711:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4ce3e00/0x4076af6727515750 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951b4 expref: 78 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.872721:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4ce3e00/0x4076af6727515750 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951b4 expref: 78 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.872743:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4ce3e00/0x4076af6727515750 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951b4 expref: 78 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.872798:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.872801:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.872809:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951bb expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.873828:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951bb expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.874131:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951bb expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.874149:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:3.0:1746144896.874212:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175312512:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5813us (6054us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.874220:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5776 00010000:00010000:2.0:1746144896.874290:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951bb expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.874303:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172516992:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.874364:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.878644:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.878709:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175312768 00000100:00100000:3.0:1746144896.878718:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175312768 00000100:00100000:3.0:1746144896.878792:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5777 00000100:00100000:3.0:1746144896.878875:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+78:31565:x1830965175312768:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.878894:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.878919:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af951c2 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.878950:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951bb expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.878961:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.878963:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.878966:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c2 expref: 79 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.878997:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951bb expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.879009:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951bb expref: 5 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144896.879027:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172517120:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.879309:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172516992:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.879330:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144896.879472:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.879490:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.879541:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175313024 00000100:00100000:3.0:1746144896.879545:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175313024 00002000:00100000:3.0:1746144896.879579:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b460380 x1830965175313024/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.879588:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460380 with x1830965175313024 ext(0->4095) 00010000:00010000:3.0:1746144896.879594:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951bb expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144896.879603:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951bb expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144896.879608:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b460380 00000100:00100000:2.0:1746144896.879621:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+79:1985:x1830965175312640:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6936us (7078us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.879623:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2220 00000100:00100000:3.0:1746144896.879629:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175313024:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144896.879634:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11192 00000100:00100000:3.0:1746144896.879827:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175313024:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 197us (345us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.879834:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2220 00002000:00100000:3.0:1746144896.879839:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b460380 x1830965175313024/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.879846:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460380 with x1830965175313024 ext(0->4095) 00010000:00010000:3.0:1746144896.879850:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951bb expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144896.879859:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951bb expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144896.879864:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b460380 00000100:00100000:3.0:1746144896.882072:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172517120:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144896.882150:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c2 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.882166:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:3.0:1746144896.882217:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+78:31565:x1830965175312768:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3343us (3583us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.882225:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5777 00000100:00100000:0.0:1746144896.883022:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.883477:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175313152 00000100:00100000:3.0:1746144896.883485:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175313152 00000100:00100000:3.0:1746144896.883531:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5778 00000100:00100000:3.0:1746144896.883537:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+78:31579:x1830965175313152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144896.883553:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144896.883569:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af951c9 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.883592:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144896.883597:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c2 expref: 79 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.883602:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144896.883606:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c9 expref: 79 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.883637:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c2 expref: 79 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.883646:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c9 expref: 79 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144896.883653:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:3.0:1746144896.883682:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+79:31579:x1830965175313152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 145us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144896.883686:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5778 00000100:00100000:0.0:1746144896.890014:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.890187:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175313280 00000100:00100000:2.0:1746144896.890198:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175313280 00010000:00010000:2.0:1746144896.890244:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951bb expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144896.890274:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11193 00000100:00100000:2.0:1746144896.890282:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175313280:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.890296:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.890318:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951bb expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.890335:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951bb expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.890358:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af6727515757 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951bb expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.890551:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.890553:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.890562:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c2 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.890570:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c2 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.890606:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c2 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.890617:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c2 expref: 78 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144896.890628:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172517376:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.890719:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.897027:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172517376:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.897063:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.897125:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175313280:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6843us (7122us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.897140:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11193 00000100:00100000:1.0:1746144896.897558:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.897661:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175313536 00000100:00100000:3.0:1746144896.897669:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175313536 00002000:00100000:3.0:1746144896.897709:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5c000 x1830965175313536/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.897719:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5c000 with x1830965175313536 ext(0->4095) 00010000:00010000:3.0:1746144896.897728:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c2 expref: 79 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144896.897742:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c2 expref: 79 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144896.897748:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5c000 00000100:00100000:3.0:1746144896.901028:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2221 00000100:00100000:3.0:1746144896.901046:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+79:1983:x1830965175313536:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:3.0:1746144896.901380:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+79:1983:x1830965175313536:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 335us (3817us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.901389:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2221 00002000:00100000:3.0:1746144896.901396:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5c000 x1830965175313536/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.901404:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5c000 with x1830965175313536 ext(0->4095) 00010000:00010000:3.0:1746144896.901412:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c2 expref: 79 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144896.901426:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c2 expref: 79 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144896.901431:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5c000 00000100:00100000:0.0:1746144896.905745:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.907954:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175313664 00000100:00100000:2.0:1746144896.907969:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175313664 00010000:00010000:2.0:1746144896.908021:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c2 expref: 79 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144896.908056:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11194 00000100:00100000:2.0:1746144896.908064:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+79:1984:x1830965175313664:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.908079:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.908102:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c2 expref: 79 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.908114:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c2 expref: 79 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.908138:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752a00/0x4076af672751575e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c2 expref: 79 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.908172:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.908174:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.908181:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c9 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.908188:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c9 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.908220:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c9 expref: 78 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.908232:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172517504:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.909968:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.914215:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172517504:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.914241:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.914291:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1984:x1830965175313664:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6227us (8558us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.914300:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11194 00000100:00100000:0.0:1746144896.914467:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.914583:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175313920 00000100:00100000:3.0:1746144896.914589:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175313920 00002000:00100000:3.0:1746144896.914620:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b4f9880 x1830965175313920/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.914628:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4f9880 with x1830965175313920 ext(0->4095) 00002000:00010000:3.0:1746144896.914632:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4f9880 00000100:00100000:3.0:1746144896.914648:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4179 00000100:00100000:3.0:1746144896.914654:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+79:1984:x1830965175313920:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144896.921741:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1984:x1830965175313920:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 7075us (7269us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.921752:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4179 00002000:00100000:3.0:1746144896.921776:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b4f9880 x1830965175313920/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.921783:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4f9880 with x1830965175313920 ext(0->4095) 00002000:00010000:3.0:1746144896.921788:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4f9880 00000100:00100000:0.0:1746144896.928360:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.928702:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175314048 00000100:00100000:2.0:1746144896.928712:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175314048 00000100:00100000:2.0:1746144896.928793:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5779 00000100:00100000:2.0:1746144896.928802:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175314048:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144896.928820:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144896.928838:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af951d0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.928871:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c9 expref: 77 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.928878:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.928880:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144896.928883:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d0 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.928925:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c9 expref: 77 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.928941:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c9 expref: 77 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144896.928953:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172517632:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144896.931161:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.934976:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172517632:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.935016:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d0 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.935034:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009422a400, rc 0) 00000100:00100000:2.0:1746144896.935079:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175314048:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 6277us (6731us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.935087:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5779 00000100:00100000:0.0:1746144896.937653:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.937879:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175314176 00000100:00100000:3.0:1746144896.937892:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175314176 00002000:00100000:3.0:1746144896.937951:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009b030e00 x1830965175314176/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.937962:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b030e00 with x1830965175314176 ext(0->7) 00010000:00010000:3.0:1746144896.937971:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c9 expref: 78 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144896.937983:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c9 expref: 78 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144896.937990:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b030e00 00000100:00100000:3.0:1746144896.938485:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2222 00000100:00100000:3.0:1746144896.938494:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+78:1982:x1830965175314176:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144896.939691:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+80:1982:x1830965175314176:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 1196us (2045us total) trans 4294968046 rc 0/0 00000100:00100000:3.0:1746144896.939700:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2222 00002000:00100000:3.0:1746144896.939718:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009b030e00 x1830965175314176/t4294968046(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/448 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.939727:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b030e00 with x1830965175314176 ext(0->7) 00010000:00010000:3.0:1746144896.939734:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c9 expref: 80 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144896.939746:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c9 expref: 80 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144896.939751:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b030e00 00000100:00100000:0.0:1746144896.946215:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.946619:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175314304 00000100:00100000:2.0:1746144896.946629:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175314304 00010000:00010000:2.0:1746144896.946676:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c9 expref: 80 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144896.946717:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11195 00000100:00100000:2.0:1746144896.946726:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b032300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+80:1985:x1830965175314304:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.946740:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.946789:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c9 expref: 80 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.946809:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c9 expref: 80 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.946832:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515765 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951c9 expref: 80 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.946862:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.946864:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.946872:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d0 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.946879:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d0 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.946984:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d0 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.946996:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172517760:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.947464:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.952303:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.952519:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175314432 00000100:00100000:0.0:1746144896.952527:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175314432 00000100:00100000:0.0:1746144896.952582:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5780 00000100:00100000:0.0:1746144896.952590:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+80:31565:x1830965175314432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144896.952609:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144896.952625:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af951d7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.952653:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d0 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.952660:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144896.952662:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144896.952665:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d7 expref: 81 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.952692:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d0 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.952703:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d0 expref: 5 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:0.0:1746144896.952714:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b031500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172517888:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144896.952823:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144896.954821:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172517760:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.954848:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.954884:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b032300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+81:1985:x1830965175314304:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 8160us (8680us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.954893:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11195 00000100:00100000:0.0:1746144896.955241:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.955574:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175314688 00000100:00100000:3.0:1746144896.955581:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175314688 00002000:00100000:3.0:1746144896.955620:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b031f80 x1830965175314688/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.955630:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031f80 with x1830965175314688 ext(0->4095) 00010000:00010000:3.0:1746144896.955638:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d0 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144896.955650:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d0 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144896.955656:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b031f80 00000100:00100000:3.0:1746144896.955673:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2223 00000100:00100000:3.0:1746144896.955678:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175314688:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144896.955859:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175314688:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 180us (618us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144896.955865:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2223 00002000:00100000:3.0:1746144896.955870:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b031f80 x1830965175314688/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.955877:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031f80 with x1830965175314688 ext(0->4095) 00010000:00010000:3.0:1746144896.955882:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d0 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144896.955891:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d0 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144896.955897:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b031f80 00000100:00100000:2.0:1746144896.956056:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b031500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172517888:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.956073:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d7 expref: 80 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.956086:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b3c00, rc 0) 00000100:00100000:2.0:1746144896.956106:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+80:31565:x1830965175314432:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3518us (3815us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.956112:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5780 00000100:00100000:0.0:1746144896.965103:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.965236:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175314816 00000100:00100000:2.0:1746144896.965247:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175314816 00010000:00010000:2.0:1746144896.965289:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d0 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144896.965327:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11196 00000100:00100000:2.0:1746144896.965335:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175314816:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144896.965351:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144896.965372:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d0 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.965384:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d0 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.965407:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af672751576c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d0 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144896.966632:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.966636:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144896.966647:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d7 expref: 79 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.966656:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d7 expref: 79 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.966696:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d7 expref: 79 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144896.966708:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172518016:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144896.967408:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.970381:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144896.970494:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172518016:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144896.970520:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144896.970560:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175314816:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5226us (5468us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144896.970570:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11196 00000100:00100000:1.0:1746144896.970663:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175315072 00000100:00100000:1.0:1746144896.970670:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175315072 00002000:00100000:1.0:1746144896.970710:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b031c00 x1830965175315072/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.970719:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031c00 with x1830965175315072 ext(0->4095) 00002000:00010000:1.0:1746144896.970724:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b031c00 00000100:00100000:1.0:1746144896.971294:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4180 00000100:00100000:1.0:1746144896.971302:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+80:1985:x1830965175315072:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144896.971467:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+80:1985:x1830965175315072:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 166us (1095us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144896.971472:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4180 00002000:00100000:1.0:1746144896.971477:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b031c00 x1830965175315072/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 488/4536 e 0 to 0 dl 1746144907 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144896.971485:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031c00 with x1830965175315072 ext(0->4095) 00002000:00010000:1.0:1746144896.971488:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b031c00 00000100:00100000:2.0:1746144896.987884:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144896.987963:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175315200 00000100:00100000:0.0:1746144896.987974:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175315200 00000100:00100000:0.0:1746144896.988023:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5781 00000100:00100000:0.0:1746144896.988031:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175315200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144896.988050:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144896.988068:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af951de expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.988099:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d7 expref: 79 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.988106:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144896.988108:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144896.988111:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951de expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.988143:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d7 expref: 79 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144896.988154:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d7 expref: 79 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:0.0:1746144896.988166:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b032d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172518144:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144896.988432:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144896.993713:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144896.993804:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175315328 00000100:00100000:3.0:1746144896.993817:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175315328 00000100:00100000:2.0:1746144896.993940:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b032d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172518144:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144896.993965:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951de expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144896.993979:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b3000, rc 0) 00002000:00100000:3.0:1746144896.994009:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009b030700 x1830965175315328/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/0 e 0 to 0 dl 1746144907 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.994018:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b030700 with x1830965175315328 ext(0->7) 00000100:00100000:2.0:1746144896.994023:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175315200:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5991us (6148us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144896.994026:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d7 expref: 80 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144896.994031:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5781 00010000:00010000:3.0:1746144896.994039:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d7 expref: 80 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144896.994045:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b030700 00000100:00100000:3.0:1746144896.994077:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2224 00000100:00100000:3.0:1746144896.994084:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+80:1983:x1830965175315328:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144896.994953:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1983:x1830965175315328:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 867us (1245us total) trans 4294968047 rc 0/0 00000100:00100000:3.0:1746144896.994961:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2224 00002000:00100000:3.0:1746144896.994967:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009b030700 x1830965175315328/t4294968047(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:537/0 lens 496/448 e 0 to 0 dl 1746144907 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144896.994981:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b030700 with x1830965175315328 ext(0->7) 00010000:00010000:3.0:1746144896.994986:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d7 expref: 82 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144896.994996:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d7 expref: 82 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144896.995001:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b030700 00000100:00100000:0.0:1746144897.006010:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.006068:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.006307:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175315456 00000100:00100000:2.0:1746144897.006317:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175315456 00000100:00100000:2.0:1746144897.006372:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5782 00000100:00080000:0.0:1746144897.007903:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746144897.008044:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+82:31565:x1830965175315456:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144897.008069:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.008087:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af951e5 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.008116:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144897.008121:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951de expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.008127:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144897.008130:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951e5 expref: 83 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.008165:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951de expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144897.008201:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175315584 00000100:00100000:3.0:1746144897.008205:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175315584 00010000:00010000:3.0:1746144897.008225:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d7 expref: 84 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.008243:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11197 00000100:00100000:3.0:1746144897.008248:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1983:x1830965175315584:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.008254:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.008273:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d7 expref: 84 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.008283:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d7 expref: 84 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.008298:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515773 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951d7 expref: 84 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.008544:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951e5 expref: 83 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.008554:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.008555:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.008561:0:8432:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951de expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.008567:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951de expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.008585:0:8432:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951de expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.008596:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951de expref: 5 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.008606:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172518400:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.008699:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.009063:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.009101:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1983:x1830965175315584:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 851us (3030us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.009108:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11197 00000100:00100000:0.0:1746144897.012295:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.012391:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175315840 00000100:00100000:2.0:1746144897.012396:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172518400:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.012398:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175315840 00010000:00010000:2.0:1746144897.012421:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009422ae00, rc 0) 00002000:00100000:3.0:1746144897.012449:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b033b80 x1830965175315840/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.012458:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033b80 with x1830965175315840 ext(0->4095) 00010000:00010000:3.0:1746144897.012466:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951de expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.012479:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951de expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.012486:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b033b80 00000100:00080000:0.0:1746144897.012647:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746144897.013441:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+82:31565:x1830965175315456:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7060us (7439us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.013449:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5782 00000100:00100000:3.0:1746144897.013572:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2225 00000100:00100000:3.0:1746144897.013581:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175315840:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144897.013772:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175315840:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 181us (1476us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.013778:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2225 00002000:00100000:3.0:1746144897.013784:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b033b80 x1830965175315840/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.013792:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033b80 with x1830965175315840 ext(0->4095) 00010000:00010000:3.0:1746144897.013797:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951de expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.013811:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951de expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.013816:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b033b80 00000100:00100000:0.0:1746144897.017717:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.017817:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175315968 00000100:00100000:3.0:1746144897.017827:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175315968 00010000:00010000:3.0:1746144897.017860:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951de expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.017893:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11198 00000100:00100000:3.0:1746144897.017898:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b032a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175315968:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.017930:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.017952:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951de expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.017963:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951de expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.017987:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af672751577a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951de expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.018204:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.018207:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.018214:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951e5 expref: 81 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.018227:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951e5 expref: 81 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.018265:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951e5 expref: 81 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144897.018276:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172518528:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.018625:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.021509:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.021550:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175316224 00000100:00100000:2.0:1746144897.021557:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175316224 00002000:00100000:2.0:1746144897.021602:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b033480 x1830965175316224/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.021609:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033480 with x1830965175316224 ext(0->4095) 00002000:00010000:2.0:1746144897.021613:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b033480 00000100:00100000:2.0:1746144897.021629:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4181 00000100:00100000:2.0:1746144897.021634:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1983:x1830965175316224:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746144897.021954:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1983:x1830965175316224:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 317us (451us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.021956:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172518528:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.021960:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4181 00002000:00100000:2.0:1746144897.021966:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b033480 x1830965175316224/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00010000:00010000:3.0:1746144897.021974:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746144897.021978:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033480 with x1830965175316224 ext(0->4095) 00002000:00010000:2.0:1746144897.021980:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b033480 00000100:00100000:3.0:1746144897.022009:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b032a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175315968:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4110us (4299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.022017:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11198 00000100:00100000:0.0:1746144897.035075:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.040098:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175316352 00000100:00100000:0.0:1746144897.040118:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175316352 00000100:00100000:0.0:1746144897.040193:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5783 00000100:00100000:0.0:1746144897.040201:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175316352:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144897.040220:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144897.040239:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af951ec expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.040288:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951e5 expref: 81 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.040298:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.040300:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.040304:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ec expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.040342:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951e5 expref: 81 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.040354:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951e5 expref: 81 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.040366:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172518656:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.041276:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.042606:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172518656:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144897.042627:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ec expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.042642:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b3c00, rc 0) 00000100:00100000:3.0:1746144897.042675:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175316352:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2474us (7613us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.042683:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5783 00000100:00100000:0.0:1746144897.043986:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.044104:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175316480 00000100:00100000:3.0:1746144897.044114:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175316480 00002000:00100000:3.0:1746144897.044153:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009b030a80 x1830965175316480/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 496/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.044162:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b030a80 with x1830965175316480 ext(0->7) 00010000:00010000:3.0:1746144897.044170:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951e5 expref: 82 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.044182:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951e5 expref: 82 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.044189:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b030a80 00000100:00100000:3.0:1746144897.044223:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2226 00000100:00100000:3.0:1746144897.044230:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+82:1984:x1830965175316480:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:3.0:1746144897.044516:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b030a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175316480:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 286us (533us total) trans 4294968048 rc 0/0 00000100:00100000:3.0:1746144897.044522:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2226 00002000:00100000:3.0:1746144897.044528:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009b030a80 x1830965175316480/t4294968048(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 496/448 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.044535:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b030a80 with x1830965175316480 ext(0->7) 00010000:00010000:3.0:1746144897.044539:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951e5 expref: 84 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.044552:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951e5 expref: 84 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.044557:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b030a80 00000100:00100000:0.0:1746144897.049339:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.049389:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175316608 00000100:00100000:3.0:1746144897.049397:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175316608 00010000:00010000:3.0:1746144897.049422:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951e5 expref: 84 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.049449:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11199 00000100:00100000:3.0:1746144897.049454:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175316608:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.049462:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.049478:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951e5 expref: 84 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.049485:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951e5 expref: 84 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.049501:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515781 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951e5 expref: 84 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.049521:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.049522:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.049528:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ec expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.049535:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ec expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.049562:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ec expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144897.049572:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172518784:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.049648:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.056504:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.056567:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175316736 00000100:00100000:3.0:1746144897.056575:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175316736 00000100:00100000:2.0:1746144897.056677:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172518784:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.056700:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.056801:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175316608:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 7343us (7472us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.056811:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11199 00000100:00100000:3.0:1746144897.056845:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5784 00000100:00100000:3.0:1746144897.056853:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+83:31565:x1830965175316736:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.056869:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.056884:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af951f3 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.056920:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ec expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.056932:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.056934:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.056937:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951f3 expref: 84 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.056963:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ec expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.056973:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ec expref: 5 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.056984:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172518912:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.057053:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.058295:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.058415:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175316992 00000100:00100000:1.0:1746144897.058421:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175316992 00002000:00100000:1.0:1746144897.058452:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b032300 x1830965175316992/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.058461:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b032300 with x1830965175316992 ext(0->4095) 00010000:00010000:1.0:1746144897.058467:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ec expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.058478:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ec expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.058484:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b032300 00000100:00100000:1.0:1746144897.059310:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2227 00000100:00100000:1.0:1746144897.059319:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175316992:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144897.059465:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b032300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175316992:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 147us (1173us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.059470:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2227 00002000:00100000:1.0:1746144897.059475:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009b032300 x1830965175316992/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.059482:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b032300 with x1830965175316992 ext(0->4095) 00010000:00010000:1.0:1746144897.059487:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ec expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.059497:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ec expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.059502:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009b032300 00000100:00100000:3.0:1746144897.061081:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172518912:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144897.061103:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951f3 expref: 84 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.061116:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:3.0:1746144897.061151:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31565:x1830965175316736:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4299us (4655us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.061158:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5784 00000100:00100000:0.0:1746144897.067827:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.067882:0:3307:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746144897.067898:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172519040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746144897.067951:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144897.067980:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172519040 00000100:00100000:3.0:1746144897.067986:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172519040 00000100:00100000:3.0:1746144897.068033:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1746144897.068038:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172519040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746144897.068056:0:8434:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 436011008 pending 66453504 free 3855613952 avail 3853516800 00000100:00100000:3.0:1746144897.068081:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172519040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.068087:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1746144897.068119:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172519040:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1746144897.068184:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746144897.069041:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175317248 00000100:00100000:2.0:1746144897.069046:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175317248 00010000:00010000:2.0:1746144897.069073:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ec expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.069078:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.069102:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11200 00000100:00100000:2.0:1746144897.069108:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175317248:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.069116:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746144897.069155:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175317120 00000100:00100000:0.0:1746144897.069158:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175317120 00000100:00100000:0.0:1746144897.069185:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5785 00000100:00100000:0.0:1746144897.069190:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31579:x1830965175317120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144897.069197:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144897.069207:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727515796 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af951fa expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.069230:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ec expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.069242:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ec expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.069257:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3c00/0x4076af6727515788 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951ec expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.069277:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.069278:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.069284:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951f3 expref: 84 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.069290:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951f3 expref: 84 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.069311:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951f3 expref: 84 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.069318:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925ab100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172519168:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144897.069367:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951f3 expref: 85 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.069508:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144897.069509:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144897.069513:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727515796 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951fa expref: 85 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.069532:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951f3 expref: 85 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.069541:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951f3 expref: 85 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:0.0:1746144897.069548:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013619aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172519296:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144897.069613:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.069655:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.073325:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013619aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172519296:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144897.073351:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727515796 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951fa expref: 85 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.073366:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b2600, rc 0) 00000100:00100000:2.0:1746144897.073413:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:31579:x1830965175317120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4221us (4334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.073420:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5785 00000100:00100000:0.0:1746144897.073637:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.073675:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175317504 00000100:00100000:1.0:1746144897.073682:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175317504 00002000:00100000:1.0:1746144897.073711:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880136198700 x1830965175317504/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.073719:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136198700 with x1830965175317504 ext(0->4095) 00010000:00010000:1.0:1746144897.073725:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951f3 expref: 85 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.073735:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951f3 expref: 85 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.073746:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136198700 00000100:00100000:1.0:1746144897.073796:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2228 00000100:00100000:1.0:1746144897.073806:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1983:x1830965175317504:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:1.0:1746144897.074019:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136198700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1983:x1830965175317504:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 215us (382us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.074025:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2228 00002000:00100000:1.0:1746144897.074030:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880136198700 x1830965175317504/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.074036:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136198700 with x1830965175317504 ext(0->4095) 00010000:00010000:1.0:1746144897.074040:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951f3 expref: 85 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.074048:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951f3 expref: 85 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.074053:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136198700 00000100:00100000:2.0:1746144897.074113:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ab100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172519168:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.074127:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.074159:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175317248:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5050us (6340us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.074166:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11200 00000100:00100000:0.0:1746144897.078289:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.078611:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175317632 00000100:00100000:2.0:1746144897.078622:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175317632 00010000:00010000:2.0:1746144897.078656:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951f3 expref: 85 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.078689:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11201 00000100:00100000:2.0:1746144897.078695:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013619b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175317632:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.078705:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.078724:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951f3 expref: 85 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.078733:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951f3 expref: 85 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.078750:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751578f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951f3 expref: 85 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.078795:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.078797:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.078803:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727515796 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951fa expref: 84 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.078810:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727515796 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951fa expref: 84 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.078836:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727515796 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951fa expref: 84 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.078845:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925ab100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172519424:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.078905:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.084554:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.084620:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175317888 00000100:00100000:1.0:1746144897.084627:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175317888 00002000:00100000:1.0:1746144897.084659:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013619aa00 x1830965175317888/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.084668:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013619aa00 with x1830965175317888 ext(0->4095) 00002000:00010000:1.0:1746144897.084673:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013619aa00 00000100:00100000:2.0:1746144897.084811:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ab100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172519424:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.084832:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.084868:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013619b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+85:1984:x1830965175317632:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6172us (6586us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.084876:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11201 00000100:00100000:3.0:1746144897.085201:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4182 00000100:00100000:3.0:1746144897.085209:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013619aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175317888:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144897.085337:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013619aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175317888:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 129us (790us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.085343:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4182 00002000:00100000:3.0:1746144897.085347:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013619aa00 x1830965175317888/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.085354:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013619aa00 with x1830965175317888 ext(0->4095) 00002000:00010000:3.0:1746144897.085357:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013619aa00 00000100:00100000:0.0:1746144897.088298:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.088404:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175318016 00000100:00100000:2.0:1746144897.088411:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175318016 00000100:00100000:2.0:1746144897.088463:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5786 00000100:00100000:2.0:1746144897.088470:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175318016:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144897.088486:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.088500:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95201 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.088523:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727515796 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951fa expref: 83 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.088530:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144897.088532:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144897.088535:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95201 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.088558:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727515796 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951fa expref: 83 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.088567:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727515796 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951fa expref: 83 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.088583:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172519552:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144897.088650:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.090370:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172519552:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144897.090398:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.090473:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175318144 00000100:00100000:3.0:1746144897.090478:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175318144 00010000:00010000:3.0:1746144897.090503:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727515796 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951fa expref: 84 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.090535:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11202 00000100:00100000:3.0:1746144897.090542:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175318144:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.090555:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.090625:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727515796 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951fa expref: 84 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.090626:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95201 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.090635:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727515796 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951fa expref: 84 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.090705:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2600/0x4076af6727515796 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af951fa expref: 84 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.090705:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.090707:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.090713:0:8432:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95201 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.090721:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95201 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.090742:0:8432:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95201 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.090752:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172519680:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.090821:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1746144897.090970:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.090992:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+83:1984:x1830965175318144:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 450us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.090998:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11202 00000100:00100000:2.0:1746144897.095530:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172519680:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.095551:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009422ae00, rc 0) 00000100:00100000:2.0:1746144897.095586:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175318016:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7116us (7295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.095593:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5786 00000100:00100000:0.0:1746144897.096829:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.096956:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175318272 00000100:00100000:3.0:1746144897.096962:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175318272 00000100:00100000:3.0:1746144897.097002:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5787 00000100:00100000:3.0:1746144897.097008:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+83:31565:x1830965175318272:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.097024:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.097038:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95208 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.097061:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95201 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.097068:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.097070:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.097074:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95208 expref: 84 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.097097:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95201 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.097107:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95201 expref: 5 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.097118:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172519808:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.097175:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd426c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.098978:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172519808:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144897.099000:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95208 expref: 84 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.099012:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:3.0:1746144897.099147:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+84:31565:x1830965175318272:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2137us (2321us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.099154:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5787 00000100:00100000:0.0:1746144897.099425:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.099848:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175318528 00000100:00100000:1.0:1746144897.099854:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175318528 00002000:00100000:1.0:1746144897.099881:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612f480 x1830965175318528/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.099889:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612f480 with x1830965175318528 ext(0->4095) 00010000:00010000:1.0:1746144897.099894:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95201 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.099903:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95201 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.099920:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612f480 00000100:00100000:1.0:1746144897.099944:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2229 00000100:00100000:1.0:1746144897.099951:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175318528:12345-192.168.202.16@tcp:3:ldlm_bl.0 00000100:00100000:1.0:1746144897.100133:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175318528:12345-192.168.202.16@tcp:3:ldlm_bl.0 Request processed in 182us (708us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.100139:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2229 00002000:00100000:1.0:1746144897.100144:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612f480 x1830965175318528/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.100150:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612f480 with x1830965175318528 ext(0->4095) 00010000:00010000:1.0:1746144897.100155:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95201 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.100163:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95201 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.100168:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612f480 00000100:00100000:0.0:1746144897.102976:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.103384:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175318656 00000100:00100000:3.0:1746144897.103392:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175318656 00010000:00010000:3.0:1746144897.103421:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95201 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.103452:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11203 00000100:00100000:3.0:1746144897.103459:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129d6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175318656:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.103471:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.103487:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95201 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.103497:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95201 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.103514:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af672751579d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95201 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.103542:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.103544:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.103550:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95208 expref: 83 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.103558:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95208 expref: 83 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.103585:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95208 expref: 83 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144897.103596:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172519936:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.103664:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.106300:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.106380:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175318912 00000100:00100000:2.0:1746144897.106387:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175318912 00002000:00100000:2.0:1746144897.106425:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612df80 x1830965175318912/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.106434:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612df80 with x1830965175318912 ext(0->4095) 00002000:00010000:2.0:1746144897.106438:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612df80 00000100:00100000:2.0:1746144897.106453:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4183 00000100:00100000:2.0:1746144897.106459:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175318912:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144897.106600:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1984:x1830965175318912:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 140us (306us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.106606:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4183 00002000:00100000:2.0:1746144897.106611:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612df80 x1830965175318912/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.106617:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612df80 with x1830965175318912 ext(0->4095) 00002000:00010000:2.0:1746144897.106620:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612df80 00000100:00100000:3.0:1746144897.107201:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172519936:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.107217:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.107251:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129d6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175318656:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3792us (4281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.107258:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11203 00000100:00100000:0.0:1746144897.117971:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.118945:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175319040 00000100:00100000:3.0:1746144897.118954:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175319040 00000100:00100000:3.0:1746144897.119247:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5788 00000100:00100000:3.0:1746144897.119254:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175319040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.119270:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.119283:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9520f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.119307:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95208 expref: 83 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.119314:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.119315:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.119318:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.119591:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95208 expref: 83 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.119603:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95208 expref: 83 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.119613:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172520064:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.120129:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42180 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.126399:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172520064:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144897.126426:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.126447:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:3.0:1746144897.126487:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175319040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7232us (8522us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.126494:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5788 00000100:00100000:2.0:1746144897.126966:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.127002:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175319168 00000100:00100000:1.0:1746144897.127009:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175319168 00002000:00100000:1.0:1746144897.127046:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800925ab100 x1830965175319168/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 496/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.127055:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab100 with x1830965175319168 ext(0->7) 00010000:00010000:1.0:1746144897.127061:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95208 expref: 84 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.127072:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95208 expref: 84 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.127078:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925ab100 00000100:00100000:1.0:1746144897.127102:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2230 00000100:00100000:1.0:1746144897.127109:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+84:1985:x1830965175319168:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144897.127551:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1985:x1830965175319168:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 438us (581us total) trans 4294968049 rc 0/0 00000100:00100000:1.0:1746144897.127557:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2230 00002000:00100000:1.0:1746144897.127562:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff8800925ab100 x1830965175319168/t4294968049(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 496/448 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.127568:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab100 with x1830965175319168 ext(0->7) 00010000:00010000:1.0:1746144897.127572:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95208 expref: 86 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.127580:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95208 expref: 86 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.127623:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925ab100 00000100:00100000:0.0:1746144897.141606:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.141670:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175319296 00000100:00100000:3.0:1746144897.141679:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175319296 00000100:00100000:0.0:1746144897.141737:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.141789:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175319424 00000100:00100000:2.0:1746144897.141793:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175319424 00010000:00010000:2.0:1746144897.141826:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95208 expref: 86 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.141858:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11204 00000100:00100000:3.0:1746144897.141865:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5789 00000100:00100000:2.0:1746144897.141865:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175319424:12345-192.168.202.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746144897.141871:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31565:x1830965175319296:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144897.141876:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.141883:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.141893:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95216 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.141895:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95208 expref: 87 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.141905:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95208 expref: 88 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.141933:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af67275157a4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95208 expref: 88 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.141935:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.141941:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.141946:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.141949:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95216 expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.142016:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.142018:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.142023:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.142030:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.142053:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.142064:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 5 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.142079:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172520192:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144897.142100:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 5 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.142108:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 5 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.142117:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172520320:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.142134:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42180 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.142140:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.145497:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172520320:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.145519:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144897.145545:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.145564:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175319424:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3699us (3826us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.145577:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11204 00000100:00100000:3.0:1746144897.145714:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172520192:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144897.145730:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95216 expref: 86 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.145743:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:3.0:1746144897.145783:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+86:31565:x1830965175319296:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3912us (4186us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.145789:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5789 00000100:00100000:1.0:1746144897.145859:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175319680 00000100:00100000:1.0:1746144897.145980:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175319680 00002000:00100000:1.0:1746144897.146009:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612ce00 x1830965175319680/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.146017:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ce00 with x1830965175319680 ext(0->4095) 00010000:00010000:1.0:1746144897.146023:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.146034:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.146041:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612ce00 00000100:00100000:1.0:1746144897.146066:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2231 00000100:00100000:1.0:1746144897.146073:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175319680:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144897.146204:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175319680:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 131us (659us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.146209:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2231 00002000:00100000:1.0:1746144897.146214:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612ce00 x1830965175319680/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.146220:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ce00 with x1830965175319680 ext(0->4095) 00010000:00010000:1.0:1746144897.146224:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.146238:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.146243:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612ce00 00000100:00100000:0.0:1746144897.149340:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.149651:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175319808 00000100:00100000:2.0:1746144897.149659:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175319808 00010000:00010000:2.0:1746144897.149692:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.149716:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11205 00000100:00100000:2.0:1746144897.149723:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175319808:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.149735:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.149752:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.149787:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.149807:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9520f expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.149840:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.149842:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.149848:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95216 expref: 85 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.149856:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95216 expref: 85 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.149885:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95216 expref: 85 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.149901:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172520448:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.149984:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.154064:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.154287:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175320064 00000100:00100000:3.0:1746144897.154295:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175320064 00002000:00100000:3.0:1746144897.154329:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925a9500 x1830965175320064/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.154338:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9500 with x1830965175320064 ext(0->4095) 00002000:00010000:3.0:1746144897.154342:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925a9500 00000100:00100000:3.0:1746144897.154370:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4184 00000100:00100000:3.0:1746144897.154377:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1983:x1830965175320064:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:0.0:1746144897.154388:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172520448:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144897.154407:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144897.154441:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175319808:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4719us (5107us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144897.154448:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11205 00000100:00100000:3.0:1746144897.154535:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1983:x1830965175320064:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 157us (477us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.154541:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4184 00002000:00100000:3.0:1746144897.154546:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925a9500 x1830965175320064/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.154557:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9500 with x1830965175320064 ext(0->4095) 00002000:00010000:3.0:1746144897.154560:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925a9500 00000100:00100000:0.0:1746144897.157801:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.157880:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175320192 00000100:00100000:3.0:1746144897.157888:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175320192 00000100:00100000:3.0:1746144897.158041:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5790 00000100:00100000:3.0:1746144897.158049:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175320192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.158064:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.158076:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9521d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.158099:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95216 expref: 85 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.158106:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.158107:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.158111:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157b9 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9521d expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.158140:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95216 expref: 85 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.158149:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95216 expref: 85 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.158159:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172520576:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.158562:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.161157:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172520576:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144897.161180:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157b9 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9521d expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.161194:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:3.0:1746144897.161226:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175320192:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3178us (3432us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.161233:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5790 00000100:00100000:0.0:1746144897.163858:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.163897:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175320320 00000100:00100000:1.0:1746144897.163916:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175320320 00002000:00100000:1.0:1746144897.164297:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88013612d180 x1830965175320320/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 496/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.164305:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612d180 with x1830965175320320 ext(0->7) 00010000:00010000:1.0:1746144897.164313:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95216 expref: 86 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.164326:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95216 expref: 86 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.164332:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612d180 00000100:00100000:1.0:1746144897.164368:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2232 00000100:00100000:1.0:1746144897.164375:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+86:1985:x1830965175320320:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144897.165400:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175320320:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 1022us (1552us total) trans 4294968050 rc 0/0 00000100:00100000:1.0:1746144897.165407:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2232 00002000:00100000:1.0:1746144897.165413:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88013612d180 x1830965175320320/t4294968050(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 496/448 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.165419:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612d180 with x1830965175320320 ext(0->7) 00010000:00010000:1.0:1746144897.165425:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95216 expref: 88 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.165434:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95216 expref: 88 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.165439:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013612d180 00000100:00100000:0.0:1746144897.169651:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.171298:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175320448 00000100:00100000:2.0:1746144897.171307:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175320448 00010000:00010000:2.0:1746144897.171342:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95216 expref: 88 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.171374:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11206 00000100:00100000:2.0:1746144897.171380:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1983:x1830965175320448:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.171391:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.171409:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95216 expref: 88 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.171419:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95216 expref: 88 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.171436:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275157b2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95216 expref: 88 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.172031:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.172033:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.172039:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9521d expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.172046:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9521d expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.172074:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9521d expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.172085:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172520704:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.172158:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.174253:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172520704:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.174271:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.174298:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1983:x1830965175320448:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2918us (4654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.174306:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11206 00000100:00100000:0.0:1746144897.174609:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.174686:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175320704 00000100:00100000:1.0:1746144897.174691:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175320704 00002000:00100000:1.0:1746144897.174718:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612c000 x1830965175320704/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.174726:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612c000 with x1830965175320704 ext(0->4095) 00002000:00010000:1.0:1746144897.174730:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612c000 00000100:00100000:1.0:1746144897.174752:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4185 00000100:00100000:1.0:1746144897.174758:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175320704:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144897.174893:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175320704:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 136us (285us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.174899:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4185 00002000:00100000:1.0:1746144897.174903:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88013612c000 x1830965175320704/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.174920:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612c000 with x1830965175320704 ext(0->4095) 00002000:00010000:1.0:1746144897.174923:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612c000 00000100:00100000:0.0:1746144897.179900:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.179990:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.180844:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175320832 00000100:00100000:3.0:1746144897.180853:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175320832 00000100:00100000:3.0:1746144897.180888:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175320960 00000100:00100000:3.0:1746144897.180890:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175320960 00000100:00100000:3.0:1746144897.180904:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5791 00000100:00100000:3.0:1746144897.180920:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31579:x1830965175320832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.180935:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.180947:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95224 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.180969:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9521d expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.180976:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.180977:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.180980:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95224 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.181004:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9521d expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.181018:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9521d expref: 5 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.181029:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172520832:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144897.185003:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5792 00000100:00100000:0.0:1746144897.185020:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31565:x1830965175320960:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144897.185036:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144897.185051:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9522b expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.185070:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144897.185075:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95224 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.185080:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144897.185083:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9522b expref: 90 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.185113:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95224 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.185124:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9522b expref: 90 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.185131:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b2400, rc 0) 00000100:00100000:3.0:1746144897.185516:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.185583:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31565:x1830965175320960:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 568us (5590us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144897.185588:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5792 00000100:00100000:3.0:1746144897.188060:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172520832:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144897.188084:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95224 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.188097:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:3.0:1746144897.188140:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31579:x1830965175320832:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 7219us (8247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.188147:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5791 00000100:00100000:0.0:1746144897.188580:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.191204:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175321088 00000100:00100000:2.0:1746144897.191216:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175321088 00010000:00010000:2.0:1746144897.191254:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9521d expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.191287:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11207 00000100:00100000:2.0:1746144897.191293:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175321088:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.191304:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.191321:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9521d expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.191330:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9521d expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.191346:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9521d expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.191367:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.191369:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.191374:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95224 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.191380:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95224 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.191405:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95224 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.191413:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95224 expref: 88 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.191422:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172521088:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.191486:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.193540:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172521088:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.193561:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.193601:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175321088:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2308us (5020us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.193610:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11207 00000100:00100000:0.0:1746144897.195697:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.196757:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175321344 00000100:00100000:3.0:1746144897.196777:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175321344 00002000:00100000:3.0:1746144897.196815:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918eea00 x1830965175321344/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.196824:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eea00 with x1830965175321344 ext(0->4095) 00010000:00010000:3.0:1746144897.196832:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95224 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.196843:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95224 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.196854:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918eea00 00000100:00100000:3.0:1746144897.197190:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2233 00000100:00100000:3.0:1746144897.197198:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1984:x1830965175321344:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.198872:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1984:x1830965175321344:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 1669us (3174us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.198881:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2233 00002000:00100000:3.0:1746144897.198889:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918eea00 x1830965175321344/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.198897:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eea00 with x1830965175321344 ext(0->4095) 00010000:00010000:3.0:1746144897.198904:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95224 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.198926:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95224 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.198931:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918eea00 00000100:00100000:0.0:1746144897.202090:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.202173:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.203160:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175321600 00000100:00100000:3.0:1746144897.203170:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175321600 00000100:00100000:3.0:1746144897.203223:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5793 00000100:00100000:3.0:1746144897.203230:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175321600:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.203246:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.203260:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95232 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.203288:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.203292:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9522b expref: 88 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.203298:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144897.203301:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95232 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.203331:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9522b expref: 88 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.203341:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95232 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.203349:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:3.0:1746144897.203391:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175321600:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 162us (1308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.203396:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5793 00000100:00100000:2.0:1746144897.203689:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175321472 00000100:00100000:2.0:1746144897.203693:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175321472 00010000:00010000:2.0:1746144897.203714:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95224 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.203939:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11208 00000100:00100000:2.0:1746144897.203946:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1984:x1830965175321472:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.203954:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.203973:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95224 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.203983:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95224 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.203998:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af67275157c0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95224 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.204023:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.204024:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.204029:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9522b expref: 88 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.204035:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9522b expref: 88 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.204054:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9522b expref: 88 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.204063:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9522b expref: 88 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.204077:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172521344:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.205112:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.207685:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172521344:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.207703:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.207867:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175321472:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3920us (5692us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.207876:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11208 00000100:00100000:0.0:1746144897.208825:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.209431:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175321856 00000100:00100000:3.0:1746144897.209437:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175321856 00002000:00100000:3.0:1746144897.209474:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ef100 x1830965175321856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.209483:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ef100 with x1830965175321856 ext(0->4095) 00010000:00010000:3.0:1746144897.209490:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9522b expref: 88 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.209507:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9522b expref: 88 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.209513:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ef100 00000100:00100000:3.0:1746144897.209538:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2234 00000100:00100000:3.0:1746144897.209544:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175321856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.210044:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175321856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 499us (1219us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.210050:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2234 00002000:00100000:3.0:1746144897.210056:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ef100 x1830965175321856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.210063:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ef100 with x1830965175321856 ext(0->4095) 00010000:00010000:3.0:1746144897.210068:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9522b expref: 88 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.210076:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9522b expref: 88 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.210081:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ef100 00000100:00100000:0.0:1746144897.211920:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.211989:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.212078:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175321984 00000100:00100000:1.0:1746144897.212084:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175321984 00000100:00100000:1.0:1746144897.212269:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5794 00000100:00100000:1.0:1746144897.212275:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31565:x1830965175321984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.212288:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.212302:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af67275157d5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95239 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.212322:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.212326:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95232 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.212331:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144897.212335:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af67275157d5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95239 expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.212362:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95232 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.212373:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af67275157d5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95239 expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.212381:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d800, rc 0) 00000100:00100000:1.0:1746144897.212411:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31565:x1830965175321984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 136us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.212417:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5794 00000100:00100000:2.0:1746144897.212455:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175322112 00000100:00100000:2.0:1746144897.212459:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175322112 00010000:00010000:2.0:1746144897.212478:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9522b expref: 89 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.212496:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11209 00000100:00100000:2.0:1746144897.212501:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175322112:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.212513:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.212531:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9522b expref: 89 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.212540:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9522b expref: 89 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.212677:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2400/0x4076af67275157c7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9522b expref: 89 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.212689:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.212691:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.212696:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95232 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.212703:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95232 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.212721:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95232 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.212731:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95232 expref: 5 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.212742:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172521600:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.212803:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.214631:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.214836:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172521600:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.214853:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.214891:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175322112:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2390us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.214900:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11209 00000100:00100000:3.0:1746144897.215440:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175322368 00000100:00100000:3.0:1746144897.215446:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175322368 00002000:00100000:3.0:1746144897.215473:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ed180 x1830965175322368/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.215480:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ed180 with x1830965175322368 ext(0->4095) 00010000:00010000:3.0:1746144897.215487:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95232 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.215497:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95232 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.215502:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ed180 00000100:00100000:3.0:1746144897.215522:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2235 00000100:00100000:3.0:1746144897.215527:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175322368:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.215642:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175322368:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 115us (1016us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.215647:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2235 00002000:00100000:3.0:1746144897.215651:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ed180 x1830965175322368/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.215658:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ed180 with x1830965175322368 ext(0->4095) 00010000:00010000:3.0:1746144897.215661:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95232 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.215669:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95232 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.215674:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918ed180 00000100:00100000:0.0:1746144897.218979:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.219397:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175322496 00000100:00100000:2.0:1746144897.219405:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175322496 00010000:00010000:2.0:1746144897.219435:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95232 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.219469:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11210 00000100:00100000:2.0:1746144897.219476:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175322496:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.219491:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.219508:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95232 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.219518:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95232 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.219536:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275157ce lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95232 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.219558:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.219560:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.219566:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af67275157d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95239 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.219573:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af67275157d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95239 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.219600:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af67275157d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95239 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.219611:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172521728:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.219672:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.222283:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.222385:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172521728:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.222404:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.222438:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4fd7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175322496:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2962us (3464us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.222451:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11210 00000100:00100000:1.0:1746144897.222543:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175322752 00000100:00100000:1.0:1746144897.222548:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175322752 00002000:00100000:1.0:1746144897.222575:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918edf80 x1830965175322752/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.222587:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918edf80 with x1830965175322752 ext(0->4095) 00002000:00010000:1.0:1746144897.222591:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918edf80 00000100:00100000:1.0:1746144897.222615:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4186 00000100:00100000:1.0:1746144897.222621:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175322752:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144897.222833:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175322752:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 211us (557us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.222838:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4186 00002000:00100000:1.0:1746144897.222843:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918edf80 x1830965175322752/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.222849:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918edf80 with x1830965175322752 ext(0->4095) 00002000:00010000:1.0:1746144897.222851:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918edf80 00000100:00100000:0.0:1746144897.224339:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.224533:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175322880 00000100:00100000:3.0:1746144897.224539:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175322880 00000100:00100000:3.0:1746144897.224579:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5795 00000100:00100000:3.0:1746144897.224585:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175322880:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.224597:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.224610:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157dc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95240 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.224633:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af67275157d5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95239 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.224639:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.224640:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.224643:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157dc lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95240 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.224666:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af67275157d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95239 expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.224674:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af67275157d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95239 expref: 87 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.224684:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172521856:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.224745:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.226247:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172521856:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144897.226268:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157dc lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95240 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.226280:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:3.0:1746144897.226322:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175322880:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1736us (1986us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.226332:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5795 00000100:00100000:0.0:1746144897.226579:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.226797:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175323008 00000100:00100000:2.0:1746144897.226801:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175323008 00010000:00010000:2.0:1746144897.226823:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af67275157d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95239 expref: 88 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.226861:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11211 00000100:00100000:2.0:1746144897.226868:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175323008:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.226878:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.226894:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af67275157d5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95239 expref: 88 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.226903:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af67275157d5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95239 expref: 88 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.226931:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af67275157d5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95239 expref: 88 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.226947:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.226949:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.226954:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95240 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.226961:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95240 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.226984:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95240 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.226993:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172521984:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.227046:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.228406:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172521984:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.228421:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.228453:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:1985:x1830965175323008:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1585us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.228459:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11211 00000100:00100000:0.0:1746144897.229197:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.229413:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175323264 00000100:00100000:1.0:1746144897.229419:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175323264 00002000:00100000:1.0:1746144897.229451:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ef800 x1830965175323264/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.229460:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ef800 with x1830965175323264 ext(0->4095) 00002000:00010000:1.0:1746144897.229468:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ef800 00000100:00100000:1.0:1746144897.229493:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4187 00000100:00100000:1.0:1746144897.229500:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175323264:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144897.229621:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175323264:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 122us (426us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.229628:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4187 00002000:00100000:1.0:1746144897.229633:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918ef800 x1830965175323264/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.229644:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ef800 with x1830965175323264 ext(0->4095) 00002000:00010000:1.0:1746144897.229646:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ef800 00000100:00100000:0.0:1746144897.231692:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.232302:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175323392 00000100:00100000:3.0:1746144897.232310:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175323392 00000100:00100000:3.0:1746144897.232360:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5796 00000100:00100000:3.0:1746144897.232367:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+87:31579:x1830965175323392:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.232381:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.232394:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95247 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.232414:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157dc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95240 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.232420:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.232422:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.232425:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95247 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.232449:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95240 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.232458:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95240 expref: 5 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.232468:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172522112:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.232541:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.234956:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.235987:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172522112:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144897.235991:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:3.0:1746144897.236013:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95247 expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.236028:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:3.0:1746144897.236063:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31579:x1830965175323392:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3697us (4377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.236070:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5796 00000100:00100000:1.0:1746144897.236086:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175323520 00000100:00100000:1.0:1746144897.236092:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175323520 00000100:00100000:2.0:1746144897.236176:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175323648 00000100:00100000:2.0:1746144897.236180:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175323648 00010000:00010000:2.0:1746144897.236238:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95240 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.236258:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11212 00000100:00100000:2.0:1746144897.236265:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175323648:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.236275:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.236293:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157dc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95240 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.236303:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157dc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95240 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.236321:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af67275157dc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95240 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.236333:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.236335:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.236340:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95247 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.236347:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95247 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.236368:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95247 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.236377:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172522240:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.236417:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.236598:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5797 00000100:00100000:1.0:1746144897.236605:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31565:x1830965175323520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.236620:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.236629:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9524e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.236644:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95247 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.236651:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.236652:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.236655:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9524e expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.236668:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95247 expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.236677:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95247 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.236684:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172522368:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144897.236747:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.239369:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172522368:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144897.239370:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:1.0:1746144897.239391:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9524e expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.239404:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966c000, rc 0) 00000100:00100000:3.0:1746144897.239423:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175323904 00000100:00100000:3.0:1746144897.239429:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175323904 00000100:00100000:1.0:1746144897.239437:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31565:x1830965175323520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2833us (4487us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.239444:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5797 00002000:00100000:3.0:1746144897.239461:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918eca80 x1830965175323904/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.239469:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eca80 with x1830965175323904 ext(0->4095) 00010000:00010000:3.0:1746144897.239475:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95247 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.239622:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95247 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.239628:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918eca80 00000100:00100000:3.0:1746144897.239652:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2236 00000100:00100000:3.0:1746144897.239659:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175323904:12345-192.168.202.16@tcp:3:ldlm_bl.0 00000100:00100000:2.0:1746144897.239760:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172522240:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.240019:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175323904:12345-192.168.202.16@tcp:3:ldlm_bl.0 Request processed in 360us (653us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.240025:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2236 00002000:00100000:3.0:1746144897.240030:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800918eca80 x1830965175323904/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.240036:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eca80 with x1830965175323904 ext(0->4095) 00010000:00010000:3.0:1746144897.240040:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95247 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.240048:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95247 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.240053:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800918eca80 00010000:00010000:2.0:1746144897.240098:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.240132:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175323648:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3867us (4141us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.240140:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11212 00000100:00100000:0.0:1746144897.242665:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.242710:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.242730:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175324032 00000100:00100000:1.0:1746144897.242736:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175324032 00000100:00100000:1.0:1746144897.242794:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5798 00000100:00100000:1.0:1746144897.242801:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175324032:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.242813:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.242825:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95255 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.242844:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.242849:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9524e expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.242855:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144897.242858:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95255 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.242884:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9524e expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.242894:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95255 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.242902:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966ce00, rc 0) 00000100:00100000:1.0:1746144897.242951:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175324032:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 151us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.242957:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5798 00000100:00100000:2.0:1746144897.243015:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175324160 00000100:00100000:2.0:1746144897.243024:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175324160 00010000:00010000:2.0:1746144897.243106:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95247 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.243126:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11213 00000100:00100000:2.0:1746144897.243133:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1984:x1830965175324160:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.243331:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.243350:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95247 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.243363:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95247 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.243378:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275157e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95247 expref: 89 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.243390:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.243391:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.243396:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9524e expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.243402:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9524e expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.243420:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9524e expref: 88 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.243430:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9524e expref: 88 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.243439:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172522624:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.243493:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.246537:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172522624:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.246559:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.246750:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175324160:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3616us (4037us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.246782:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11213 00000100:00100000:0.0:1746144897.248255:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.248760:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175324416 00000100:00100000:3.0:1746144897.248783:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175324416 00002000:00100000:3.0:1746144897.248818:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230dc00 x1830965175324416/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.248827:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230dc00 with x1830965175324416 ext(0->4095) 00010000:00010000:3.0:1746144897.248835:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9524e expref: 88 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.248846:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9524e expref: 88 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.248852:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230dc00 00000100:00100000:3.0:1746144897.249007:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2237 00000100:00100000:3.0:1746144897.249015:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175324416:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.249382:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175324416:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 366us (1129us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.249389:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2237 00002000:00100000:3.0:1746144897.249395:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230dc00 x1830965175324416/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.249401:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230dc00 with x1830965175324416 ext(0->4095) 00010000:00010000:3.0:1746144897.249406:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9524e expref: 88 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.249415:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9524e expref: 88 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.249420:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230dc00 00000100:00100000:0.0:1746144897.252159:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.252276:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.252413:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175324544 00000100:00100000:1.0:1746144897.252421:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175324544 00000100:00100000:1.0:1746144897.252458:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5799 00000100:00100000:1.0:1746144897.252464:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31565:x1830965175324544:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.252479:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.252492:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275157f8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9525c expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.252511:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.252516:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95255 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.252521:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746144897.252523:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275157f8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9525c expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.252548:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95255 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.252557:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275157f8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9525c expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.252569:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d200, rc 0) 00000100:00100000:1.0:1746144897.252598:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31565:x1830965175324544:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 135us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.252603:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5799 00000100:00100000:2.0:1746144897.252756:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175324672 00000100:00100000:2.0:1746144897.252760:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175324672 00010000:00010000:2.0:1746144897.252793:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9524e expref: 89 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.252809:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11214 00000100:00100000:2.0:1746144897.252813:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175324672:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.252820:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.252837:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9524e expref: 89 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.252847:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9524e expref: 89 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.252863:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275157ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9524e expref: 89 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.252876:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.252877:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.252882:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95255 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.252889:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95255 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.252921:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95255 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.252933:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95255 expref: 5 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.252942:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172522880:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.252987:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.255158:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aa300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172522880:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.255179:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.255209:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175324672:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2394us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.255218:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11214 00000100:00100000:2.0:1746144897.256697:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.256801:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175324928 00000100:00100000:3.0:1746144897.256807:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175324928 00002000:00100000:3.0:1746144897.256842:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925aa300 x1830965175324928/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.256851:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925aa300 with x1830965175324928 ext(0->4095) 00010000:00010000:3.0:1746144897.256857:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95255 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.256867:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95255 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.256873:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925aa300 00000100:00100000:3.0:1746144897.257191:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2238 00000100:00100000:3.0:1746144897.257199:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175324928:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.257347:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175324928:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 147us (653us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.257356:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2238 00002000:00100000:3.0:1746144897.257361:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925aa300 x1830965175324928/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.257368:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925aa300 with x1830965175324928 ext(0->4095) 00010000:00010000:3.0:1746144897.257373:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95255 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.257381:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95255 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.257387:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925aa300 00000100:00100000:0.0:1746144897.260686:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.260865:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175325056 00000100:00100000:2.0:1746144897.260872:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175325056 00010000:00010000:2.0:1746144897.260917:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95255 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.261179:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11215 00000100:00100000:2.0:1746144897.261188:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175325056:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.261199:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.261219:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95255 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.261231:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95255 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.261253:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966ce00/0x4076af67275157f1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95255 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.261280:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.261282:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.261289:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275157f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9525c expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.261295:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275157f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9525c expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.261324:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275157f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9525c expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.261334:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925ab800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172523008:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.261408:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.263465:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ab800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172523008:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.263485:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.263524:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175325056:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2338us (2845us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.263532:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11215 00000100:00100000:3.0:1746144897.265514:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.265597:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175325312 00000100:00100000:1.0:1746144897.265603:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175325312 00002000:00100000:1.0:1746144897.265635:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38dc00 x1830965175325312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.265644:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38dc00 with x1830965175325312 ext(0->4095) 00002000:00010000:1.0:1746144897.265647:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f38dc00 00000100:00100000:1.0:1746144897.265669:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4188 00000100:00100000:1.0:1746144897.265674:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175325312:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144897.265829:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175325312:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 154us (319us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.265836:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4188 00002000:00100000:1.0:1746144897.265840:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88008f38dc00 x1830965175325312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.265847:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38dc00 with x1830965175325312 ext(0->4095) 00002000:00010000:1.0:1746144897.265850:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f38dc00 00000100:00100000:0.0:1746144897.268148:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.268303:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175325440 00000100:00100000:3.0:1746144897.268309:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175325440 00000100:00100000:3.0:1746144897.268348:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5800 00000100:00100000:3.0:1746144897.268354:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175325440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.268368:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.268381:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95263 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.268403:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275157f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9525c expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.268410:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.268411:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.268414:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95263 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.268438:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275157f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9525c expref: 87 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.268447:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275157f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9525c expref: 87 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.268458:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172523136:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.268525:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.271475:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172523136:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144897.271497:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95263 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.271511:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:3.0:1746144897.271552:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175325440:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3198us (3408us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.271559:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5800 00000100:00100000:0.0:1746144897.272961:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.273071:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175325568 00000100:00100000:2.0:1746144897.273076:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175325568 00010000:00010000:2.0:1746144897.273105:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275157f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9525c expref: 88 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.273586:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11216 00000100:00100000:2.0:1746144897.273595:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1985:x1830965175325568:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.273606:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.273625:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275157f8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9525c expref: 88 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.273635:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275157f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9525c expref: 88 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.273653:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275157f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9525c expref: 88 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.273677:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.273679:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.273685:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95263 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.273691:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95263 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.273716:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95263 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.273726:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925ab800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172523264:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.274411:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.274561:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.274605:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175325696 00000100:00100000:3.0:1746144897.274609:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175325696 00000100:00100000:3.0:1746144897.275932:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5801 00000100:00100000:3.0:1746144897.275943:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31565:x1830965175325696:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.275956:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.275969:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9526a expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.275992:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95263 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.275999:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.276001:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.276003:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9526a expref: 89 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.276024:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95263 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.276035:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95263 expref: 5 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.276044:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172523392:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.276117:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.278221:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ab800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172523264:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.278240:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.278279:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1985:x1830965175325568:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4686us (5322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.278287:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11216 00000100:00100000:3.0:1746144897.279338:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172523392:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144897.279356:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9526a expref: 88 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.279370:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:3.0:1746144897.279405:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+88:31565:x1830965175325696:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3464us (4844us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.279412:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5801 00000100:00100000:0.0:1746144897.279998:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.280220:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175325952 00000100:00100000:3.0:1746144897.280225:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175325952 00002000:00100000:3.0:1746144897.280254:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230ea00 x1830965175325952/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.280268:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230ea00 with x1830965175325952 ext(0->4095) 00010000:00010000:3.0:1746144897.280273:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95263 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.280283:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95263 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.280289:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230ea00 00000100:00100000:3.0:1746144897.280317:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2239 00000100:00100000:3.0:1746144897.280323:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175325952:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144897.280497:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175325952:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 173us (499us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.280503:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2239 00002000:00100000:3.0:1746144897.280509:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230ea00 x1830965175325952/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.280516:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230ea00 with x1830965175325952 ext(0->4095) 00010000:00010000:3.0:1746144897.280521:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95263 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.280529:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95263 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.280534:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230ea00 00000100:00100000:0.0:1746144897.284090:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.284298:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175326080 00000100:00100000:2.0:1746144897.284307:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175326080 00010000:00010000:2.0:1746144897.284335:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95263 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.284663:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11217 00000100:00100000:2.0:1746144897.284672:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175326080:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.284682:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.284698:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95263 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.284709:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95263 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.284726:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af67275157ff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95263 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.284748:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.284750:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.284755:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9526a expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.284784:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9526a expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.284812:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9526a expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.284823:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925ab800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172523520:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.284894:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.288270:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ab800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172523520:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.288291:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.288335:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4fd6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175326080:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3663us (4251us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.288345:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11217 00000100:00100000:0.0:1746144897.288819:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.289280:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175326336 00000100:00100000:3.0:1746144897.289286:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175326336 00002000:00100000:3.0:1746144897.289316:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230f480 x1830965175326336/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.289325:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230f480 with x1830965175326336 ext(0->4095) 00002000:00010000:3.0:1746144897.289329:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230f480 00000100:00100000:3.0:1746144897.289354:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4189 00000100:00100000:3.0:1746144897.289360:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175326336:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.289500:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175326336:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 139us (681us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.289507:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4189 00002000:00100000:3.0:1746144897.289511:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230f480 x1830965175326336/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.289517:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230f480 with x1830965175326336 ext(0->4095) 00002000:00010000:3.0:1746144897.289520:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230f480 00000100:00100000:0.0:1746144897.301700:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.304802:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175326464 00000100:00100000:3.0:1746144897.304814:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175326464 00000100:00100000:3.0:1746144897.304860:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5802 00000100:00100000:3.0:1746144897.304868:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175326464:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.304881:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.304896:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751580d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95271 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.304931:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9526a expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.304942:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.304943:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.304946:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751580d lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95271 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.304974:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9526a expref: 87 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.304984:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9526a expref: 87 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.304995:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172523648:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.305074:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.310417:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172523648:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144897.310444:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751580d lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95271 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.310459:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:3.0:1746144897.310499:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175326464:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5632us (8806us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.310505:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5802 00000100:00100000:0.0:1746144897.317379:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.317460:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175326592 00000100:00100000:1.0:1746144897.317467:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175326592 00002000:00100000:1.0:1746144897.317501:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009230c380 x1830965175326592/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 496/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.317515:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230c380 with x1830965175326592 ext(0->7) 00010000:00010000:1.0:1746144897.317522:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9526a expref: 88 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.317532:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9526a expref: 88 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.317538:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230c380 00000100:00100000:1.0:1746144897.317563:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2240 00000100:00100000:1.0:1746144897.317570:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+88:1984:x1830965175326592:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144897.317853:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175326592:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 282us (479us total) trans 4294968051 rc 0/0 00000100:00100000:1.0:1746144897.317859:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2240 00002000:00100000:1.0:1746144897.317863:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff88009230c380 x1830965175326592/t4294968051(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 496/448 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.317870:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230c380 with x1830965175326592 ext(0->7) 00010000:00010000:1.0:1746144897.317874:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9526a expref: 90 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.317881:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9526a expref: 90 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.317886:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230c380 00000100:00100000:0.0:1746144897.319682:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.319860:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175326720 00000100:00100000:2.0:1746144897.319867:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175326720 00010000:00010000:2.0:1746144897.319897:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9526a expref: 90 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.319958:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11218 00000100:00100000:2.0:1746144897.319965:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1983:x1830965175326720:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.319980:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.319998:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9526a expref: 90 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.320008:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9526a expref: 90 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.320028:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515806 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9526a expref: 90 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.320044:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.320046:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.320051:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751580d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95271 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.320059:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751580d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95271 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.320086:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751580d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95271 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.320095:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925ab800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172523776:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.320296:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.325031:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.325112:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175326976 00000100:00100000:3.0:1746144897.325119:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175326976 00002000:00100000:3.0:1746144897.325154:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230f800 x1830965175326976/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.325168:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230f800 with x1830965175326976 ext(0->4095) 00002000:00010000:3.0:1746144897.325172:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230f800 00000100:00100000:3.0:1746144897.325203:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4190 00000100:00100000:3.0:1746144897.325210:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175326976:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:3.0:1746144897.325359:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175326976:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 149us (335us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.325366:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4190 00002000:00100000:3.0:1746144897.325371:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230f800 x1830965175326976/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.325377:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230f800 with x1830965175326976 ext(0->4095) 00002000:00010000:3.0:1746144897.325380:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009230f800 00000100:00100000:2.0:1746144897.325687:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ab800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172523776:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.325707:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.325854:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:1983:x1830965175326720:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5888us (6174us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.325861:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11218 00000100:00100000:0.0:1746144897.327875:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.327993:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175327104 00000100:00100000:3.0:1746144897.327999:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175327104 00000100:00100000:3.0:1746144897.328039:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5803 00000100:00100000:3.0:1746144897.328044:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+89:31579:x1830965175327104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.328056:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.328070:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95278 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.328092:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751580d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95271 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.328098:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.328099:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.328102:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95278 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.328124:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751580d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95271 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.328134:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751580d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95271 expref: 5 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.328144:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172523904:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.328205:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42180 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.329969:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172523904:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144897.329991:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95278 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.330005:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:3.0:1746144897.330052:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31579:x1830965175327104:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2006us (2180us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.330058:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5803 00000100:00100000:0.0:1746144897.334631:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.334735:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175327232 00000100:00100000:3.0:1746144897.334743:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175327232 00000100:00100000:3.0:1746144897.335353:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5804 00000100:00100000:3.0:1746144897.335361:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31565:x1830965175327232:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.335376:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.335390:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9527f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.335417:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.335421:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95278 expref: 91 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.335426:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.335429:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9527f expref: 91 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.336103:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95278 expref: 91 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.336116:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9527f expref: 91 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.336125:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00000100:00100000:0.0:1746144897.336181:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.336228:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175327360 00000100:00100000:2.0:1746144897.336233:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175327360 00010000:00010000:2.0:1746144897.336255:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751580d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95271 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.336419:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31565:x1830965175327232:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1058us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.336425:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5804 00000100:00100000:2.0:1746144897.336477:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11219 00000100:00100000:2.0:1746144897.336487:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175327360:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.336498:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.336515:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751580d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95271 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.336524:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751580d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95271 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.336539:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751580d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95271 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.336560:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.336562:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.336566:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95278 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.336572:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95278 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.336591:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95278 expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.336599:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95278 expref: 90 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.336610:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925ab800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172524160:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.336649:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.342081:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ab800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172524160:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144897.342103:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144897.342151:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175327360:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5665us (5967us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144897.342160:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11219 00000100:00100000:2.0:1746144897.342281:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.342388:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175327616 00000100:00100000:0.0:1746144897.342394:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175327616 00002000:00100000:0.0:1746144897.342426:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925ab800 x1830965175327616/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144897.342435:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab800 with x1830965175327616 ext(0->4095) 00010000:00010000:0.0:1746144897.342442:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95278 expref: 91 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:0.0:1746144897.342453:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95278 expref: 91 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:0.0:1746144897.342459:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925ab800 00000100:00100000:0.0:1746144897.342484:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2241 00000100:00100000:0.0:1746144897.342491:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175327616:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:0.0:1746144897.342754:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175327616:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 262us (472us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144897.342760:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2241 00002000:00100000:0.0:1746144897.343020:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800925ab800 x1830965175327616/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:0.0:1746144897.343028:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab800 with x1830965175327616 ext(0->4095) 00010000:00010000:0.0:1746144897.343033:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95278 expref: 91 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:0.0:1746144897.343042:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95278 expref: 91 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:0.0:1746144897.343047:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800925ab800 00000100:00100000:0.0:1746144897.346841:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.346882:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.346976:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175327744 00000100:00100000:3.0:1746144897.346983:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175327744 00000100:00100000:3.0:1746144897.347016:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5805 00000100:00100000:3.0:1746144897.347023:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175327744:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.347037:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.347051:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95286 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.347084:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.347089:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9527f expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.347094:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144897.347097:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95286 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144897.347116:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175327872 00000100:00100000:1.0:1746144897.347121:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175327872 00010000:00010000:3.0:1746144897.347130:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9527f expref: 91 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.347137:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95278 expref: 91 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.347142:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95286 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.347151:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:1.0:1746144897.347162:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11220 00000100:00100000:1.0:1746144897.347196:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1983:x1830965175327872:12345-192.168.202.16@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746144897.347201:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175327744:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 178us (366us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144897.347204:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746144897.347207:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5805 00010000:00010000:1.0:1746144897.347221:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95278 expref: 91 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.347231:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95278 expref: 91 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.347246:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515814 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95278 expref: 91 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.347259:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.347261:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.347266:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9527f expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.347272:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9527f expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.347291:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9527f expref: 90 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.347302:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9527f expref: 90 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.347313:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172524416:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144897.347366:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.349374:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172524416:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.349387:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.349449:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1983:x1830965175327872:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2281us (2565us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.349457:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11220 00000100:00100000:0.0:1746144897.350155:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.350331:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175328128 00000100:00100000:2.0:1746144897.350336:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175328128 00002000:00100000:2.0:1746144897.350367:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230d500 x1830965175328128/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.350375:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230d500 with x1830965175328128 ext(0->4095) 00010000:00010000:2.0:1746144897.350382:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9527f expref: 90 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.350393:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9527f expref: 90 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.350398:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230d500 00000100:00100000:2.0:1746144897.350413:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2242 00000100:00100000:2.0:1746144897.350419:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175328128:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144897.350538:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175328128:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 119us (384us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.350544:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2242 00002000:00100000:2.0:1746144897.350548:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009230d500 x1830965175328128/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.350554:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009230d500 with x1830965175328128 ext(0->4095) 00010000:00010000:2.0:1746144897.350559:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9527f expref: 90 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.350567:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9527f expref: 90 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.350576:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009230d500 00000100:00100000:0.0:1746144897.355419:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.355478:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175328256 00000100:00100000:2.0:1746144897.355487:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175328256 00000100:00100000:2.0:1746144897.355637:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5806 00000100:00100000:2.0:1746144897.355645:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31565:x1830965175328256:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144897.355661:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.355675:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af6727515829 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9528d expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.355696:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:0.0:1746144897.355699:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:2.0:1746144897.355701:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95286 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.355706:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144897.355709:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af6727515829 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9528d expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.355737:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95286 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144897.355789:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175328384 00000100:00100000:1.0:1746144897.355793:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175328384 00010000:00010000:1.0:1746144897.355808:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9527f expref: 92 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.355830:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11221 00010000:00010000:2.0:1746144897.355833:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af6727515829 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9528d expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144897.355835:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175328384:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.355843:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009422aa00, rc 0) 00010000:00010000:1.0:1746144897.355843:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144897.355858:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9527f expref: 92 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.355869:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9527f expref: 92 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.355875:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31565:x1830965175328256:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 232us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.355883:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5806 00010000:00010000:1.0:1746144897.355883:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751581b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9527f expref: 92 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.355913:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.355915:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.355919:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95286 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.355925:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95286 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.355943:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95286 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.355951:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95286 expref: 5 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.355961:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172524672:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144897.356248:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.357528:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172524672:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.357545:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.357577:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175328384:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1741us (1876us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.357585:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11221 00000100:00100000:0.0:1746144897.360527:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.360624:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175328640 00000100:00100000:3.0:1746144897.360631:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175328640 00002000:00100000:3.0:1746144897.360665:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac84a80 x1830965175328640/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.360675:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac84a80 with x1830965175328640 ext(0->4095) 00010000:00010000:3.0:1746144897.360682:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95286 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.360700:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95286 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.360706:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac84a80 00000100:00100000:3.0:1746144897.360731:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2243 00000100:00100000:3.0:1746144897.360737:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175328640:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144897.360897:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175328640:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 159us (375us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.360903:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2243 00002000:00100000:3.0:1746144897.360917:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac84a80 x1830965175328640/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.360924:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac84a80 with x1830965175328640 ext(0->4095) 00010000:00010000:3.0:1746144897.360929:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95286 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.360937:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95286 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.360942:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ac84a80 00000100:00100000:0.0:1746144897.363102:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.363337:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175328768 00000100:00100000:1.0:1746144897.363344:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175328768 00010000:00010000:1.0:1746144897.363366:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95286 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.363383:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11222 00000100:00100000:1.0:1746144897.363388:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175328768:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144897.363400:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144897.363414:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95286 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.363424:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95286 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.363440:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515822 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95286 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.363467:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.363468:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.363474:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af6727515829 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9528d expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.363480:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af6727515829 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9528d expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.363504:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af6727515829 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9528d expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144897.363513:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172524800:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144897.363574:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.366883:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172524800:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.366902:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.366956:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175328768:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3565us (3858us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.366968:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11222 00000100:00100000:0.0:1746144897.368477:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.368546:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175329024 00000100:00100000:3.0:1746144897.368551:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175329024 00002000:00100000:3.0:1746144897.368582:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac84380 x1830965175329024/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.368590:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac84380 with x1830965175329024 ext(0->4095) 00002000:00010000:3.0:1746144897.368595:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac84380 00000100:00100000:3.0:1746144897.368727:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4191 00000100:00100000:3.0:1746144897.368733:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175329024:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144897.369085:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175329024:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 351us (610us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.369091:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4191 00002000:00100000:3.0:1746144897.369096:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ac84380 x1830965175329024/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.369102:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac84380 with x1830965175329024 ext(0->4095) 00002000:00010000:3.0:1746144897.369105:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac84380 00000100:00100000:0.0:1746144897.371044:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.371614:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175329152 00000100:00100000:2.0:1746144897.371621:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175329152 00000100:00100000:2.0:1746144897.371661:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5807 00000100:00100000:2.0:1746144897.371666:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175329152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144897.371679:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.371691:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95294 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.371713:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af6727515829 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9528d expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.371719:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144897.371721:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144897.371724:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95294 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.371747:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af6727515829 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9528d expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.371756:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af6727515829 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9528d expref: 89 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.371785:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172524928:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144897.371845:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.373154:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172524928:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144897.373176:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95294 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.373186:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009422ae00, rc 0) 00000100:00100000:2.0:1746144897.373217:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175329152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1551us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.373223:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5807 00000100:00100000:0.0:1746144897.374857:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.374934:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175329280 00000100:00100000:1.0:1746144897.374940:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175329280 00010000:00010000:1.0:1746144897.374962:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af6727515829 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9528d expref: 90 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.374982:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11223 00000100:00100000:1.0:1746144897.374987:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1984:x1830965175329280:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144897.374996:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144897.375012:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af6727515829 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9528d expref: 90 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.375022:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af6727515829 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9528d expref: 90 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.375038:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af6727515829 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9528d expref: 90 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.375468:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.375470:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.375477:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95294 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.375485:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95294 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.375510:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95294 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144897.375521:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172525056:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144897.376032:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.376600:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.376667:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175329408 00000100:00100000:2.0:1746144897.376672:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175329408 00000100:00100000:2.0:1746144897.376711:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5808 00000100:00100000:2.0:1746144897.376718:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31565:x1830965175329408:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144897.376857:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.376869:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9529b expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.376888:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95294 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.376893:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.376895:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.376898:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9529b expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.376929:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95294 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.376939:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95294 expref: 5 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.376947:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172525184:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144897.377081:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f900 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.377821:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172525056:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.377832:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.377982:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175329280:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2994us (3128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.377990:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11223 00000100:00100000:0.0:1746144897.379574:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.379648:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172525184:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144897.379668:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9529b expref: 90 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.379681:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbbd200, rc 0) 00000100:00100000:2.0:1746144897.379706:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+90:31565:x1830965175329408:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2989us (3108us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.379712:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5808 00000100:00100000:3.0:1746144897.379990:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175329664 00000100:00100000:3.0:1746144897.379996:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175329664 00002000:00100000:3.0:1746144897.380022:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5fb80 x1830965175329664/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.380030:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5fb80 with x1830965175329664 ext(0->4095) 00010000:00010000:3.0:1746144897.380036:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95294 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.380045:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95294 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.380051:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5fb80 00000100:00100000:3.0:1746144897.380063:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2244 00000100:00100000:3.0:1746144897.380069:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175329664:12345-192.168.202.16@tcp:3:ldlm_bl.0 00000100:00100000:3.0:1746144897.381109:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175329664:12345-192.168.202.16@tcp:3:ldlm_bl.0 Request processed in 1038us (1537us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.381116:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2244 00002000:00100000:3.0:1746144897.381122:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5fb80 x1830965175329664/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.381128:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5fb80 with x1830965175329664 ext(0->4095) 00010000:00010000:3.0:1746144897.381133:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95294 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.381142:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95294 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.381147:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5fb80 00000100:00100000:0.0:1746144897.383689:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.384695:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175329792 00000100:00100000:1.0:1746144897.384705:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175329792 00010000:00010000:1.0:1746144897.384734:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95294 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.385283:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11224 00000100:00100000:1.0:1746144897.385291:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175329792:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144897.385305:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144897.385323:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95294 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.385333:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95294 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.385350:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515830 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95294 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.385378:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.385381:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.385386:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9529b expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.385393:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9529b expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.385420:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9529b expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144897.385430:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172525312:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144897.386104:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b53440c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.389472:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.389563:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172525312:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.389578:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.389612:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4fd6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175329792:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4321us (5927us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.389620:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11224 00000100:00100000:3.0:1746144897.390450:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175330048 00000100:00100000:3.0:1746144897.390456:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175330048 00002000:00100000:3.0:1746144897.390486:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5c000 x1830965175330048/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.390495:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5c000 with x1830965175330048 ext(0->4095) 00002000:00010000:3.0:1746144897.390499:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5c000 00000100:00100000:3.0:1746144897.390522:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4192 00000100:00100000:3.0:1746144897.390527:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1982:x1830965175330048:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 00000100:00100000:3.0:1746144897.390654:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1982:x1830965175330048:12345-192.168.202.16@tcp:3:ptlrpcd_00_00.0 Request processed in 126us (1189us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.390659:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4192 00002000:00100000:3.0:1746144897.390664:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5c000 x1830965175330048/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.390675:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5c000 with x1830965175330048 ext(0->4095) 00002000:00010000:3.0:1746144897.390678:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5c000 00000100:00100000:0.0:1746144897.398659:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.398759:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175330176 00000100:00100000:2.0:1746144897.398793:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175330176 00000100:00100000:2.0:1746144897.398846:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5809 00000100:00100000:2.0:1746144897.398854:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175330176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144897.398869:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.398884:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af672751583e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af952a2 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.398918:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9529b expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.398925:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144897.398926:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144897.398929:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af672751583e lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a2 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.398959:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9529b expref: 89 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.398970:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9529b expref: 89 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.398981:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172525440:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144897.399129:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f900 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.400676:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172525440:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144897.400700:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af672751583e lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a2 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.400712:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbbc200, rc 0) 00000100:00100000:2.0:1746144897.400740:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175330176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1887us (2089us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.400746:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5809 00000100:00100000:0.0:1746144897.401872:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.401948:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175330304 00000100:00100000:2.0:1746144897.401952:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175330304 00002000:00100000:2.0:1746144897.401983:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880087c5df80 x1830965175330304/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 496/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.401992:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5df80 with x1830965175330304 ext(0->7) 00010000:00010000:2.0:1746144897.401998:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9529b expref: 90 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.402011:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9529b expref: 90 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.402016:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5df80 00000100:00100000:2.0:1746144897.402043:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2245 00000100:00100000:2.0:1746144897.402050:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+90:1985:x1830965175330304:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:2.0:1746144897.402462:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965175330304:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 412us (590us total) trans 4294968052 rc 0/0 00000100:00100000:2.0:1746144897.402468:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2245 00002000:00100000:2.0:1746144897.402474:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880087c5df80 x1830965175330304/t4294968052(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 496/448 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.402481:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5df80 with x1830965175330304 ext(0->7) 00010000:00010000:2.0:1746144897.402485:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9529b expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.402493:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9529b expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.402498:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5df80 00000100:00100000:0.0:1746144897.413558:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.413647:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175330432 00000100:00100000:1.0:1746144897.413655:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175330432 00010000:00010000:1.0:1746144897.413682:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9529b expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.413707:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11225 00000100:00100000:1.0:1746144897.413713:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1982:x1830965175330432:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144897.413723:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144897.413740:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9529b expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.413757:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9529b expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.413797:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd200/0x4076af6727515837 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9529b expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.413821:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.413823:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.413829:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af672751583e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a2 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.413836:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af672751583e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a2 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.413862:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af672751583e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a2 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144897.413872:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172525568:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144897.413943:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.415621:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172525568:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.415635:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.415663:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1982:x1830965175330432:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1950us (2112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.415671:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11225 00000100:00100000:0.0:1746144897.416826:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.416995:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175330688 00000100:00100000:2.0:1746144897.417000:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175330688 00002000:00100000:2.0:1746144897.417033:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5f100 x1830965175330688/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.417041:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5f100 with x1830965175330688 ext(0->4095) 00002000:00010000:2.0:1746144897.417045:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5f100 00000100:00100000:2.0:1746144897.417102:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4193 00000100:00100000:2.0:1746144897.417108:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175330688:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 00000100:00100000:2.0:1746144897.418374:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175330688:12345-192.168.202.16@tcp:3:ptlrpcd_00_01.0 Request processed in 1262us (1547us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.418380:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4193 00002000:00100000:2.0:1746144897.418386:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5f100 x1830965175330688/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_00_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.418393:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5f100 with x1830965175330688 ext(0->4095) 00002000:00010000:2.0:1746144897.418395:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5f100 00000100:00100000:0.0:1746144897.420951:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.421026:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175330816 00000100:00100000:2.0:1746144897.421032:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175330816 00000100:00100000:2.0:1746144897.421630:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5810 00000100:00100000:2.0:1746144897.421638:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31579:x1830965175330816:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144897.421653:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.421667:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af952a9 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.421690:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af672751583e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a2 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.421696:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.421698:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.421700:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a9 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.421726:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af672751583e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a2 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.421735:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af672751583e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a2 expref: 5 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.421745:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172525696:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144897.423162:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.424460:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172525696:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144897.424485:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a9 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.424498:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbbc400, rc 0) 00000100:00100000:2.0:1746144897.424532:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31579:x1830965175330816:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2895us (3586us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.424539:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5810 00000100:00100000:0.0:1746144897.425352:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.425433:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175330944 00000100:00100000:3.0:1746144897.425439:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175330944 00000100:00100000:3.0:1746144897.425465:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5811 00000100:00100000:3.0:1746144897.425471:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31565:x1830965175330944:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.425482:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.425493:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af952b0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.425511:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.425515:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a9 expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.425520:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.425523:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b0 expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.425549:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a9 expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.425557:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b0 expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.425565:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:3.0:1746144897.425599:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31565:x1830965175330944:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 128us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.425605:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5811 00000100:00100000:0.0:1746144897.427992:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.428318:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175331072 00000100:00100000:1.0:1746144897.428325:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175331072 00010000:00010000:1.0:1746144897.428351:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af672751583e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a2 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.428371:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11226 00000100:00100000:1.0:1746144897.428378:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175331072:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144897.428387:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144897.428404:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af672751583e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a2 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.428414:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af672751583e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a2 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.428432:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc200/0x4076af672751583e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a2 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.428460:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.428462:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.428468:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a9 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.428476:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a9 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.428500:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a9 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.428508:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a9 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.428519:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172525952:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144897.429125:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.431191:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.431311:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172525952:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.431326:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.431362:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175331072:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2985us (3376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.431370:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11226 00000100:00100000:2.0:1746144897.431614:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175331328 00000100:00100000:2.0:1746144897.431619:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175331328 00002000:00100000:2.0:1746144897.431650:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5d180 x1830965175331328/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.431659:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5d180 with x1830965175331328 ext(0->4095) 00010000:00010000:2.0:1746144897.431665:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a9 expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.431679:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a9 expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.431685:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5d180 00000100:00100000:2.0:1746144897.431712:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2246 00000100:00100000:2.0:1746144897.431719:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1984:x1830965175331328:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144897.431873:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1984:x1830965175331328:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 155us (688us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.431878:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2246 00002000:00100000:2.0:1746144897.431883:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5d180 x1830965175331328/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.431889:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5d180 with x1830965175331328 ext(0->4095) 00010000:00010000:2.0:1746144897.431893:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a9 expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.431901:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a9 expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.431916:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5d180 00000100:00100000:0.0:1746144897.434141:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.434280:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175331456 00000100:00100000:2.0:1746144897.434285:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175331456 00000100:00100000:2.0:1746144897.434414:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5812 00000100:00100000:2.0:1746144897.434421:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175331456:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144897.434432:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.434444:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af952b7 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.434462:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144897.434466:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b0 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.434471:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144897.434474:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b7 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.434497:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b0 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.434506:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b7 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.434513:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbbd800, rc 0) 00000100:00100000:2.0:1746144897.434541:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175331456:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 121us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.434546:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5812 00000100:00100000:0.0:1746144897.434891:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.435356:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175331584 00000100:00100000:1.0:1746144897.435360:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175331584 00010000:00010000:1.0:1746144897.435380:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a9 expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.435650:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11227 00000100:00100000:1.0:1746144897.435656:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1982:x1830965175331584:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144897.435665:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144897.435682:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a9 expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.435692:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a9 expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.435707:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515845 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952a9 expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.436186:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.436189:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.436195:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b0 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.436203:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b0 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.436228:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b0 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.436237:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b0 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.436247:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172526208:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144897.436702:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.437700:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172526208:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.437713:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.437738:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1982:x1830965175331584:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2082us (2847us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.437745:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11227 00000100:00100000:0.0:1746144897.438698:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.439161:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175331840 00000100:00100000:3.0:1746144897.439167:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175331840 00002000:00100000:3.0:1746144897.439279:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5e680 x1830965175331840/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.439290:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5e680 with x1830965175331840 ext(0->4095) 00010000:00010000:3.0:1746144897.439298:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b0 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.439309:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b0 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.439314:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5e680 00000100:00100000:3.0:1746144897.439340:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2247 00000100:00100000:3.0:1746144897.439347:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175331840:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.440056:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175331840:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 707us (1357us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.440062:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2247 00002000:00100000:3.0:1746144897.440068:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5e680 x1830965175331840/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.440074:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5e680 with x1830965175331840 ext(0->4095) 00010000:00010000:3.0:1746144897.440079:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b0 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.440092:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b0 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.440097:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5e680 00000100:00100000:0.0:1746144897.442235:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.442946:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.443087:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175332096 00000100:00100000:1.0:1746144897.443094:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175332096 00010000:00010000:1.0:1746144897.443119:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b0 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.443188:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175331968 00000100:00100000:3.0:1746144897.443192:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175331968 00000100:00100000:1.0:1746144897.443289:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11228 00000100:00100000:1.0:1746144897.443296:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1982:x1830965175332096:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144897.443309:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144897.443324:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b0 expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.443333:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b0 expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.443350:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751584c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b0 expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.443366:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.443368:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.443374:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b7 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.443381:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b7 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.443407:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b7 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144897.443417:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172526336:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.443480:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5813 00000100:00100000:3.0:1746144897.443486:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31565:x1830965175331968:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.443497:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.443506:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751585a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af952be expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.443521:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b7 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.443526:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.443527:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.443529:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751585a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952be expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.443544:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b7 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.443552:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 6/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b7 expref: 5 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.443558:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172526464:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144897.444301:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.444443:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.447074:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.447204:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172526336:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.447217:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.447246:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1982:x1830965175332096:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3950us (4300us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.447257:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11228 00000100:00100000:3.0:1746144897.447324:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175332352 00000100:00100000:3.0:1746144897.447330:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175332352 00002000:00100000:3.0:1746144897.447358:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5d500 x1830965175332352/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.447367:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5d500 with x1830965175332352 ext(0->4095) 00010000:00010000:3.0:1746144897.447373:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b7 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.447383:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b7 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.447388:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5d500 00000100:00100000:3.0:1746144897.447400:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2248 00000100:00100000:3.0:1746144897.447405:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175332352:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144897.447532:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175332352:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 126us (464us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.447538:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2248 00002000:00100000:3.0:1746144897.447542:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880087c5d500 x1830965175332352/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.447549:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5d500 with x1830965175332352 ext(0->4095) 00010000:00010000:3.0:1746144897.447553:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b7 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.447561:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b7 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.447567:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880087c5d500 00000100:00100000:2.0:1746144897.447714:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172526464:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144897.447728:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751585a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952be expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.447738:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:2.0:1746144897.447755:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31565:x1830965175331968:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4270us (5526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.447784:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5813 00000100:00100000:0.0:1746144897.453046:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.453299:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175332480 00000100:00100000:1.0:1746144897.453306:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175332480 00010000:00010000:1.0:1746144897.453335:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b7 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.453359:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11229 00000100:00100000:1.0:1746144897.453365:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175332480:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144897.453377:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144897.453394:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b7 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.453405:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b7 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.453422:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af6727515853 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952b7 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.453531:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.453534:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.453540:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751585a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952be expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.453547:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751585a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952be expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.453576:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751585a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952be expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144897.453587:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172526592:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144897.454009:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.456735:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172526592:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.456749:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.456793:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175332480:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3428us (3755us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.456802:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11229 00000100:00100000:0.0:1746144897.457077:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.457451:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175332736 00000100:00100000:3.0:1746144897.457458:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175332736 00002000:00100000:3.0:1746144897.457488:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc5500 x1830965175332736/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.457497:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc5500 with x1830965175332736 ext(0->4095) 00002000:00010000:3.0:1746144897.457501:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc5500 00000100:00100000:3.0:1746144897.457515:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4194 00000100:00100000:3.0:1746144897.457521:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175332736:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.457655:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175332736:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 133us (577us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.457661:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4194 00002000:00100000:3.0:1746144897.457666:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc5500 x1830965175332736/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.457672:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc5500 with x1830965175332736 ext(0->4095) 00002000:00010000:3.0:1746144897.457675:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc5500 00000100:00100000:0.0:1746144897.460527:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.460639:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175332864 00000100:00100000:2.0:1746144897.460646:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175332864 00000100:00100000:2.0:1746144897.460679:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5814 00000100:00100000:2.0:1746144897.460686:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175332864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144897.460700:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.460713:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515861 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af952c5 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.460736:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751585a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952be expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.460742:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144897.460744:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144897.460747:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515861 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952c5 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.460787:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751585a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952be expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.460796:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751585a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952be expref: 91 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.460806:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172526720:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144897.461230:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.463381:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172526720:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144897.463410:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515861 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952c5 expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.463422:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbbd000, rc 0) 00000100:00100000:2.0:1746144897.463452:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175332864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2767us (2933us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.463458:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5814 00000100:00100000:0.0:1746144897.463819:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.463960:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175332992 00000100:00100000:1.0:1746144897.463966:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175332992 00010000:00010000:1.0:1746144897.463986:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751585a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952be expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.464003:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11230 00000100:00100000:1.0:1746144897.464008:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965175332992:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144897.464018:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144897.464033:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751585a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952be expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.464042:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751585a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952be expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.464059:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af672751585a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952be expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.464081:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.464083:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.464089:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515861 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952c5 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.464097:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515861 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952c5 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.464119:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515861 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952c5 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144897.464128:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172526848:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144897.464178:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.466646:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172526848:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.466660:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.466690:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1985:x1830965175332992:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2680us (2872us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.466699:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11230 00000100:00100000:0.0:1746144897.467090:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.467306:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175333248 00000100:00100000:2.0:1746144897.467312:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175333248 00002000:00100000:2.0:1746144897.467345:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc4700 x1830965175333248/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.467353:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4700 with x1830965175333248 ext(0->4095) 00002000:00010000:2.0:1746144897.467357:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc4700 00000100:00100000:0.0:1746144897.468011:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.468061:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4195 00000100:00100000:2.0:1746144897.468070:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175333248:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144897.468207:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175333248:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 140us (1117us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.468213:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4195 00002000:00100000:2.0:1746144897.468219:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc4700 x1830965175333248/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.468226:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4700 with x1830965175333248 ext(0->4095) 00002000:00010000:2.0:1746144897.468229:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc4700 00000100:00100000:2.0:1746144897.468244:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175333376 00000100:00100000:2.0:1746144897.468247:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175333376 00000100:00100000:2.0:1746144897.468262:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5815 00000100:00100000:2.0:1746144897.468267:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31565:x1830965175333376:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144897.468274:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.468287:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af952cc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.468305:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515861 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952c5 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.468311:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.468313:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.468316:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952cc expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.468336:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515861 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952c5 expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.468345:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515861 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952c5 expref: 5 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.468355:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172526976:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144897.468399:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.472464:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.472786:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925aaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172526976:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144897.472811:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952cc expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.472824:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbbc400, rc 0) 00000100:00100000:3.0:1746144897.472867:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31565:x1830965175333376:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4599us (4856us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.472877:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5815 00000100:00100000:3.0:1746144897.472897:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175333504 00000100:00100000:3.0:1746144897.472901:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175333504 00000100:00100000:3.0:1746144897.472941:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5816 00000100:00100000:3.0:1746144897.472946:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31579:x1830965175333504:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.472957:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.472968:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751586f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af952d3 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.472983:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.472987:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952cc expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.472992:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.472995:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751586f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952d3 expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.473018:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952cc expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.473025:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751586f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952d3 expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.473031:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:3.0:1746144897.473043:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31579:x1830965175333504:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 98us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.473048:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5816 00000100:00100000:0.0:1746144897.474791:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.475093:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175333632 00000100:00100000:1.0:1746144897.475098:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175333632 00010000:00010000:1.0:1746144897.475119:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515861 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952c5 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.475137:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11231 00000100:00100000:1.0:1746144897.475143:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175333632:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144897.475152:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144897.475168:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515861 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952c5 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.475183:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515861 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952c5 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.475198:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd000/0x4076af6727515861 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952c5 expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.475220:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.475222:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.475227:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952cc expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.475234:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952cc expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.475255:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952cc expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.475264:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952cc expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.475275:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172527232:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144897.475330:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88013738ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.477200:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172527232:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.477214:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.477236:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4fd6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175333632:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2093us (2450us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.477248:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11231 00000100:00100000:0.0:1746144897.479088:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.479281:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175333888 00000100:00100000:3.0:1746144897.479287:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175333888 00002000:00100000:3.0:1746144897.479319:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc4380 x1830965175333888/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.479328:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4380 with x1830965175333888 ext(0->4095) 00010000:00010000:3.0:1746144897.479335:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952cc expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.479346:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952cc expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.479353:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bbc4380 00000100:00100000:3.0:1746144897.479367:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2249 00000100:00100000:3.0:1746144897.479373:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175333888:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144897.479505:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175333888:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 132us (422us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.479511:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2249 00002000:00100000:3.0:1746144897.479516:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc4380 x1830965175333888/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.479523:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4380 with x1830965175333888 ext(0->4095) 00010000:00010000:3.0:1746144897.479527:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952cc expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.479536:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952cc expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.479546:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009bbc4380 00000100:00100000:0.0:1746144897.481660:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.481883:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175334016 00000100:00100000:1.0:1746144897.481889:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175334016 00010000:00010000:1.0:1746144897.481920:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952cc expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.481937:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11232 00000100:00100000:1.0:1746144897.481944:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1982:x1830965175334016:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144897.481954:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144897.481969:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952cc expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.481979:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952cc expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.481996:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbc400/0x4076af6727515868 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952cc expref: 93 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.482493:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.482496:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.482502:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751586f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952d3 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.482510:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751586f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952d3 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.482539:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751586f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952d3 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144897.482549:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172527360:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144897.482617:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.485224:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.485332:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172527360:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.485347:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.485375:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1982:x1830965175334016:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3431us (3719us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.485383:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11232 00000100:00100000:2.0:1746144897.485519:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175334272 00000100:00100000:2.0:1746144897.485525:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175334272 00002000:00100000:2.0:1746144897.485558:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc4a80 x1830965175334272/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.485573:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4a80 with x1830965175334272 ext(0->4095) 00002000:00010000:2.0:1746144897.485576:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc4a80 00000100:00100000:2.0:1746144897.485598:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4196 00000100:00100000:2.0:1746144897.485603:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175334272:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144897.485716:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175334272:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 113us (497us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.485722:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4196 00002000:00100000:2.0:1746144897.485726:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009bbc4a80 x1830965175334272/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.485733:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4a80 with x1830965175334272 ext(0->4095) 00002000:00010000:2.0:1746144897.485735:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc4a80 00000100:00100000:0.0:1746144897.488337:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.488651:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175334400 00000100:00100000:1.0:1746144897.488657:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175334400 00000100:00100000:1.0:1746144897.488713:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5817 00000100:00100000:1.0:1746144897.488719:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175334400:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.488733:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.488745:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515876 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af952da expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.488793:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751586f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952d3 expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.488799:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.488801:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.488804:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515876 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952da expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.488825:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751586f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952d3 expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.488839:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751586f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952d3 expref: 91 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.488849:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172527488:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144897.488921:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.490913:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172527488:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144897.490934:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515876 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952da expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.490947:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966da00, rc 0) 00000100:00100000:1.0:1746144897.490975:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175334400:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2256us (2643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.490982:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5817 00000100:00100000:0.0:1746144897.492338:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.492410:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175334528 00000100:00100000:1.0:1746144897.492415:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175334528 00010000:00010000:1.0:1746144897.492437:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751586f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952d3 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.492686:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11233 00000100:00100000:1.0:1746144897.492692:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965175334528:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144897.492702:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144897.492718:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751586f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952d3 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.492731:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751586f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952d3 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.492747:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752c00/0x4076af672751586f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952d3 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.492783:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.492784:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.492790:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515876 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952da expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.492798:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515876 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952da expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.492820:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515876 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952da expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144897.492829:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172527616:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144897.493225:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.495524:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.495598:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172527616:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.495612:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.495638:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1985:x1830965175334528:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2946us (3304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.495645:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11233 00000100:00100000:3.0:1746144897.495702:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175334784 00000100:00100000:3.0:1746144897.495706:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175334784 00002000:00100000:3.0:1746144897.495733:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e80000 x1830965175334784/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.495740:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e80000 with x1830965175334784 ext(0->4095) 00002000:00010000:3.0:1746144897.495744:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e80000 00000100:00100000:3.0:1746144897.495785:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4197 00000100:00100000:3.0:1746144897.495799:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175334784:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.495920:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175334784:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 130us (400us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.495926:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4197 00002000:00100000:3.0:1746144897.495930:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e80000 x1830965175334784/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.495936:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e80000 with x1830965175334784 ext(0->4095) 00002000:00010000:3.0:1746144897.495938:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e80000 00000100:00100000:0.0:1746144897.497079:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.497340:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175334912 00000100:00100000:1.0:1746144897.497344:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175334912 00000100:00100000:1.0:1746144897.497373:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5818 00000100:00100000:1.0:1746144897.497378:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31565:x1830965175334912:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.497387:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.497400:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af952e1 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.497420:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515876 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952da expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.497426:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.497427:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.497430:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e1 expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.497449:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515876 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952da expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.497458:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515876 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952da expref: 5 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.497466:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172527744:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144897.497523:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.500338:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.500872:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175335040 00000100:00100000:2.0:1746144897.500878:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175335040 00000100:00100000:2.0:1746144897.500927:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5819 00000100:00100000:2.0:1746144897.500933:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31579:x1830965175335040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144897.500947:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.500959:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515884 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af952e8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.500977:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.500981:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e1 expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.500986:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144897.500990:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515884 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e8 expref: 94 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.501016:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e1 expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.501025:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515884 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e8 expref: 94 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.501033:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009422ae00, rc 0) 00000100:00100000:2.0:1746144897.501065:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+94:31579:x1830965175335040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 133us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.501070:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5819 00000100:00100000:0.0:1746144897.501915:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.502082:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172527744:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144897.502096:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e1 expref: 93 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.502109:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d600, rc 0) 00000100:00100000:1.0:1746144897.502137:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31565:x1830965175334912:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4759us (5060us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.502142:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5818 00000100:00100000:2.0:1746144897.502801:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175335168 00000100:00100000:2.0:1746144897.502805:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175335168 00010000:00010000:2.0:1746144897.502826:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515876 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952da expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.502884:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11234 00000100:00100000:2.0:1746144897.502889:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175335168:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.502898:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.503096:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515876 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952da expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.503107:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515876 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952da expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.503134:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515876 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952da expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.503983:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.503988:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.503995:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e1 expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.504003:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e1 expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.504046:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e1 expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.504056:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e1 expref: 92 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.504082:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172528000:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.504168:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.505476:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172528000:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.505492:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.505540:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175335168:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2650us (3635us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.505548:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11234 00000100:00100000:0.0:1746144897.506382:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.506528:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175335424 00000100:00100000:2.0:1746144897.506533:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175335424 00002000:00100000:2.0:1746144897.506559:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e81500 x1830965175335424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.506574:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e81500 with x1830965175335424 ext(0->4095) 00010000:00010000:2.0:1746144897.506580:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e1 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.506590:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e1 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.506596:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e81500 00000100:00100000:2.0:1746144897.506617:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2250 00000100:00100000:2.0:1746144897.506623:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1984:x1830965175335424:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144897.506751:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1984:x1830965175335424:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 128us (370us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.506757:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2250 00002000:00100000:2.0:1746144897.506785:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e81500 x1830965175335424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.506792:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e81500 with x1830965175335424 ext(0->4095) 00010000:00010000:2.0:1746144897.506796:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e1 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.506803:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e1 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.506808:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e81500 00000100:00100000:0.0:1746144897.509379:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.509480:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175335552 00000100:00100000:2.0:1746144897.509488:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175335552 00010000:00010000:2.0:1746144897.509519:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e1 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.510089:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11235 00000100:00100000:2.0:1746144897.510098:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1983:x1830965175335552:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.510110:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.510129:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e1 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.510140:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e1 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.510157:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af672751587d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e1 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.510169:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.510171:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.510176:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515884 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e8 expref: 92 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.510183:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515884 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e8 expref: 92 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.510210:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515884 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e8 expref: 92 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.510220:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172528128:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.510714:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.513333:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172528128:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.513354:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.513389:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1983:x1830965175335552:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3292us (4016us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.513398:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11235 00000100:00100000:0.0:1746144897.514878:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.514938:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175335808 00000100:00100000:3.0:1746144897.514945:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175335808 00002000:00100000:3.0:1746144897.515008:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e83b80 x1830965175335808/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.515018:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83b80 with x1830965175335808 ext(0->4095) 00002000:00010000:3.0:1746144897.515022:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e83b80 00000100:00100000:3.0:1746144897.515049:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4198 00000100:00100000:3.0:1746144897.515057:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175335808:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.515341:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175335808:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 284us (465us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.515347:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4198 00002000:00100000:3.0:1746144897.515353:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e83b80 x1830965175335808/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.515357:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83b80 with x1830965175335808 ext(0->4095) 00002000:00010000:3.0:1746144897.515359:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e83b80 00000100:00100000:0.0:1746144897.516633:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.516730:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175335936 00000100:00100000:1.0:1746144897.516736:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175335936 00000100:00100000:3.0:1746144897.516929:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5820 00000100:00100000:3.0:1746144897.516936:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175335936:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.516946:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.516959:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751588b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af952ef expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.516978:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515884 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e8 expref: 91 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.516985:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.516986:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.516990:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751588b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952ef expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.517017:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515884 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e8 expref: 91 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.517027:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515884 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e8 expref: 91 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.517093:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172528256:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.517162:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.519120:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172528256:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144897.519142:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751588b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952ef expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.519160:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:3.0:1746144897.519253:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175335936:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2316us (2621us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.519261:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5820 00000100:00100000:0.0:1746144897.519273:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.519455:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175336064 00000100:00100000:2.0:1746144897.519460:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175336064 00010000:00010000:2.0:1746144897.519484:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515884 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e8 expref: 92 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.519501:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11236 00000100:00100000:2.0:1746144897.519508:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965175336064:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.519517:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.519534:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515884 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e8 expref: 92 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.519542:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515884 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e8 expref: 92 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.519601:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009422ae00/0x4076af6727515884 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952e8 expref: 92 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.519614:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.519617:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.519622:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751588b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952ef expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.519633:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751588b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952ef expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.519654:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751588b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952ef expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.519664:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172528384:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.519721:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f180 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.521479:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172528384:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.521814:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.521850:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1985:x1830965175336064:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2342us (2576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.521858:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11236 00000100:00100000:0.0:1746144897.522217:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.522312:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175336320 00000100:00100000:3.0:1746144897.522318:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175336320 00002000:00100000:3.0:1746144897.522350:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e82680 x1830965175336320/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.522358:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82680 with x1830965175336320 ext(0->4095) 00002000:00010000:3.0:1746144897.522362:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e82680 00000100:00100000:3.0:1746144897.522383:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4199 00000100:00100000:3.0:1746144897.522389:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175336320:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.522518:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175336320:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 129us (301us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.522523:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4199 00002000:00100000:3.0:1746144897.522528:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e82680 x1830965175336320/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.522540:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82680 with x1830965175336320 ext(0->4095) 00002000:00010000:3.0:1746144897.522543:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e82680 00000100:00100000:0.0:1746144897.525973:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.526051:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.526126:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175336448 00000100:00100000:3.0:1746144897.526133:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175336448 00000100:00100000:1.0:1746144897.526174:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175336576 00000100:00100000:1.0:1746144897.526178:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175336576 00000100:00100000:1.0:1746144897.526216:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5821 00000100:00100000:1.0:1746144897.526223:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31565:x1830965175336576:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.526239:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.526253:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af952fd expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.526276:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751588b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952ef expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.526282:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.526283:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.526286:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952fd expref: 93 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.526309:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751588b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952ef expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.526318:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751588b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952ef expref: 5 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.526328:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172528512:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.526504:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5822 00000100:00100000:3.0:1746144897.526511:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31579:x1830965175336448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.526518:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.526524:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515899 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af952f6 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.526535:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.526538:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952fd expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.526542:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.526544:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515899 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952f6 expref: 94 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.526564:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952fd expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.526579:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515899 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952f6 expref: 94 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.526588:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753600, rc 0) 00000100:00100000:3.0:1746144897.526636:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+94:31579:x1830965175336448:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 126us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.526642:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5822 00000100:00100000:1.0:1746144897.526677:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.528687:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172528512:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144897.528709:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952fd expref: 93 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.528722:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d800, rc 0) 00000100:00100000:1.0:1746144897.528750:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31565:x1830965175336576:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2527us (2699us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.528757:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5821 00000100:00100000:0.0:1746144897.528980:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.529086:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175336704 00000100:00100000:3.0:1746144897.529091:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175336704 00010000:00010000:3.0:1746144897.529113:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751588b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952ef expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.529131:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11237 00000100:00100000:3.0:1746144897.529136:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175336704:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.529146:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.529163:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751588b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952ef expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.529172:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751588b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952ef expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.529190:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af672751588b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952ef expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.529201:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.529203:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.529208:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952fd expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.529365:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952fd expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.529391:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952fd expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.529401:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952fd expref: 92 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.529410:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172528768:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.529603:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.530869:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172528768:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.530885:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.531034:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175336704:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1896us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.531042:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11237 00000100:00100000:0.0:1746144897.531116:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.531147:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175336960 00000100:00100000:3.0:1746144897.531152:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175336960 00002000:00100000:3.0:1746144897.531178:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e80700 x1830965175336960/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.531186:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e80700 with x1830965175336960 ext(0->4095) 00010000:00010000:3.0:1746144897.531192:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952fd expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.531201:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952fd expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.531207:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e80700 00000100:00100000:3.0:1746144897.531221:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2251 00000100:00100000:3.0:1746144897.531226:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1984:x1830965175336960:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.531361:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1984:x1830965175336960:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 134us (245us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.531367:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2251 00002000:00100000:3.0:1746144897.531371:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e80700 x1830965175336960/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.531378:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e80700 with x1830965175336960 ext(0->4095) 00010000:00010000:3.0:1746144897.531382:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952fd expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.531390:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952fd expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.531395:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093e80700 00000100:00100000:0.0:1746144897.533130:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.533332:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175337088 00000100:00100000:3.0:1746144897.533338:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175337088 00010000:00010000:3.0:1746144897.533362:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952fd expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.533381:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11238 00000100:00100000:3.0:1746144897.533387:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1984:x1830965175337088:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.533398:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.533415:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952fd expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.533424:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952fd expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.533443:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af6727515892 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952fd expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.533460:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.533462:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.533467:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515899 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952f6 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.533474:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515899 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952f6 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.533501:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515899 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952f6 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144897.533510:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172528896:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.533723:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.535531:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172528896:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.535546:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.535574:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4fd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175337088:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2187us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.535584:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11238 00000100:00100000:0.0:1746144897.536436:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.536594:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175337344 00000100:00100000:2.0:1746144897.536600:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175337344 00002000:00100000:2.0:1746144897.537006:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e81880 x1830965175337344/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.537014:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e81880 with x1830965175337344 ext(0->4095) 00002000:00010000:2.0:1746144897.537018:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e81880 00000100:00100000:2.0:1746144897.537042:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4200 00000100:00100000:2.0:1746144897.537049:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965175337344:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144897.537186:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965175337344:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 137us (751us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.537195:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4200 00002000:00100000:2.0:1746144897.537200:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e81880 x1830965175337344/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.537206:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e81880 with x1830965175337344 ext(0->4095) 00002000:00010000:2.0:1746144897.537209:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e81880 00000100:00100000:0.0:1746144897.539459:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.539576:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175337472 00000100:00100000:1.0:1746144897.539582:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175337472 00000100:00100000:1.0:1746144897.539623:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5823 00000100:00100000:1.0:1746144897.539630:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175337472:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.539642:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.539656:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275158a0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95304 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.539679:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515899 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952f6 expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.539686:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.539687:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.539690:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275158a0 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95304 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.539722:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515899 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952f6 expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.539732:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515899 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952f6 expref: 91 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.539742:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172529024:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144897.539837:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.541540:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172529024:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144897.541561:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275158a0 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95304 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.541573:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d200, rc 0) 00000100:00100000:1.0:1746144897.541601:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175337472:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1971us (2146us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.541608:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5823 00000100:00100000:0.0:1746144897.542017:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.542203:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175337600 00000100:00100000:3.0:1746144897.542207:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175337600 00010000:00010000:3.0:1746144897.542228:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515899 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952f6 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.542250:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11239 00000100:00100000:3.0:1746144897.542255:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175337600:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.542339:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.542357:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515899 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952f6 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.542366:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515899 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952f6 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.542382:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753600/0x4076af6727515899 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af952f6 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.542405:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.542406:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.542412:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275158a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95304 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.542418:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275158a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95304 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.542441:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275158a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95304 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144897.542450:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172529152:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.542514:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42180 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.544139:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172529152:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.544154:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.544181:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175337600:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1925us (2165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.544189:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11239 00000100:00100000:0.0:1746144897.544597:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.544669:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175337856 00000100:00100000:3.0:1746144897.544673:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175337856 00002000:00100000:3.0:1746144897.544700:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e83800 x1830965175337856/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.544709:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83800 with x1830965175337856 ext(0->4095) 00002000:00010000:3.0:1746144897.544712:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e83800 00000100:00100000:3.0:1746144897.545264:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4201 00000100:00100000:3.0:1746144897.545271:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175337856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.545422:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175337856:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 150us (824us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.545427:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4201 00002000:00100000:3.0:1746144897.545432:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093e83800 x1830965175337856/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.545438:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e83800 with x1830965175337856 ext(0->4095) 00002000:00010000:3.0:1746144897.545440:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e83800 00000100:00100000:0.0:1746144897.547047:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.547135:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175337984 00000100:00100000:1.0:1746144897.547141:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175337984 00000100:00100000:1.0:1746144897.547200:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5824 00000100:00100000:1.0:1746144897.547206:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31565:x1830965175337984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.547218:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.547230:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9530b expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.547252:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275158a0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95304 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.547259:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.547261:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.547264:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9530b expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.547284:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275158a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95304 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.547293:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275158a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95304 expref: 5 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.547302:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172529280:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144897.547360:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.547502:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.547692:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175338112 00000100:00100000:2.0:1746144897.547697:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175338112 00000100:00100000:2.0:1746144897.547718:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5825 00000100:00100000:2.0:1746144897.547723:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31579:x1830965175338112:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144897.547730:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.547737:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af67275158ae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95312 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.547749:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.547752:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9530b expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.547757:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144897.547759:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af67275158ae lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95312 expref: 94 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.547799:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9530b expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.547809:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af67275158ae lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95312 expref: 94 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.547821:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009422aa00, rc 0) 00000100:00100000:2.0:1746144897.547844:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+94:31579:x1830965175338112:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 120us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.547849:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5825 00000100:00100000:1.0:1746144897.549339:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172529280:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144897.549362:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9530b expref: 93 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.549373:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966da00, rc 0) 00000100:00100000:1.0:1746144897.549673:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31565:x1830965175337984:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2465us (2627us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.549679:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5824 00000100:00100000:0.0:1746144897.550037:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.550184:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175338240 00000100:00100000:3.0:1746144897.550189:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175338240 00010000:00010000:3.0:1746144897.550212:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275158a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95304 expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.550235:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11240 00000100:00100000:3.0:1746144897.550240:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1982:x1830965175338240:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.550251:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.550266:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275158a0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95304 expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.550276:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275158a0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95304 expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.550293:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af67275158a0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95304 expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.550318:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.550320:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.550325:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9530b expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.550332:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9530b expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.550357:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9530b expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.550367:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9530b expref: 92 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.550380:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172529536:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.550434:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.552357:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172529536:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.552370:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.552454:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1982:x1830965175338240:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2213us (2416us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.552462:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11240 00000100:00100000:0.0:1746144897.554245:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.554438:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175338496 00000100:00100000:2.0:1746144897.554444:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175338496 00002000:00100000:2.0:1746144897.554483:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ce00 x1830965175338496/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.554491:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ce00 with x1830965175338496 ext(0->4095) 00010000:00010000:2.0:1746144897.554498:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9530b expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.554509:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9530b expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.554515:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398ce00 00000100:00100000:2.0:1746144897.554542:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2252 00000100:00100000:2.0:1746144897.554549:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175338496:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144897.554926:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175338496:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 152us (459us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.554933:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2252 00002000:00100000:2.0:1746144897.554939:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ce00 x1830965175338496/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.554951:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ce00 with x1830965175338496 ext(0->4095) 00010000:00010000:2.0:1746144897.554956:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9530b expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.554964:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9530b expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.554969:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398ce00 00000100:00100000:0.0:1746144897.557619:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.557795:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175338624 00000100:00100000:3.0:1746144897.557803:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175338624 00010000:00010000:3.0:1746144897.557830:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9530b expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.557853:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11241 00000100:00100000:3.0:1746144897.557859:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1984:x1830965175338624:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.557869:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.557886:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9530b expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.558065:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9530b expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.558083:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9530b expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.558110:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.558149:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.558156:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af67275158ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95312 expref: 92 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.558162:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af67275158ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95312 expref: 92 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.558266:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af67275158ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95312 expref: 92 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144897.558277:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172529664:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.558459:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.562005:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.562193:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172529664:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.562210:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.562245:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175338624:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4386us (4632us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.562254:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11241 00000100:00100000:2.0:1746144897.562321:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175338880 00000100:00100000:2.0:1746144897.562327:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175338880 00002000:00100000:2.0:1746144897.562360:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ea00 x1830965175338880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.562368:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ea00 with x1830965175338880 ext(0->4095) 00002000:00010000:2.0:1746144897.562372:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398ea00 00000100:00100000:2.0:1746144897.562396:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4202 00000100:00100000:2.0:1746144897.562403:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965175338880:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144897.562535:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965175338880:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 133us (537us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.562541:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4202 00002000:00100000:2.0:1746144897.562546:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ea00 x1830965175338880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.562553:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ea00 with x1830965175338880 ext(0->4095) 00002000:00010000:2.0:1746144897.562556:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398ea00 00000100:00100000:0.0:1746144897.566016:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.566194:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175339008 00000100:00100000:1.0:1746144897.566201:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175339008 00000100:00100000:1.0:1746144897.566278:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5826 00000100:00100000:1.0:1746144897.566285:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175339008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.566301:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.566314:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158b5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95319 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.566340:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af67275158ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95312 expref: 91 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.566347:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.566349:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.566352:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158b5 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95319 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.566376:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af67275158ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95312 expref: 91 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.566386:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af67275158ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95312 expref: 91 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.566396:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172529792:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144897.566509:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.567959:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172529792:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144897.568011:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158b5 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95319 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.568026:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966c000, rc 0) 00000100:00100000:1.0:1746144897.568055:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175339008:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1771us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.568065:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5826 00000100:00100000:0.0:1746144897.568606:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.568703:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175339136 00000100:00100000:3.0:1746144897.568708:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175339136 00010000:00010000:3.0:1746144897.568727:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af67275158ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95312 expref: 92 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.568753:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11242 00000100:00100000:3.0:1746144897.568759:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175339136:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.568795:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.568812:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af67275158ae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95312 expref: 92 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.568825:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af67275158ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95312 expref: 92 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.568841:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009422aa00/0x4076af67275158ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95312 expref: 92 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.568862:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.568865:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.568870:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95319 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.568876:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95319 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.568898:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95319 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144897.568919:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172529920:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.568970:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.572063:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.572191:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175339392 00000100:00100000:2.0:1746144897.572198:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175339392 00002000:00100000:2.0:1746144897.572232:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ca80 x1830965175339392/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.572241:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ca80 with x1830965175339392 ext(0->4095) 00002000:00010000:2.0:1746144897.572245:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398ca80 00000100:00100000:2.0:1746144897.572261:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4203 00000100:00100000:2.0:1746144897.572267:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175339392:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.572323:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172529920:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.572337:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.572382:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175339136:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3623us (3776us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.572390:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11242 00000100:00100000:2.0:1746144897.572560:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175339392:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 293us (503us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746144897.572562:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.572566:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4203 00002000:00100000:2.0:1746144897.572576:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ca80 x1830965175339392/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.572585:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ca80 with x1830965175339392 ext(0->4095) 00002000:00010000:2.0:1746144897.572588:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398ca80 00000100:00100000:0.0:1746144897.572625:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175339520 00000100:00100000:0.0:1746144897.572633:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175339520 00000100:00100000:0.0:1746144897.572651:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5827 00000100:00100000:0.0:1746144897.572656:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31565:x1830965175339520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144897.572665:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144897.572678:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95320 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.572696:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158b5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95319 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.572702:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144897.572703:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144897.572706:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95320 expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.573441:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95319 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.573451:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95319 expref: 5 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:0.0:1746144897.573462:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172530048:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144897.573528:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.574892:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.575444:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172530048:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144897.575465:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95320 expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.575479:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b3000, rc 0) 00000100:00100000:3.0:1746144897.575497:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175339648 00000100:00100000:3.0:1746144897.575504:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175339648 00000100:00100000:1.0:1746144897.575512:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31565:x1830965175339520:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2854us (2949us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.575518:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5827 00000100:00100000:3.0:1746144897.575531:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5828 00000100:00100000:3.0:1746144897.575536:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31579:x1830965175339648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.575548:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.575559:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275158c3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95327 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.575577:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.575581:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95320 expref: 93 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.575587:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.575589:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275158c3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95327 expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.575721:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:3.0:1746144897.575900:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95320 expref: 93 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.575918:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275158c3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95327 expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.575926:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:0.0:1746144897.575989:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175339776 00000100:00100000:0.0:1746144897.575992:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175339776 00010000:00010000:0.0:1746144897.576006:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95319 expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:0.0:1746144897.576027:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11243 00000100:00100000:0.0:1746144897.576032:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175339776:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144897.576039:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144897.576054:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158b5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95319 expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:0.0:1746144897.576062:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158b5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95319 expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:0.0:1746144897.576077:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158b5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95319 expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:0.0:1746144897.576093:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144897.576094:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144897.576099:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95320 expref: 93 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.576104:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95320 expref: 93 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.576120:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95320 expref: 93 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.576128:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95320 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:0.0:1746144897.576137:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172530304:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.576402:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31579:x1830965175339648:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 863us (1512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.576408:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5828 00000100:00100000:0.0:1746144897.577302:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.579699:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.579935:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172530304:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.579950:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.579996:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175339776:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3963us (4274us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.580005:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11243 00000100:00100000:3.0:1746144897.580405:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175340032 00000100:00100000:3.0:1746144897.580411:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175340032 00002000:00100000:3.0:1746144897.580444:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398df80 x1830965175340032/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.580457:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398df80 with x1830965175340032 ext(0->4095) 00010000:00010000:3.0:1746144897.580464:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95320 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.580473:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95320 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.580478:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398df80 00000100:00100000:3.0:1746144897.580492:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2253 00000100:00100000:3.0:1746144897.580497:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1984:x1830965175340032:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.580618:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1984:x1830965175340032:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 120us (926us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.580623:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2253 00002000:00100000:3.0:1746144897.580627:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398df80 x1830965175340032/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.580633:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398df80 with x1830965175340032 ext(0->4095) 00010000:00010000:3.0:1746144897.580637:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95320 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.580644:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95320 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.580649:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398df80 00000100:00100000:0.0:1746144897.582498:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.582585:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175340160 00000100:00100000:2.0:1746144897.582591:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175340160 00010000:00010000:2.0:1746144897.582617:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95320 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.582641:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11244 00000100:00100000:2.0:1746144897.582646:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1983:x1830965175340160:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.582655:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.582670:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95320 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.582679:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95320 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.582698:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3000/0x4076af67275158bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95320 expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.582822:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.582824:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.582830:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275158c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95327 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.582838:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275158c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95327 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.582864:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275158c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95327 expref: 92 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.582874:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925ab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172530432:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.583209:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f900 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.585525:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.585688:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175340416 00000100:00100000:2.0:1746144897.585694:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175340416 00002000:00100000:2.0:1746144897.585726:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398f100 x1830965175340416/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.585732:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398f100 with x1830965175340416 ext(0->4095) 00002000:00010000:2.0:1746144897.585736:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398f100 00000100:00100000:2.0:1746144897.585749:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4204 00000100:00100000:2.0:1746144897.585753:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175340416:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144897.585806:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925ab480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172530432:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.585824:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.585873:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1983:x1830965175340160:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3225us (3377us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.585880:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11244 00000100:00100000:2.0:1746144897.585884:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175340416:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 130us (366us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.585888:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4204 00002000:00100000:2.0:1746144897.585891:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398f100 x1830965175340416/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.585896:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398f100 with x1830965175340416 ext(0->4095) 00002000:00010000:2.0:1746144897.585898:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398f100 00000100:00100000:0.0:1746144897.587734:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.587811:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175340544 00000100:00100000:3.0:1746144897.587817:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175340544 00000100:00100000:3.0:1746144897.587845:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5829 00000100:00100000:3.0:1746144897.587851:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175340544:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.587863:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.587876:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275158ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9532e expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.587899:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275158c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95327 expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.587918:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.587920:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.587923:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275158ca lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9532e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.587947:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275158c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95327 expref: 91 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.587956:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275158c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95327 expref: 91 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.587966:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172530560:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.588346:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.589688:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172530560:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144897.589705:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275158ca lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9532e expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.589717:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:2.0:1746144897.590026:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175340544:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2173us (2295us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.590033:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5829 00000100:00100000:1.0:1746144897.590988:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.591043:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175340672 00000100:00100000:3.0:1746144897.591048:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175340672 00010000:00010000:3.0:1746144897.591068:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275158c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95327 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.591091:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11245 00000100:00100000:3.0:1746144897.591096:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175340672:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.591105:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.591121:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275158c3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95327 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.591129:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275158c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95327 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.591145:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752e00/0x4076af67275158c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95327 expref: 92 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.591158:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.591159:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.591165:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275158ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9532e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.591171:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275158ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9532e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.591191:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275158ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9532e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144897.591203:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172530688:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.591253:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.592493:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172530688:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.592505:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.592873:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4fd7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175340672:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1775us (1886us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.592882:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11245 00000100:00100000:0.0:1746144897.594590:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.594648:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175340928 00000100:00100000:2.0:1746144897.594658:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175340928 00002000:00100000:2.0:1746144897.594709:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398d180 x1830965175340928/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.594718:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398d180 with x1830965175340928 ext(0->4095) 00002000:00010000:2.0:1746144897.594721:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398d180 00000100:00100000:2.0:1746144897.594746:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4205 00000100:00100000:2.0:1746144897.594753:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175340928:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144897.594926:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175340928:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 173us (338us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.594933:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4205 00002000:00100000:2.0:1746144897.594938:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398d180 x1830965175340928/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.594944:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398d180 with x1830965175340928 ext(0->4095) 00002000:00010000:2.0:1746144897.594946:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398d180 00000100:00100000:0.0:1746144897.597178:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.597216:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.597355:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175341056 00000100:00100000:1.0:1746144897.597361:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175341056 00000100:00100000:1.0:1746144897.597390:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175341184 00000100:00100000:1.0:1746144897.597392:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175341184 00000100:00100000:1.0:1746144897.597416:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5830 00000100:00100000:1.0:1746144897.597425:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31565:x1830965175341056:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.597438:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.597450:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95335 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.597478:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275158ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9532e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.597484:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.597485:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.597488:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95335 expref: 93 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.597511:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275158ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9532e expref: 5 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.597521:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275158ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9532e expref: 5 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.597530:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172530816:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144897.597583:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.597626:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5831 00000100:00100000:0.0:1746144897.597632:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31579:x1830965175341184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:0.0:1746144897.597639:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144897.597645:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af67275158d8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9533c expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.597654:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144897.597657:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95335 expref: 94 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.597661:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144897.597663:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af67275158d8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9533c expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.597684:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95335 expref: 94 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.597692:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af67275158d8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9533c expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.597700:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b2c00, rc 0) 00000100:00100000:0.0:1746144897.597714:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+94:31579:x1830965175341184:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 83us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144897.597719:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5831 00000100:00100000:1.0:1746144897.600852:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172530816:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144897.600877:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95335 expref: 93 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.600890:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d600, rc 0) 00000100:00100000:0.0:1746144897.601045:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.601200:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175341312 00000100:00100000:3.0:1746144897.601207:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175341312 00010000:00010000:3.0:1746144897.601229:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275158ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9532e expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.601250:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11246 00000100:00100000:3.0:1746144897.601257:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175341312:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.601268:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.601285:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275158ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9532e expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.601294:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275158ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9532e expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.601311:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af67275158ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9532e expref: 6 pid: 8430 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.601324:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.601326:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.601331:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95335 expref: 93 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.601337:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95335 expref: 93 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.601360:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95335 expref: 93 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.601369:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95335 expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.601378:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172531072:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144897.601726:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31565:x1830965175341056:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4299us (4551us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.601733:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5830 00000100:00100000:3.0:1746144897.602142:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.604470:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.604495:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172531072:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.604510:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.604544:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175341312:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3287us (3500us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.604553:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11246 00000100:00100000:2.0:1746144897.604557:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175341568 00000100:00100000:2.0:1746144897.604562:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175341568 00002000:00100000:2.0:1746144897.604596:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ed80 x1830965175341568/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.604604:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ed80 with x1830965175341568 ext(0->4095) 00010000:00010000:2.0:1746144897.604611:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95335 expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.604622:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95335 expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.604632:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398ed80 00000100:00100000:1.0:1746144897.604967:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2254 00000100:00100000:1.0:1746144897.605126:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175341568:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144897.605272:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175341568:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 147us (807us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.605852:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2254 00002000:00100000:1.0:1746144897.605859:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398ed80 x1830965175341568/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.605871:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398ed80 with x1830965175341568 ext(0->4095) 00010000:00010000:1.0:1746144897.605876:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95335 expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.605886:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95335 expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.605891:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009398ed80 00000100:00100000:2.0:1746144897.608194:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.610431:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175341696 00000100:00100000:3.0:1746144897.610441:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175341696 00010000:00010000:3.0:1746144897.610471:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95335 expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.610520:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11247 00000100:00100000:3.0:1746144897.610526:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1982:x1830965175341696:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.610539:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.610557:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95335 expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.610568:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95335 expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.610588:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af67275158d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95335 expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.610619:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.610621:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.610627:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af67275158d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9533c expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.610634:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af67275158d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9533c expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.610663:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af67275158d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9533c expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144897.610674:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172531200:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.610753:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746144897.612098:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746144897.614485:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172531200:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.614500:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.614552:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1982:x1830965175341696:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4024us (6362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.614564:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11247 00000100:00100000:0.0:1746144897.615054:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.615106:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175341952 00000100:00100000:1.0:1746144897.615112:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175341952 00002000:00100000:1.0:1746144897.615145:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398d880 x1830965175341952/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.615154:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398d880 with x1830965175341952 ext(0->4095) 00002000:00010000:1.0:1746144897.615158:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398d880 00000100:00100000:1.0:1746144897.615182:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4206 00000100:00100000:1.0:1746144897.615188:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965175341952:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144897.615336:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965175341952:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 147us (282us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.615342:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4206 00002000:00100000:1.0:1746144897.615347:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398d880 x1830965175341952/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.615354:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398d880 with x1830965175341952 ext(0->4095) 00002000:00010000:1.0:1746144897.615356:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398d880 00000100:00100000:0.0:1746144897.617891:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.617953:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175342080 00000100:00100000:1.0:1746144897.617960:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175342080 00000100:00100000:1.0:1746144897.617999:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5832 00000100:00100000:1.0:1746144897.618005:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175342080:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.618019:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.618032:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158df lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95343 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.618054:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af67275158d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9533c expref: 91 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.618061:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.618063:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.618065:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158df lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95343 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.618091:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af67275158d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9533c expref: 91 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.618106:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af67275158d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9533c expref: 91 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.618115:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172531328:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144897.618190:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.621605:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.621618:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172531328:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.621669:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175342208 00000100:00100000:3.0:1746144897.621674:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175342208 00010000:00010000:3.0:1746144897.621703:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af67275158d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9533c expref: 92 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.621738:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11248 00000100:00100000:3.0:1746144897.621745:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965175342208:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.621756:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.621802:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af67275158d8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9533c expref: 92 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.621814:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af67275158d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9533c expref: 92 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.621833:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af67275158d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9533c expref: 92 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.621856:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.621858:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.621864:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95343 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.621871:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95343 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.621989:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95343 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144897.622001:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172531456:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.622102:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158df lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95343 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.622114:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966c000, rc 0) 00000100:00100000:1.0:1746144897.622163:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175342080:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4156us (4277us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.622169:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5832 00000100:00100000:3.0:1746144897.622372:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.626056:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172531456:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.626074:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.626122:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1985:x1830965175342208:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4375us (4521us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.626131:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11248 00000100:00100000:0.0:1746144897.627541:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.628249:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.628309:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175342592 00000100:00100000:2.0:1746144897.628316:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175342592 00002000:00100000:2.0:1746144897.628361:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398e300 x1830965175342592/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.628371:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398e300 with x1830965175342592 ext(0->4095) 00002000:00010000:2.0:1746144897.628376:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398e300 00000100:00100000:2.0:1746144897.628408:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4207 00000100:00100000:2.0:1746144897.628415:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175342592:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144897.628555:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175342592:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 140us (306us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.628560:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4207 00002000:00100000:2.0:1746144897.628565:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009398e300 x1830965175342592/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.628572:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398e300 with x1830965175342592 ext(0->4095) 00002000:00010000:2.0:1746144897.628574:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398e300 00000100:00100000:1.0:1746144897.628991:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175342464 00000100:00100000:1.0:1746144897.628996:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175342464 00000100:00100000:1.0:1746144897.629023:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5833 00000100:00100000:1.0:1746144897.629028:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31565:x1830965175342464:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.629036:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.629049:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9534a expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.629071:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158df lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95343 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.629077:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.629079:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.629082:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9534a expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.629104:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95343 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.629113:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95343 expref: 5 pid: 20722 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.629126:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172531584:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144897.629193:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.632562:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.632874:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175342720 00000100:00100000:2.0:1746144897.632881:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175342720 00000100:00100000:2.0:1746144897.632944:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5834 00000100:00100000:2.0:1746144897.632952:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31579:x1830965175342720:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144897.632968:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.632983:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af67275158ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95351 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.633010:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.633015:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9534a expref: 94 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.633022:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144897.633028:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af67275158ed lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95351 expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.633059:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9534a expref: 94 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.633071:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af67275158ed lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95351 expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.633080:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009422a400, rc 0) 00000100:00100000:2.0:1746144897.633128:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+94:31579:x1830965175342720:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 177us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.633134:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5834 00000100:00100000:0.0:1746144897.633314:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.633810:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172531584:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144897.633824:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9534a expref: 93 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.633832:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966da00, rc 0) 00000100:00100000:2.0:1746144897.633859:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31565:x1830965175342464:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4832us (6322us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.633867:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5833 00000100:00100000:3.0:1746144897.634247:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175342848 00000100:00100000:3.0:1746144897.634252:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175342848 00010000:00010000:3.0:1746144897.634270:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95343 expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.634306:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11249 00000100:00100000:3.0:1746144897.634311:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175342848:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.634320:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.634336:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158df lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95343 expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.634346:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158df lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95343 expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.634361:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af67275158df lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95343 expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.634382:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.634384:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.634390:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9534a expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.634396:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9534a expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.634416:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9534a expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.634426:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9534a expref: 92 pid: 20722 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.634435:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172531840:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.634496:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.637947:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172531840:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.637964:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.638004:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175342848:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3693us (4690us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.638012:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11249 00000100:00100000:0.0:1746144897.638879:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.640215:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175343104 00000100:00100000:2.0:1746144897.640224:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175343104 00002000:00100000:2.0:1746144897.640261:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417c380 x1830965175343104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.640270:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417c380 with x1830965175343104 ext(0->4095) 00010000:00010000:2.0:1746144897.640276:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9534a expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.640287:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9534a expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.640294:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417c380 00000100:00100000:2.0:1746144897.640323:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2255 00000100:00100000:2.0:1746144897.640330:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175343104:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144897.640481:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175343104:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 151us (1604us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.640487:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2255 00002000:00100000:2.0:1746144897.640492:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417c380 x1830965175343104/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.640498:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417c380 with x1830965175343104 ext(0->4095) 00010000:00010000:2.0:1746144897.640503:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9534a expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.640514:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9534a expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.640518:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417c380 00000100:00100000:0.0:1746144897.645943:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.646008:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175343232 00000100:00100000:3.0:1746144897.646016:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175343232 00010000:00010000:3.0:1746144897.646047:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9534a expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.646083:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11250 00000100:00100000:3.0:1746144897.646090:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1984:x1830965175343232:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.646109:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.646127:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9534a expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.646605:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9534a expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.646627:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af67275158e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9534a expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.646656:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.646658:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.646664:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af67275158ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95351 expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.646672:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af67275158ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95351 expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.646701:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af67275158ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95351 expref: 92 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144897.646712:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172531968:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.646817:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.651073:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.651204:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175343488 00000100:00100000:2.0:1746144897.651212:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175343488 00002000:00100000:2.0:1746144897.651251:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417f480 x1830965175343488/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.651262:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417f480 with x1830965175343488 ext(0->4095) 00002000:00010000:2.0:1746144897.651266:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417f480 00000100:00100000:2.0:1746144897.651692:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4208 00000100:00100000:2.0:1746144897.651701:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175343488:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144897.651958:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172531968:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.651975:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.652736:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175343488:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 1035us (1667us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.652743:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4208 00002000:00100000:2.0:1746144897.652751:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417f480 x1830965175343488/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.652758:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417f480 with x1830965175343488 ext(0->4095) 00002000:00010000:2.0:1746144897.652785:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417f480 00000100:00100000:3.0:1746144897.652855:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175343232:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6765us (6920us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.652866:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11250 00000100:00100000:0.0:1746144897.654920:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.654993:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175343616 00000100:00100000:2.0:1746144897.654998:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175343616 00000100:00100000:2.0:1746144897.655027:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5835 00000100:00100000:2.0:1746144897.655032:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175343616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144897.655045:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.655056:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af67275158f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95358 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.655075:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af67275158ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95351 expref: 91 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.655079:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144897.655080:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144897.655082:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af67275158f4 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95358 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.655101:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af67275158ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95351 expref: 91 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.655108:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af67275158ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95351 expref: 91 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.655115:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172532096:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144897.655550:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.657491:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.657615:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175343744 00000100:00100000:3.0:1746144897.657622:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175343744 00010000:00010000:3.0:1746144897.657652:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af67275158ed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95351 expref: 92 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.657664:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172532096:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.657675:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11251 00000100:00100000:3.0:1746144897.657681:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175343744:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.657690:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af67275158f4 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95358 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.657692:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.657703:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009422a000, rc 0) 00010000:00010000:3.0:1746144897.657709:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af67275158ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95351 expref: 92 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.657719:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af67275158ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95351 expref: 92 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.657735:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175343616:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2701us (2832us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144897.657737:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009422a400/0x4076af67275158ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95351 expref: 92 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.657744:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5835 00010000:00010000:3.0:1746144897.657778:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.657780:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.657787:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af67275158f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95358 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.657794:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af67275158f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95358 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.657817:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af67275158f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95358 expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144897.657827:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172532224:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.657870:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144897.660212:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172532224:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.660229:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.660722:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+91:1984:x1830965175343744:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3039us (3234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.660732:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11251 00000100:00100000:1.0:1746144897.663859:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.663917:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175344000 00000100:00100000:2.0:1746144897.663926:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175344000 00000100:00100000:1.0:1746144897.663975:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.664046:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175344128 00000100:00100000:3.0:1746144897.664050:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175344128 00002000:00100000:2.0:1746144897.664076:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5d180 x1830965175344000/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.664086:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5d180 with x1830965175344000 ext(0->4095) 00000100:00100000:3.0:1746144897.664087:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5836 00002000:00010000:2.0:1746144897.664091:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5d180 00000100:00100000:3.0:1746144897.664095:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+91:31565:x1830965175344128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:2.0:1746144897.664106:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4209 00010000:00010000:3.0:1746144897.664107:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144897.664113:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175344000:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00010000:00010000:3.0:1746144897.664121:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9535f expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.664140:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af67275158f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95358 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.664147:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.664148:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.664151:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9535f expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.664175:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af67275158f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95358 expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.664189:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af67275158f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95358 expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.664199:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172532352:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144897.664259:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175344000:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 146us (406us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.664265:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4209 00000100:00100000:3.0:1746144897.664268:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd420c0 going to sleep for 11 seconds 00002000:00100000:2.0:1746144897.664270:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5d180 x1830965175344000/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.664276:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5d180 with x1830965175344000 ext(0->4095) 00010000:00010000:2.0:1746144897.664281:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af67275158f4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95358 expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.664291:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af67275158f4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95358 expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.664413:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5d180 00000100:00100000:3.0:1746144897.666498:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172532352:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144897.666520:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9535f expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.666533:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:3.0:1746144897.666575:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31565:x1830965175344128:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2480us (2598us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.666581:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5836 00000100:00100000:0.0:1746144897.666834:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.666891:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175344256 00000100:00100000:3.0:1746144897.666895:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175344256 00000100:00100000:3.0:1746144897.666930:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5837 00000100:00100000:3.0:1746144897.667884:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31579:x1830965175344256:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.667914:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.667927:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515902 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95366 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.667946:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.667951:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9535f expref: 93 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.667961:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.667965:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515902 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95366 expref: 93 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.667965:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:3.0:1746144897.667990:0:20722:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9535f expref: 93 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.667999:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515902 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95366 expref: 93 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.668008:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:0.0:1746144897.668029:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175344384 00000100:00100000:0.0:1746144897.668033:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175344384 00000100:00100000:3.0:1746144897.668048:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31579:x1830965175344256:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1111us (1214us total) trans 0 rc 0/0 00010000:00010000:0.0:1746144897.668048:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af67275158f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95358 expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.668053:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5837 00000100:00100000:0.0:1746144897.668069:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11252 00000100:00100000:0.0:1746144897.668074:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175344384:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144897.668081:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144897.668097:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af67275158f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95358 expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:0.0:1746144897.668106:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af67275158f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95358 expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:0.0:1746144897.668120:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af67275158f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95358 expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:0.0:1746144897.668320:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144897.668322:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144897.668328:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9535f expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.668335:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9535f expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.668353:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9535f expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.668363:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9535f expref: 92 pid: 20722 timeout: 591 lvb_type: 0 00000100:00100000:0.0:1746144897.668372:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a417d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172532608:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144897.668436:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.669582:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a417d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172532608:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.669597:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.669629:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4fd7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175344384:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1554us (1664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.669636:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11252 00000100:00100000:1.0:1746144897.670287:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.670416:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175344640 00000100:00100000:3.0:1746144897.670420:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175344640 00002000:00100000:3.0:1746144897.670448:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ea00 x1830965175344640/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.670455:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ea00 with x1830965175344640 ext(0->4095) 00010000:00010000:3.0:1746144897.670461:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9535f expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.670471:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9535f expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.670477:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5ea00 00000100:00100000:3.0:1746144897.670489:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2256 00000100:00100000:3.0:1746144897.670494:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175344640:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144897.670619:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175344640:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 124us (332us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.670624:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2256 00002000:00100000:3.0:1746144897.670628:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009ad5ea00 x1830965175344640/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.670634:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ea00 with x1830965175344640 ext(0->4095) 00010000:00010000:3.0:1746144897.670638:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9535f expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.670645:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9535f expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.670650:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009ad5ea00 00000100:00100000:0.0:1746144897.672609:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.672675:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175344768 00000100:00100000:2.0:1746144897.672683:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175344768 00010000:00010000:2.0:1746144897.672710:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9535f expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.672738:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11253 00000100:00100000:2.0:1746144897.672744:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1982:x1830965175344768:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.672754:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.672786:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9535f expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.672795:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9535f expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.672814:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af67275158fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9535f expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.672837:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.672839:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.672845:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515902 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95366 expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.672851:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95366 expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.672877:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95366 expref: 92 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.672887:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172532736:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.672969:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.674746:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172532736:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.674792:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.674826:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1982:x1830965175344768:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2077us (2216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.674834:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11253 00000100:00100000:0.0:1746144897.677279:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.677362:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175345024 00000100:00100000:1.0:1746144897.677383:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175345024 00002000:00100000:1.0:1746144897.677452:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417e680 x1830965175345024/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.677460:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417e680 with x1830965175345024 ext(0->4095) 00002000:00010000:1.0:1746144897.677465:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417e680 00000100:00100000:1.0:1746144897.677494:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4210 00000100:00100000:1.0:1746144897.677501:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965175345024:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144897.677670:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965175345024:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 169us (397us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.677677:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4210 00002000:00100000:1.0:1746144897.677682:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417e680 x1830965175345024/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.677688:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417e680 with x1830965175345024 ext(0->4095) 00002000:00010000:1.0:1746144897.677690:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417e680 00000100:00100000:0.0:1746144897.682659:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.682719:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175345152 00000100:00100000:3.0:1746144897.682726:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175345152 00000100:00100000:3.0:1746144897.682792:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5838 00000100:00100000:3.0:1746144897.682799:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175345152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.682817:0:20722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.682863:0:20722:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9536d expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.682887:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515902 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95366 expref: 91 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.682899:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.682900:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.682912:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9536d expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.682938:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95366 expref: 91 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.682948:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515902 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95366 expref: 91 pid: 20722 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.682958:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172532864:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.683087:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.686933:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.687068:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.687157:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175345280 00000100:00100000:1.0:1746144897.687163:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175345280 00000100:00100000:3.0:1746144897.687175:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:20722:1830965172532864:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144897.687198:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5839 00010000:00010000:3.0:1746144897.687202:0:20722:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9536d expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144897.687205:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+92:31565:x1830965175345280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.687218:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.687219:0:20722:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00010000:00010000:1.0:1746144897.687230:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95374 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.687247:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.687251:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9536d expref: 6 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.687256:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00000100:00100000:3.0:1746144897.687259:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175345152:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4460us (4607us total) trans 0 rc 0/0 00010000:00010000:1.0:1746144897.687260:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95374 expref: 93 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144897.687265:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5838 00010000:00010000:1.0:1746144897.687283:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9536d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.687293:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95374 expref: 93 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.687300:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d200, rc 0) 00000100:00100000:1.0:1746144897.687317:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31565:x1830965175345280:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 113us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.687322:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5839 00000100:00100000:2.0:1746144897.687562:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175345408 00000100:00100000:2.0:1746144897.687565:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175345408 00010000:00010000:2.0:1746144897.687584:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515902 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95366 expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.687612:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11254 00000100:00100000:2.0:1746144897.687618:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175345408:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.687626:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.687643:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515902 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95366 expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.687652:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95366 expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.687667:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515902 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95366 expref: 93 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.687679:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.687680:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.687685:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9536d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.687692:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9536d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.687708:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9536d expref: 5 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.687717:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9536d expref: 5 pid: 20722 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.687726:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172533120:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.687790:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.690870:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172533120:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.690894:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.691023:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965175345408:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3405us (3954us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.691032:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11254 00000100:00100000:0.0:1746144897.692861:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.693269:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175345664 00000100:00100000:3.0:1746144897.693277:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175345664 00002000:00100000:3.0:1746144897.693314:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417d180 x1830965175345664/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.693328:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417d180 with x1830965175345664 ext(0->4095) 00010000:00010000:3.0:1746144897.693335:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9536d expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.693347:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9536d expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.693353:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417d180 00000100:00100000:3.0:1746144897.694171:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2257 00000100:00100000:3.0:1746144897.694181:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175345664:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144897.694341:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175345664:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 161us (1483us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.694347:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2257 00002000:00100000:3.0:1746144897.694353:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417d180 x1830965175345664/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.694360:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417d180 with x1830965175345664 ext(0->4095) 00010000:00010000:3.0:1746144897.694365:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9536d expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.694373:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9536d expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.694378:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a417d180 00000100:00100000:0.0:1746144897.698476:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.698542:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175345792 00000100:00100000:2.0:1746144897.698550:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175345792 00010000:00010000:2.0:1746144897.698583:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9536d expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.698623:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11255 00000100:00100000:2.0:1746144897.698630:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175345792:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.698640:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.698657:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9536d expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.698667:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9536d expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.698684:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af6727515909 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9536d expref: 6 pid: 20722 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.698707:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.698709:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.698714:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95374 expref: 91 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.698722:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95374 expref: 91 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.698749:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95374 expref: 91 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.698759:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172533248:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.698842:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.705129:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172533248:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.705155:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.705196:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175345792:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6567us (6727us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.705206:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11255 00000100:00100000:0.0:1746144897.706687:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.706854:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175346048 00000100:00100000:1.0:1746144897.706862:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175346048 00002000:00100000:1.0:1746144897.706894:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417d880 x1830965175346048/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.706918:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417d880 with x1830965175346048 ext(0->4095) 00002000:00010000:1.0:1746144897.706922:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417d880 00000100:00100000:1.0:1746144897.707020:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4211 00000100:00100000:1.0:1746144897.707028:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175346048:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144897.707839:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1984:x1830965175346048:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 810us (1155us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.707846:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4211 00002000:00100000:1.0:1746144897.707852:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff8800a417d880 x1830965175346048/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.707859:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417d880 with x1830965175346048 ext(0->4095) 00002000:00010000:1.0:1746144897.707862:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a417d880 00000100:00100000:0.0:1746144897.716966:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.717033:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175346176 00000100:00100000:1.0:1746144897.717041:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175346176 00000100:00100000:1.0:1746144897.717091:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5840 00000100:00100000:1.0:1746144897.717098:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175346176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.717114:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.717132:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515917 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9537b expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.717158:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95374 expref: 91 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.717165:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.717167:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.717170:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515917 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9537b expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.717196:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95374 expref: 91 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.717207:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95374 expref: 91 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.717217:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172533376:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144897.717423:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.722449:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.722578:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175346304 00000100:00100000:2.0:1746144897.722588:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175346304 00002000:00100000:2.0:1746144897.722629:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880092587800 x1830965175346304/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 496/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.722638:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092587800 with x1830965175346304 ext(0->7) 00010000:00010000:2.0:1746144897.722646:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95374 expref: 92 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.722657:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95374 expref: 92 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.722663:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092587800 00000100:00100000:2.0:1746144897.722695:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2258 00000100:00100000:2.0:1746144897.722702:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+92:1985:x1830965175346304:12345-192.168.202.16@tcp:4:ldlm_bl.0 00000100:00100000:1.0:1746144897.722747:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172533376:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144897.722797:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515917 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9537b expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.722809:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d600, rc 0) 00000100:00100000:1.0:1746144897.722845:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092587100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175346176:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 5748us (5886us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.722852:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5840 00000100:00100000:2.0:1746144897.723333:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092587800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1985:x1830965175346304:12345-192.168.202.16@tcp:4:ldlm_bl.0 Request processed in 630us (889us total) trans 4294968053 rc 0/0 00000100:00100000:2.0:1746144897.723339:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2258 00002000:00100000:2.0:1746144897.723344:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->7) req@ffff880092587800 x1830965175346304/t4294968053(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 496/448 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 0/0 job:'ldlm_bl.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.723351:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092587800 with x1830965175346304 ext(0->7) 00010000:00010000:2.0:1746144897.723356:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95374 expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.723365:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95374 expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.723370:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092587800 00000100:00100000:0.0:1746144897.727868:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.728050:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175346432 00000100:00100000:2.0:1746144897.728057:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175346432 00010000:00010000:2.0:1746144897.728154:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95374 expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.729782:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11256 00000100:00100000:1.0:1746144897.729797:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092584a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1982:x1830965175346432:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144897.729812:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746144897.729829:0:7098:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb mtime from disk: 1746144897 -> 1746144898 00002000:00010000:1.0:1746144897.729834:0:7098:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x18:0x0] updating lvb ctime from disk: 1746144897 -> 1746144898 00010000:00010000:1.0:1746144897.729841:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95374 expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.729857:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95374 expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.729877:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af6727515910 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95374 expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.729914:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.729916:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.729925:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515917 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9537b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.729931:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515917 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9537b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.729958:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515917 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9537b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144897.729972:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172533504:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144897.730052:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.733342:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.733436:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172533504:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.733454:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.733498:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092584a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1982:x1830965175346432:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3704us (5636us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.733507:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11256 00000100:00100000:2.0:1746144897.733511:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175346688 00000100:00100000:2.0:1746144897.733516:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175346688 00002000:00100000:2.0:1746144897.733550:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092584380 x1830965175346688/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.733558:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092584380 with x1830965175346688 ext(0->4095) 00002000:00010000:2.0:1746144897.733561:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092584380 00000100:00100000:2.0:1746144897.733585:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4212 00000100:00100000:2.0:1746144897.733591:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175346688:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:2.0:1746144897.733719:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092584380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175346688:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 128us (385us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.733725:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4212 00002000:00100000:2.0:1746144897.733730:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092584380 x1830965175346688/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.733736:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092584380 with x1830965175346688 ext(0->4095) 00002000:00010000:2.0:1746144897.733740:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092584380 00000100:00100000:0.0:1746144897.737059:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.737347:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175346816 00000100:00100000:1.0:1746144897.737354:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175346816 00000100:00100000:1.0:1746144897.737505:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5841 00000100:00100000:1.0:1746144897.737512:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+93:31579:x1830965175346816:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.737528:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.737541:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95382 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.737565:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515917 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9537b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.737572:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.737574:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.737577:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95382 expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.737600:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515917 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9537b expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.737610:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515917 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9537b expref: 5 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.737620:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172533632:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144897.738747:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.741320:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172533632:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144897.741345:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95382 expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.741365:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966da00, rc 0) 00000100:00100000:1.0:1746144897.741414:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+94:31579:x1830965175346816:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3901us (4360us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.741421:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5841 00000100:00100000:0.0:1746144897.746515:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.746572:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175346944 00000100:00100000:1.0:1746144897.746580:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175346944 00000100:00100000:1.0:1746144897.746633:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5842 00000100:00100000:1.0:1746144897.746641:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+94:31565:x1830965175346944:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.746656:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.746670:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95389 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.746693:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.746697:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95382 expref: 95 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.746703:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.746705:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95389 expref: 95 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.746734:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95382 expref: 95 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.746744:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95389 expref: 95 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.746756:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966c000, rc 0) 00000100:00100000:1.0:1746144897.746829:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092586d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+95:31565:x1830965175346944:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 188us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.746838:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5842 00000100:00100000:0.0:1746144897.749344:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.750139:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175347072 00000100:00100000:1.0:1746144897.750148:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175347072 00010000:00010000:1.0:1746144897.750190:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515917 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9537b expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.750233:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11257 00000100:00100000:1.0:1746144897.750240:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092586300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175347072:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144897.750251:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144897.750270:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515917 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9537b expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.750280:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515917 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9537b expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.750297:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515917 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9537b expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.750324:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.750326:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.750332:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95382 expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.750343:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95382 expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.750371:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95382 expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.750380:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95382 expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.750391:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172533888:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144897.750453:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.755494:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172533888:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144897.755514:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.755554:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092586300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175347072:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5314us (6215us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.755564:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11257 00000100:00100000:0.0:1746144897.755625:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.755782:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175347328 00000100:00100000:3.0:1746144897.755789:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175347328 00002000:00100000:3.0:1746144897.755823:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092584e00 x1830965175347328/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.755831:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092584e00 with x1830965175347328 ext(0->4095) 00010000:00010000:3.0:1746144897.755838:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95382 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.755850:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95382 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.755856:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092584e00 00000100:00100000:3.0:1746144897.755870:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2259 00000100:00100000:3.0:1746144897.755875:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1984:x1830965175347328:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.757093:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092584e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1984:x1830965175347328:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 1213us (1464us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.757104:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2259 00002000:00100000:3.0:1746144897.757110:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880092584e00 x1830965175347328/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.757118:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092584e00 with x1830965175347328 ext(0->4095) 00010000:00010000:3.0:1746144897.757124:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95382 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.757135:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95382 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.757140:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092584e00 00000100:00100000:0.0:1746144897.759130:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.759222:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175347456 00000100:00100000:3.0:1746144897.759228:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175347456 00000100:00100000:0.0:1746144897.759266:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.759296:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5843 00000100:00100000:3.0:1746144897.759302:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175347456:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00000100:00100000:0.0:1746144897.759309:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175347584 00000100:00100000:0.0:1746144897.759312:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175347584 00010000:00010000:3.0:1746144897.759316:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144897.759326:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95382 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.759327:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95390 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.759345:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.759349:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95389 expref: 95 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.759354:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00000100:00100000:0.0:1746144897.759354:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11258 00010000:00010000:3.0:1746144897.759357:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95390 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144897.759358:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1982:x1830965175347584:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144897.759365:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144897.759381:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95382 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.759386:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95389 expref: 95 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.759389:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95382 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:0.0:1746144897.759402:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af672751591e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95382 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:0.0:1746144897.759835:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.759837:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95390 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.759837:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144897.759842:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95389 expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.759849:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95389 expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.759864:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753400, rc 0) 00010000:00010000:0.0:1746144897.759872:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95389 expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144897.759880:0:7098:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95389 expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:0.0:1746144897.759889:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012a2b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172534144:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.759914:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175347456:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 611us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.759919:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5843 00000100:00100000:0.0:1746144897.759948:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.761985:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.762155:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012a2b3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172534144:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.762171:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.762202:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1982:x1830965175347584:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2843us (2935us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.762210:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11258 00000100:00100000:3.0:1746144897.762285:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175347840 00000100:00100000:3.0:1746144897.762290:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175347840 00002000:00100000:3.0:1746144897.762449:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b0700 x1830965175347840/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.762457:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b0700 with x1830965175347840 ext(0->4095) 00010000:00010000:3.0:1746144897.762463:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95389 expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.762474:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95389 expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.762479:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012a2b0700 00000100:00100000:3.0:1746144897.762622:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2260 00000100:00100000:3.0:1746144897.762629:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1984:x1830965175347840:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.762792:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1984:x1830965175347840:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 162us (810us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.762797:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2260 00002000:00100000:3.0:1746144897.762802:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b0700 x1830965175347840/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.762807:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b0700 with x1830965175347840 ext(0->4095) 00010000:00010000:3.0:1746144897.762811:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95389 expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.762820:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95389 expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.762824:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012a2b0700 00000100:00100000:0.0:1746144897.765167:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.765309:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175348096 00000100:00100000:3.0:1746144897.765315:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175348096 00000100:00100000:3.0:1746144897.765357:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5844 00000100:00100000:3.0:1746144897.765363:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+94:31565:x1830965175348096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.765375:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.765388:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515933 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95397 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.765408:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.765413:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95390 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.765418:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144897.765421:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515933 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95397 expref: 95 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.765459:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95390 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.765469:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515933 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95397 expref: 95 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.765478:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752000, rc 0) 00000100:00100000:3.0:1746144897.765507:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+95:31565:x1830965175348096:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 145us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.765513:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5844 00000100:00100000:0.0:1746144897.765919:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.766701:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175347968 00000100:00100000:3.0:1746144897.766705:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175347968 00010000:00010000:3.0:1746144897.766723:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95389 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.766981:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11259 00000100:00100000:2.0:1746144897.766990:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1984:x1830965175347968:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.767000:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.767017:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95389 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.767026:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95389 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.767042:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966c000/0x4076af6727515925 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95389 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.767335:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.767337:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.767343:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95390 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.767351:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95390 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.767375:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95390 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.767385:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95390 expref: 5 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.767395:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172534400:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.767462:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.769937:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172534400:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.769957:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144897.769971:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.770220:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1984:x1830965175347968:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3230us (4299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.770229:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11259 00000100:00100000:1.0:1746144897.770236:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175348352 00000100:00100000:1.0:1746144897.770241:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175348352 00002000:00100000:1.0:1746144897.770271:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b1500 x1830965175348352/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.770279:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b1500 with x1830965175348352 ext(0->4095) 00010000:00010000:1.0:1746144897.770285:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95390 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.770299:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95390 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.770305:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012a2b1500 00000100:00100000:1.0:1746144897.770334:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2261 00000100:00100000:1.0:1746144897.770340:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175348352:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144897.770478:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175348352:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 138us (508us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.770484:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2261 00002000:00100000:1.0:1746144897.770489:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b1500 x1830965175348352/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.770496:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b1500 with x1830965175348352 ext(0->4095) 00010000:00010000:1.0:1746144897.770500:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95390 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.770508:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95390 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.770513:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012a2b1500 00000100:00100000:0.0:1746144897.774978:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.775095:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175348480 00000100:00100000:2.0:1746144897.775103:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175348480 00010000:00010000:2.0:1746144897.775133:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95390 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.775164:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11260 00000100:00100000:2.0:1746144897.775171:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1983:x1830965175348480:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.775181:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.775197:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95390 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.775208:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95390 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.775225:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753400/0x4076af672751592c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95390 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.775248:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.775250:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.775256:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95397 expref: 93 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.775263:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95397 expref: 93 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.775289:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95397 expref: 93 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.775299:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172534528:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.775369:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.778499:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172534528:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.778523:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.778556:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1983:x1830965175348480:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3385us (3583us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.778564:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11260 00000100:00100000:0.0:1746144897.779300:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.779592:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175348736 00000100:00100000:3.0:1746144897.779598:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175348736 00002000:00100000:3.0:1746144897.779627:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b0e00 x1830965175348736/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.779635:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b0e00 with x1830965175348736 ext(0->4095) 00002000:00010000:3.0:1746144897.779638:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012a2b0e00 00000100:00100000:3.0:1746144897.779698:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4213 00000100:00100000:3.0:1746144897.779704:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1984:x1830965175348736:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:3.0:1746144897.780468:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1984:x1830965175348736:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 762us (1166us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.780474:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4213 00002000:00100000:3.0:1746144897.780480:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88012a2b0e00 x1830965175348736/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.780486:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012a2b0e00 with x1830965175348736 ext(0->4095) 00002000:00010000:3.0:1746144897.780489:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012a2b0e00 00000100:00100000:0.0:1746144897.782923:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.783085:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175348864 00000100:00100000:1.0:1746144897.783092:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175348864 00000100:00100000:1.0:1746144897.783258:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5845 00000100:00100000:1.0:1746144897.783265:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175348864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.783278:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.783291:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9539e expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.783312:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515933 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95397 expref: 93 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.783318:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.783319:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.783322:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9539e expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.783343:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95397 expref: 93 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.783351:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95397 expref: 93 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.783361:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172534656:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144897.783431:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5240 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.785736:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.785828:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172534656:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144897.785851:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9539e expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.785865:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966dc00, rc 0) 00000100:00100000:1.0:1746144897.785894:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175348864:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 2630us (2977us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.785911:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5845 00000100:00100000:2.0:1746144897.786055:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175348992 00000100:00100000:2.0:1746144897.786061:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175348992 00010000:00010000:2.0:1746144897.786085:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95397 expref: 94 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.786281:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11261 00000100:00100000:2.0:1746144897.786289:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1984:x1830965175348992:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.786305:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.786321:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515933 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95397 expref: 94 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.786331:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515933 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95397 expref: 94 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.786347:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752000/0x4076af6727515933 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95397 expref: 94 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.786359:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.786361:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.786365:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9539e expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.786371:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9539e expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.786393:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9539e expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.786401:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172534784:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.786455:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.788531:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.788612:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175349120 00000100:00100000:1.0:1746144897.788619:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175349120 00000100:00100000:1.0:1746144897.789802:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5846 00000100:00100000:1.0:1746144897.789812:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+94:31565:x1830965175349120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.789828:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.789841:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af953a5 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.789862:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9539e expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.789868:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.789870:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.789873:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953a5 expref: 95 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.789895:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9539e expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.789918:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9539e expref: 5 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.789929:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172534912:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144897.789956:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172534784:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.789975:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144897.789984:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.789994:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1984:x1830965175348992:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3706us (4264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.790003:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11261 00000100:00100000:0.0:1746144897.790717:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.791666:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175349376 00000100:00100000:3.0:1746144897.791672:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175349376 00002000:00100000:3.0:1746144897.791701:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336bb80 x1830965175349376/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.791708:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336bb80 with x1830965175349376 ext(0->4095) 00010000:00010000:3.0:1746144897.791714:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9539e expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.791730:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9539e expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.791736:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009336bb80 00000100:00100000:3.0:1746144897.791779:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2262 00000100:00100000:3.0:1746144897.791785:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175349376:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:3.0:1746144897.791927:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175349376:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 142us (1211us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144897.791933:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2262 00002000:00100000:3.0:1746144897.791938:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336bb80 x1830965175349376/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:3.0:1746144897.791944:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336bb80 with x1830965175349376 ext(0->4095) 00010000:00010000:3.0:1746144897.791949:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9539e expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.791958:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9539e expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:3.0:1746144897.791963:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009336bb80 00000100:00100000:1.0:1746144897.793671:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172534912:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144897.793690:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953a5 expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.793707:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966da00, rc 0) 00000100:00100000:1.0:1746144897.793743:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+94:31565:x1830965175349120:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 3933us (5218us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.793750:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5846 00000100:00100000:0.0:1746144897.795651:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.796011:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175349504 00000100:00100000:1.0:1746144897.796017:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175349504 00000100:00100000:1.0:1746144897.796056:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5847 00000100:00100000:1.0:1746144897.796063:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+94:31579:x1830965175349504:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.796076:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.796089:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515948 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af953ac expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.796109:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.796114:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953a5 expref: 95 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.796119:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.796122:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515948 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ac expref: 95 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.796149:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953a5 expref: 95 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.796159:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515948 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ac expref: 95 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.796171:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d600, rc 0) 00000100:00100000:1.0:1746144897.796210:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+95:31579:x1830965175349504:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 148us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.796217:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5847 00000100:00100000:0.0:1746144897.797404:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.797463:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175349632 00000100:00100000:2.0:1746144897.797468:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175349632 00010000:00010000:2.0:1746144897.797492:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9539e expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.797520:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11262 00000100:00100000:2.0:1746144897.797526:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175349632:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.797535:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.797551:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9539e expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.797561:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9539e expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.797576:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966dc00/0x4076af672751593a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9539e expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.797599:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.797601:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.797605:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953a5 expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.797612:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953a5 expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.797633:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953a5 expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.797643:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953a5 expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.797652:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172535168:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.797717:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.800031:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172535168:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.800052:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.800091:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175349632:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2564us (2688us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.800100:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11262 00000100:00100000:0.0:1746144897.800513:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.800591:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175349888 00000100:00100000:1.0:1746144897.800596:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175349888 00002000:00100000:1.0:1746144897.800627:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336b100 x1830965175349888/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.800634:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336b100 with x1830965175349888 ext(0->4095) 00010000:00010000:1.0:1746144897.800641:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953a5 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.800650:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953a5 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.800655:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009336b100 00000100:00100000:1.0:1746144897.800847:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2263 00000100:00100000:1.0:1746144897.800854:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1984:x1830965175349888:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144897.801621:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1984:x1830965175349888:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 766us (1107us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.801627:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2263 00002000:00100000:1.0:1746144897.801632:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336b100 x1830965175349888/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.801644:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336b100 with x1830965175349888 ext(0->4095) 00010000:00010000:1.0:1746144897.801649:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953a5 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.801659:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953a5 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.801664:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009336b100 00000100:00100000:0.0:1746144897.804408:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.804453:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175350016 00000100:00100000:2.0:1746144897.804460:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175350016 00010000:00010000:2.0:1746144897.804494:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953a5 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.804606:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11263 00000100:00100000:2.0:1746144897.804614:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093369880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1985:x1830965175350016:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.804624:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.804640:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953a5 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.804651:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953a5 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.804668:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966da00/0x4076af6727515941 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953a5 expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.804695:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.804697:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.804703:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515948 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ac expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.804710:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ac expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.804736:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ac expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.804746:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172535296:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.805743:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.808007:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172535296:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.808028:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.808059:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093369880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1985:x1830965175350016:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3446us (3658us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.808067:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11263 00000100:00100000:0.0:1746144897.808883:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.809105:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175350272 00000100:00100000:1.0:1746144897.809111:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175350272 00002000:00100000:1.0:1746144897.809142:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368380 x1830965175350272/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.809151:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368380 with x1830965175350272 ext(0->4095) 00002000:00010000:1.0:1746144897.809155:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093368380 00000100:00100000:1.0:1746144897.809181:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4214 00000100:00100000:1.0:1746144897.809187:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1984:x1830965175350272:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 00000100:00100000:1.0:1746144897.809323:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1984:x1830965175350272:12345-192.168.202.16@tcp:3:ptlrpcd_01_00.0 Request processed in 136us (442us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.809329:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4214 00002000:00100000:1.0:1746144897.809334:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368380 x1830965175350272/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_00.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.809341:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368380 with x1830965175350272 ext(0->4095) 00002000:00010000:1.0:1746144897.809343:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093368380 00000100:00100000:0.0:1746144897.811256:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.811424:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175350400 00000100:00100000:1.0:1746144897.811430:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175350400 00000100:00100000:1.0:1746144897.811472:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5848 00000100:00100000:1.0:1746144897.811478:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175350400:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.811492:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.811504:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af672751594f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af953b3 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.811525:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515948 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ac expref: 93 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.811531:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.811532:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.811535:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af672751594f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953b3 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.811556:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ac expref: 93 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.811565:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515948 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ac expref: 93 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.811574:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172535424:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144897.811638:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a84c5780 going to sleep for 11 seconds 00000100:00100000:1.0:1746144897.812799:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172535424:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144897.812817:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af672751594f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953b3 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.812831:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d800, rc 0) 00000100:00100000:1.0:1746144897.812852:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175350400:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 1375us (1601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.812858:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5848 00000100:00100000:0.0:1746144897.814100:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.814185:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175350528 00000100:00100000:2.0:1746144897.814190:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175350528 00010000:00010000:2.0:1746144897.814217:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515948 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ac expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.814245:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11264 00000100:00100000:2.0:1746144897.814251:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1984:x1830965175350528:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.814263:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.814279:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515948 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ac expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.814287:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515948 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ac expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.814303:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d600/0x4076af6727515948 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ac expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.814326:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.814328:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.814333:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af672751594f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953b3 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.814341:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af672751594f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953b3 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.814362:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af672751594f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953b3 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144897.814372:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172535552:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.814420:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.816014:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172535552:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.816031:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.816067:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1984:x1830965175350528:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1815us (1969us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.816078:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11264 00000100:00100000:0.0:1746144897.817168:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.817244:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175350784 00000100:00100000:1.0:1746144897.817251:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175350784 00002000:00100000:1.0:1746144897.817280:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093369500 x1830965175350784/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.817288:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369500 with x1830965175350784 ext(0->4095) 00002000:00010000:1.0:1746144897.817292:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093369500 00000100:00100000:1.0:1746144897.817307:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4215 00000100:00100000:1.0:1746144897.817313:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175350784:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144897.817435:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093369500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175350784:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 121us (268us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.817442:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4215 00002000:00100000:1.0:1746144897.817446:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093369500 x1830965175350784/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.817452:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369500 with x1830965175350784 ext(0->4095) 00002000:00010000:1.0:1746144897.817455:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093369500 00000100:00100000:0.0:1746144897.819893:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.819973:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.820212:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175351040 00000100:00100000:1.0:1746144897.820220:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175351040 00000100:00100000:1.0:1746144897.820620:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175350912 00000100:00100000:1.0:1746144897.820623:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175350912 00000100:00100000:3.0:1746144897.820679:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5849 00000100:00100000:3.0:1746144897.820686:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+94:31579:x1830965175351040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.820701:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.820715:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af953c1 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.820737:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af672751594f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953b3 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.820744:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.820745:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.820748:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 95 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.820805:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af672751594f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953b3 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.820815:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af672751594f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953b3 expref: 5 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:1.0:1746144897.821023:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5850 00000100:00100000:1.0:1746144897.821029:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+95:31565:x1830965175350912:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:1.0:1746144897.821036:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144897.821042:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af953ba expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.821051:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144897.821054:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 96 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.821059:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144897.821062:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ba expref: 96 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.821079:0:10401:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 96 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.821089:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ba expref: 96 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144897.821098:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966d200, rc 0) 00000100:00100000:1.0:1746144897.821138:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+96:31565:x1830965175350912:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 108us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.821143:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5850 00000100:00100000:3.0:1746144897.821409:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172535680:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144897.821473:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.824699:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.824778:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175351168 00000100:00100000:2.0:1746144897.824785:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175351168 00010000:00010000:2.0:1746144897.824814:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af672751594f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953b3 expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.824834:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11265 00000100:00100000:2.0:1746144897.824839:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175351168:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.824849:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.824865:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af672751594f lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953b3 expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.824874:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af672751594f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953b3 expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.824894:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.824895:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.824910:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 95 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.824917:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 95 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.824939:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 95 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.824948:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 95 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.824958:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172535936:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.825020:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f540 going to sleep for 11 seconds 00010000:00010000:3.0:1746144897.825187:0:8432:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d800/0x4076af672751594f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953b3 expref: 6 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.825202:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172535680:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144897.825217:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 95 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.825223:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 95 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.825235:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:3.0:1746144897.825253:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+95:31579:x1830965175351040:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 4569us (5366us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.825259:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5849 00000100:00100000:0.0:1746144897.828101:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.828279:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172535936:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.828298:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.828329:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175351168:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3489us (3636us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.828337:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11265 00000100:00100000:1.0:1746144897.828477:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175351424 00000100:00100000:1.0:1746144897.828482:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175351424 00002000:00100000:1.0:1746144897.828509:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368000 x1830965175351424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.828521:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368000 with x1830965175351424 ext(0->4095) 00010000:00010000:1.0:1746144897.828527:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 95 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.828537:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 95 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.828542:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093368000 00000100:00100000:1.0:1746144897.828556:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2264 00000100:00100000:1.0:1746144897.828562:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1985:x1830965175351424:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:1.0:1746144897.828681:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1985:x1830965175351424:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 120us (587us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144897.828687:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2264 00002000:00100000:1.0:1746144897.828692:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368000 x1830965175351424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:1.0:1746144897.828698:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368000 with x1830965175351424 ext(0->4095) 00010000:00010000:1.0:1746144897.828702:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 95 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:1.0:1746144897.828710:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 95 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:1.0:1746144897.828716:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093368000 00000100:00100000:2.0:1746144897.833881:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.833960:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175351552 00000100:00100000:3.0:1746144897.833967:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175351552 00000100:00100000:3.0:1746144897.833997:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5851 00000100:00100000:3.0:1746144897.834002:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:31579:x1830965175351552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:3.0:1746144897.834016:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144897.834028:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af953c8 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.834047:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144897.834051:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ba expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.834056:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746144897.834059:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c8 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.834083:0:8432:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ba expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.834092:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c8 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.834103:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752400, rc 0) 00000100:00100000:3.0:1746144897.834135:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:31579:x1830965175351552:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 133us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.834140:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5851 00000100:00100000:0.0:1746144897.835193:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.835258:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175351680 00000100:00100000:2.0:1746144897.835262:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175351680 00010000:00010000:2.0:1746144897.835282:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 95 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.835299:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11266 00000100:00100000:2.0:1746144897.835304:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1983:x1830965175351680:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144897.835311:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144897.835326:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 95 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.835335:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 95 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.835351:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091753e00/0x4076af6727515956 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c1 expref: 95 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.835550:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.835553:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.835559:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ba expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.835566:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ba expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.835586:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ba expref: 94 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.835594:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ba expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:2.0:1746144897.835604:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172536192:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144897.836458:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b10f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.839529:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172536192:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144897.839552:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144897.839593:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1983:x1830965175351680:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4287us (4402us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.839602:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11266 00000100:00100000:0.0:1746144897.840646:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.841123:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175351936 00000100:00100000:2.0:1746144897.841129:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175351936 00002000:00100000:2.0:1746144897.841165:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368a80 x1830965175351936/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.841178:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368a80 with x1830965175351936 ext(0->4095) 00010000:00010000:2.0:1746144897.841185:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ba expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.841196:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ba expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.841202:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093368a80 00000100:00100000:2.0:1746144897.841290:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2265 00000100:00100000:2.0:1746144897.841297:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1985:x1830965175351936:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144897.841595:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1985:x1830965175351936:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 298us (952us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.841601:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2265 00002000:00100000:2.0:1746144897.841606:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff880093368a80 x1830965175351936/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.841613:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368a80 with x1830965175351936 ext(0->4095) 00010000:00010000:2.0:1746144897.841617:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ba expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.841626:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ba expref: 94 pid: 10401 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.841631:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880093368a80 00000100:00100000:0.0:1746144897.843483:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.843528:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175352064 00000100:00100000:2.0:1746144897.843535:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175352064 00000100:00100000:2.0:1746144897.843581:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5852 00000100:00100000:2.0:1746144897.843588:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+94:31565:x1830965175352064:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 00010000:00010000:2.0:1746144897.843600:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.843613:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af672751596b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af953cf expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.843638:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144897.843644:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c8 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.843650:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746144897.843653:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af672751596b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953cf expref: 95 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.843688:0:8430:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c8 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.843700:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af672751596b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953cf expref: 95 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.843708:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbbd800, rc 0) 00000100:00100000:2.0:1746144897.843747:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+95:31565:x1830965175352064:12345-192.168.202.16@tcp:101:rw_seq_cst_vs_d.0 Request processed in 159us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.843752:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5852 00000100:00100000:0.0:1746144897.844306:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.844723:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175352192 00000100:00100000:3.0:1746144897.844727:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175352192 00010000:00010000:3.0:1746144897.844743:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ba expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.844759:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11267 00000100:00100000:3.0:1746144897.844780:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+95:1984:x1830965175352192:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.844787:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.844801:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ba expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.844810:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ba expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.844824:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009966d200/0x4076af672751595d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953ba expref: 95 pid: 10401 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.845858:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.845861:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.845870:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c8 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.845882:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60080000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c8 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.845920:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c8 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.845930:0:7097:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c8 expref: 5 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.845940:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172536448:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.846007:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144897.848712:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.848798:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175352448 00000100:00100000:2.0:1746144897.848805:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175352448 00002000:00100000:2.0:1746144897.848846:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336ad80 x1830965175352448/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/0 e 0 to 0 dl 1746144908 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.848859:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336ad80 with x1830965175352448 ext(0->4095) 00010000:00010000:2.0:1746144897.848866:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c8 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.848877:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c8 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.848883:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009336ad80 00000100:00100000:2.0:1746144897.848923:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2266 00000100:00100000:2.0:1746144897.848929:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175352448:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144897.849065:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175352448:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 135us (359us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144897.849071:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2266 00002000:00100000:2.0:1746144897.849075:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x18:0x0] (0->4095) req@ffff88009336ad80 x1830965175352448/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:538/0 lens 488/4536 e 0 to 0 dl 1746144908 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144897.849081:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336ad80 with x1830965175352448 ext(0->4095) 00010000:00010000:2.0:1746144897.849085:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c8 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:2.0:1746144897.849093:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c8 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00002000:00010000:2.0:1746144897.849098:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009336ad80 00000100:00100000:3.0:1746144897.849510:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172536448:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.849524:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.849549:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1984:x1830965175352192:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 4768us (5244us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.849557:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11267 00000100:00100000:0.0:1746144897.855024:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.855066:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.855148:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144897.855597:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.855671:0:7114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175353216 00000100:00100000:3.0:1746144897.855679:0:7114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175353216 00000100:00100000:3.0:1746144897.855719:0:7114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 150 00000100:00100000:3.0:1746144897.855726:0:7114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+6:31565:x1830965175353216:12345-192.168.202.16@tcp:35:rw_seq_cst_vs_d.0 00000001:00080000:3.0:1746144897.855985:0:7114:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294987480 00000100:00100000:3.0:1746144897.856057:0:7114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31565:x1830965175353216:12345-192.168.202.16@tcp:35:rw_seq_cst_vs_d.0 Request processed in 331us (459us total) trans 4294987481 rc 0/0 00000100:00100000:3.0:1746144897.856063:0:7114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 150 00000020:00080000:3.0:1746144897.856069:0:7114:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1746144897.856086:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175352576 00000100:00100000:3.0:1746144897.856088:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175352576 00010000:00010000:3.0:1746144897.856102:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c8 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00000100:00100000:3.0:1746144897.856120:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11268 00000100:00100000:3.0:1746144897.856124:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093369880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175352576:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144897.856131:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144897.856145:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c8 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.856155:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c8 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.856173:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091752400/0x4076af6727515964 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953c8 expref: 6 pid: 8432 timeout: 591 lvb_type: 0 00010000:00010000:3.0:1746144897.856183:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.856185:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144897.856191:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af672751596b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953cf expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.856197:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af672751596b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953cf expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.856221:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af672751596b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953cf expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144897.856235:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172536576:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144897.856281:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800acd42180 going to sleep for 11 seconds 00000100:00100000:2.0:1746144897.856458:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175352704 00000100:00100000:2.0:1746144897.856463:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175352704 00000100:00100000:2.0:1746144897.856487:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 373 00000100:00100000:2.0:1746144897.856492:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4574b85-29c1-4863-b96a-3fe350afea52+12:1983:x1830965175352704:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1746144897.856513:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4574b85-29c1-4863-b96a-3fe350afea52+12:1983:x1830965175352704:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 21us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.856519:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 373 00000100:00100000:1.0:1746144897.856584:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175352832 00000100:00100000:1.0:1746144897.856588:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175352832 00000100:00100000:1.0:1746144897.856607:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 320 00000100:00100000:1.0:1746144897.856612:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175352832:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:1.0:1746144897.856633:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175352832:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 21us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144897.856637:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 320 00000100:00080000:0.0:1746144897.858320:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144897.859099:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.859542:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175352960 00000100:00100000:2.0:1746144897.859547:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175352960 00000100:00100000:2.0:1746144897.859594:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5853 00000100:00100000:2.0:1746144897.859603:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1981:x1830965175352960:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:2.0:1746144897.859624:0:8430:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x4076af67273f0c3b 00000100:00080000:2.0:1746144897.859630:0:8430:0:(import.c:66:import_set_state_nolock()) ffff880093fde800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746144897.859652:0:8430:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968533 00000100:00100000:2.0:1746144897.859870:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+2:1981:x1830965175352960:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 269us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.859876:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5853 00010000:00010000:2.0:1746144897.859890:0:7101:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144897.859988:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00080000:1.0:1746144897.860167:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746144897.860374:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175353344 00000100:00100000:2.0:1746144897.860378:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175353344 00000100:00100000:2.0:1746144897.860412:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 321 00000100:00100000:2.0:1746144897.860417:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1982:x1830965175353344:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1746144897.860442:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1982:x1830965175353344:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 26us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.860448:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 321 00000100:00080000:1.0:1746144897.860485:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746144897.861965:0:7097:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.16@tcp) returned -22 from completion AST (req@ffff88008f38f100 x1830965172536576) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af672751596b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953cf expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144897.862002:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012dbbd800/0x4076af672751596b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953cf expref: 93 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144897.862012:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172536576:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144897.862041:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144897.862069:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093369880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175352576:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 5943us (7053us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.862077:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11268 00000100:00100000:0.0:1746144897.862449:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144897.862641:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175353728 00000100:00100000:1.0:1746144897.862646:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175353728 00000100:00100000:1.0:1746144897.862678:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 151 00000100:00100000:1.0:1746144897.862683:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:31565:x1830965175353728:12345-192.168.202.16@tcp:35:rw_seq_cst_vs_d.0 00000100:00100000:1.0:1746144897.862833:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:31565:x1830965175353728:12345-192.168.202.16@tcp:35:rw_seq_cst_vs_d.0 Request processed in 149us (384us total) trans 4294987482 rc 0/0 00000100:00100000:1.0:1746144897.862839:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 151 00000100:00100000:2.0:1746144897.863319:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144897.863360:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175353472 00000100:00100000:3.0:1746144897.863363:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175353472 00000100:00100000:3.0:1746144897.863389:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5854 00000100:00100000:3.0:1746144897.863393:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1981:x1830965175353472:12345-192.168.202.16@tcp:9:kworker.0 00000020:00000080:3.0:1746144897.863406:0:8432:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0x4076af67273f0b15 00000100:00080000:3.0:1746144897.863411:0:8432:0:(import.c:66:import_set_state_nolock()) ffff880093e44000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1746144897.863424:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1746144897.863442:0:8432:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294968533 00000100:00100000:3.0:1746144897.863536:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+2:1981:x1830965175353472:12345-192.168.202.16@tcp:9:kworker.0 Request processed in 141us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144897.863541:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5854 00000100:00080000:1.0:1746144897.864302:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144897.895876:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.897150:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175353856 00000100:00100000:2.0:1746144897.897160:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175353856 00000100:00100000:2.0:1746144897.897282:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48213 00000100:00100000:2.0:1746144897.897291:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+8:31596:x1830965175353856:12345-192.168.202.16@tcp:101:rm.0 00010000:00010000:2.0:1746144897.897313:0:10400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.897331:0:10400:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d0c00/0x4076af6727515972 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af953d6 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.897376:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515979 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.897387:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.897397:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000004:00200000:2.0:1746144897.897451:0:10400:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:2.0:1746144897.897455:0:10400:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144897.897468:0:10400:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.897485:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800927d0c00/0x4076af6727515972 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953d6 expref: 10 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.898729:0:10400:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515979 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953d6 expref: 9 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.898738:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800917b0200) 00010000:00010000:2.0:1746144897.898740:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746144897.898743:0:10400:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbbd800, rc 0) 00000100:00100000:2.0:1746144897.899526:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31596:x1830965175353856:12345-192.168.202.16@tcp:101:rm.0 Request processed in 2233us (3654us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.899533:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48213 00000100:00100000:0.0:1746144897.901278:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.901620:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175353984 00000100:00100000:2.0:1746144897.901628:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175353984 00000100:00100000:2.0:1746144897.901673:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48214 00000100:00100000:2.0:1746144897.901680:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31596:x1830965175353984:12345-192.168.202.16@tcp:101:rm.0 00010000:00010000:2.0:1746144897.901696:0:10400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.901711:0:10400:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd400/0x4076af6727515980 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af953dd expref: -99 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.901760:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af6727515987 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902600:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af6727515987 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902610:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af6727515987 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902624:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af672751598e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902628:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af672751598e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902633:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af672751598e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902799:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd200/0x4076af6727515995 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902807:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd200/0x4076af6727515995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902813:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd200/0x4076af6727515995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000004:00200000:2.0:1746144897.902838:0:10400:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x46:0x0]: returning size 8 00000004:00200000:2.0:1746144897.902842:0:10400:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144897.902860:0:10400:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd200/0x4076af6727515995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902867:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd200/0x4076af6727515995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902872:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af6727515987 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902877:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af6727515987 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902881:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af6727515987 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902885:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbbc400 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144897.902889:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af6727515987 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902894:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af6727515987 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902911:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800917b0200) 00010000:00010000:2.0:1746144897.902914:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144897.902917:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af6727515987 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902921:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af6727515987 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902929:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af672751598e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902933:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af672751598e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902940:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af672751598e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902944:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbbd000 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144897.902946:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af672751598e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902949:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af672751598e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902955:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf0ce3da1 (ffff8800917b0300) 00010000:00010000:2.0:1746144897.902956:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144897.902958:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af672751598e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902962:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af672751598e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.902986:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd400/0x4076af6727515980 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953dd expref: 11 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.902995:0:10400:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd200/0x4076af6727515995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953dd expref: 10 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.903000:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff880099b3f200) 00010000:00010000:2.0:1746144897.903002:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144897.903004:0:10400:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbbd200, rc 0) 00000100:00100000:2.0:1746144897.903251:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+10:31596:x1830965175353984:12345-192.168.202.16@tcp:101:rm.0 Request processed in 1570us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.903258:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48214 00000100:00100000:0.0:1746144897.905852:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.906004:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175354112 00000100:00100000:2.0:1746144897.906013:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175354112 00000100:00100000:2.0:1746144897.906064:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5855 00000100:00100000:2.0:1746144897.906071:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+93:1985:x1830965175354112:12345-192.168.202.16@tcp:101:rm.0 00010000:00010000:2.0:1746144897.906087:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144897.906103:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af672751599c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af953e4 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144897.906124:0:8430:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 8, mtime: 0x68140e82, atime: 0x68140e6e, ctime: 0x68140e82, blocks: 0xb 00010000:00010000:2.0:1746144897.906457:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.906459:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144897.906466:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af672751599c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953e4 expref: 94 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144897.906479:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af672751599c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953e4 expref: 94 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144897.906488:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800927d1c00, rc 0) 00000100:00100000:2.0:1746144897.906532:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+94:1985:x1830965175354112:12345-192.168.202.16@tcp:101:rm.0 Request processed in 462us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144897.906537:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5855 00000100:00100000:0.0:1746144897.910240:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144897.910516:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175354368 00000100:00100000:2.0:1746144897.910525:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175354368 00000100:00100000:2.0:1746144897.910574:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48215 00000100:00100000:2.0:1746144897.910581:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+10:31596:x1830965175354368:12345-192.168.202.16@tcp:36:rm.0 00010000:00010000:2.0:1746144897.910620:0:10400:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1746144897.910641:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd200/0x4076af6727515995 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953dd expref: 10 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.910674:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092705c00/0x4076af6727513108 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af92b73 expref: 9 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.910683:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff880099b3f200) 00010000:00010000:2.0:1746144897.910691:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515979 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953d6 expref: 8 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144897.910696:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800917b0200) 00010000:00010000:2.0:1746144897.910704:0:10400:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144897.910719:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd400/0x4076af67275159a3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.910728:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd400/0x4076af67275159a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.910735:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd400/0x4076af67275159a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.910742:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af67275159aa lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.910747:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af67275159aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.910752:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af67275159aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.910868:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af67275159b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.910874:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af67275159b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.910879:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af67275159b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000040:00080000:2.0:1746144897.911241:0:10400:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].13, 64 off9024 00000004:00080000:2.0:1746144897.911248:0:10400:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 492058484617ns, next at 493058483097ns, rc = 0 00010000:00010000:2.0:1746144897.911297:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc200/0x4076af67275159b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911304:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc200/0x4076af67275159b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911309:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc200/0x4076af67275159b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911315:0:10400:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc200/0x4076af67275159b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911319:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc200/0x4076af67275159b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911324:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc200/0x4076af67275159b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911348:0:10400:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746144897.911362:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af67275159b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911366:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af67275159b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911372:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af67275159b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911376:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbbc400 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144897.911379:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af67275159b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911384:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af67275159b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911391:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff880099b3f200) 00010000:00010000:2.0:1746144897.911393:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746144897.911396:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af67275159b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911400:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc400/0x4076af67275159b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911434:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd400/0x4076af67275159a3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911439:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd400/0x4076af67275159a3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911443:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd400/0x4076af67275159a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911447:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbbd400 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144897.911449:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd400/0x4076af67275159a3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911453:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd400/0x4076af67275159a3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911462:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800917b0c00) 00010000:00010000:2.0:1746144897.911464:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144897.911466:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd400/0x4076af67275159a3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.911470:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd400/0x4076af67275159a3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00000004:00010000:2.0:1746144897.911480:0:10400:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880092f73480 reply state ffff880092041000 transno 4294987483 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af67275159aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000100:00100000:2.0:1746144897.911485:0:10400:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746144897.911532:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+9:31596:x1830965175354368:12345-192.168.202.16@tcp:36:rm.0 Request processed in 950us (1298us total) trans 4294987483 rc 0/0 00000100:00100000:2.0:1746144897.911538:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48215 00010000:00010000:3.0:1746144897.911789:0:7100:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746144897.911795:0:7100:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc200/0x4076af67275159b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144897.911800:0:7100:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbbc200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144897.911803:0:7100:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc200/0x4076af67275159b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144897.911807:0:7100:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc200/0x4076af67275159b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144897.911814:0:7100:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff880099b3f200) 00010000:00010000:3.0:1746144897.911816:0:7100:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1746144897.911818:0:7100:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc200/0x4076af67275159b8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144897.911821:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc200/0x4076af67275159b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144897.911833:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746144897.911834:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746144897.911835:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746144897.913375:0:3293:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af67275159aa lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.913385:0:3293:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af67275159aa lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.913390:0:3293:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af67275159aa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.913394:0:3293:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbbd000 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144897.913397:0:3293:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af67275159aa lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.913402:0:3293:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af67275159aa lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.913411:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf0ce3da1 (ffff8800917b0400) 00010000:00010000:2.0:1746144897.913414:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144897.913417:0:3293:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af67275159aa lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144897.913420:0:3293:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd000/0x4076af67275159aa lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf0ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00000001:00080000:1.0:1746144897.949658:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294968051 is committed 00000001:00080000:1.0:1746144897.949702:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294968053 is committed 00000001:00080000:2.0:1746144898.481754:0:7157:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294987482 is committed 00000001:00080000:2.0:1746144898.481802:0:7157:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294987483 is committed 00000004:00080000:2.0:1746144898.481807:0:7157:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 16 committed 00000100:00100000:0.0:1746144898.481938:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172536704:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1746144898.481989:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144898.482012:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172536704 00000100:00100000:2.0:1746144898.482018:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172536704 00000100:00100000:2.0:1746144898.482050:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5856 00000100:00100000:2.0:1746144898.482057:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172536704:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1746144898.482078:0:8430:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:24 count 1 00010000:00010000:2.0:1746144898.482096:0:8430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800916fae00/0x4076af67275159bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144898.482113:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af672751599c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953e4 expref: 5 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144898.482119:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144898.482121:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144898.482123:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800916fae00/0x4076af67275159bf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144898.482142:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af672751599c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953e4 expref: 5 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144898.482152:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af672751599c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953e4 expref: 5 pid: 8430 timeout: 592 lvb_type: 1 00000100:00100000:2.0:1746144898.482162:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172536832:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144898.482205:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137345180 going to sleep for 11 seconds 00000100:00100000:0.0:1746144898.486488:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144898.486726:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172536832:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144898.486749:0:8430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800916fae00/0x4076af67275159bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144898.486782:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175354496 00000100:00100000:3.0:1746144898.486787:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175354496 00010000:00010000:3.0:1746144898.486810:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af672751599c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953e4 expref: 6 pid: 8430 timeout: 592 lvb_type: 1 00000100:00100000:3.0:1746144898.486831:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11269 00000100:00100000:3.0:1746144898.486838:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175354496:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144898.486847:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144898.486852:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af672751599c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953e4 expref: 6 pid: 8430 timeout: 592 lvb_type: 1 00010000:00010000:3.0:1746144898.486861:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af672751599c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953e4 expref: 6 pid: 8430 timeout: 592 lvb_type: 1 00010000:00010000:3.0:1746144898.486879:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927d1c00/0x4076af672751599c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953e4 expref: 6 pid: 8430 timeout: 592 lvb_type: 1 00010000:00010000:3.0:1746144898.486889:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144898.486891:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144898.486907:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800916fae00/0x4076af67275159bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144898.486915:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800916fae00/0x4076af67275159bf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144898.486931:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144898.486962:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1984:x1830965175354496:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 123us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144898.486967:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11269 00010000:00010000:3.0:1746144898.486986:0:8430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800916fae00/0x4076af67275159bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144898.486992:0:8430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800916fae00/0x4076af67275159bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144898.487004:0:8430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800916fae00/0x4076af67275159bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144898.487010:0:8430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800916fae00/0x4076af67275159bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144898.487028:0:8430:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746144898.487476:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1830965172536704:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5419us (5486us total) trans 4294968054 rc 0/0 00000100:00100000:3.0:1746144898.487483:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5856 00010000:00010000:2.0:1746144898.488309:0:7101:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746144898.488316:0:7101:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800916fae00/0x4076af67275159bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144898.488336:0:7101:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800916fae00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144898.488340:0:7101:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800916fae00/0x4076af67275159bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144898.488349:0:7101:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800916fae00/0x4076af67275159bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144898.488361:0:7101:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800916fae00/0x4076af67275159bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144898.488367:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800916fae00/0x4076af67275159bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144898.488383:0:7101:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746144898.488384:0:7101:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746144898.488386:0:7101:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746144898.489196:0:3307:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092f72d80/2, rc 0, transno 4294968054 00000100:00100000:0.0:1746144898.489204:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092f72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172536704:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1746144898.614567:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746144899.616106:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746144900.527210:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1830965172537216:0@lo:400:kworker.0 00000100:00100000:1.0:1746144900.527302:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144900.527351:0:3306:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746144900.527355:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965172537344:0@lo:400:kworker.0 00000100:00100000:1.0:1746144900.527375:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144900.527404:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172537216 00000100:00100000:1.0:1746144900.527409:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172537216 00000100:00100000:1.0:1746144900.527439:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:1.0:1746144900.527444:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1830965172537216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746144900.527474:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1830965172537216:12345-0@lo:400:kworker.0 Request processed in 30us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144900.527478:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00080000:1.0:1746144900.527491:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746144900.527507:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1830965172537216:0@lo:400:kworker.0 00000100:00100000:0.0:1746144900.527568:0:3308:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2566f13b-362a-4e88-b0dd-c558bbe87895:3308:1830965172536960:0@lo:400:kworker.0 00000100:00100000:0.0:1746144900.527592:0:3308:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144900.527611:0:3308:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1830965172537472:0@lo:400:kworker.0 00000100:00100000:0.0:1746144900.527624:0:3308:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144900.527635:0:3308:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746144900.527639:0:3308:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1830965172537088:0@lo:400:kworker.0 00000100:00100000:0.0:1746144900.527652:0:3308:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144900.527663:0:3308:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ad5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1830965172537600:0@lo:400:kworker.0 00000100:00100000:0.0:1746144900.527677:0:3308:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144900.527696:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172537472 00000100:00100000:0.0:1746144900.527698:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172537472 00000100:00100000:0.0:1746144900.527718:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172537088 00000100:00100000:0.0:1746144900.527719:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172537088 00000100:00100000:0.0:1746144900.527730:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1746144900.527734:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1830965172537472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144900.527756:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1830965172537472:12345-0@lo:400:kworker.0 Request processed in 22us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144900.527778:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1746144900.527789:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1746144900.527794:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1830965172537088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144900.527812:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1830965172537088:12345-0@lo:400:kworker.0 Request processed in 19us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144900.527816:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1746144900.527837:0:3308:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1830965172537088:0@lo:400:kworker.0 00000100:00100000:0.0:1746144900.527846:0:3308:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1830965172537472:0@lo:400:kworker.0 00000100:00100000:3.0:1746144900.527907:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172537344 00000100:00100000:3.0:1746144900.527911:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172537344 00000100:00100000:3.0:1746144900.527929:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172537600 00000100:00100000:3.0:1746144900.527930:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172537600 00000100:00100000:3.0:1746144900.527946:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1746144900.527951:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1830965172537344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746144900.527979:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1830965172537344:12345-0@lo:400:kworker.0 Request processed in 29us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144900.527984:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1746144900.527992:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1746144900.527995:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1830965172537600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746144900.528012:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1830965172537600:12345-0@lo:400:kworker.0 Request processed in 17us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144900.528016:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:3.0:1746144900.528026:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172536960 00000100:00100000:3.0:1746144900.528028:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172536960 00000100:00100000:3.0:1746144900.528040:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1746144900.528043:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2566f13b-362a-4e88-b0dd-c558bbe87895+18:3308:x1830965172536960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746144900.528058:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2566f13b-362a-4e88-b0dd-c558bbe87895+18:3308:x1830965172536960:12345-0@lo:400:kworker.0 Request processed in 15us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144900.528062:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1746144900.528323:0:3308:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1830965172537600:0@lo:400:kworker.0 00000100:00100000:0.0:1746144900.528329:0:3308:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2566f13b-362a-4e88-b0dd-c558bbe87895:3308:1830965172536960:0@lo:400:kworker.0 00000100:00080000:1.0:1746144900.528549:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746144900.528552:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746144900.528554:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746144900.528570:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ad5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965172537344:0@lo:400:kworker.0 00000100:00100000:0.0:1746144900.572612:0:3307:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746144900.572628:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800935edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172537728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746144900.572721:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144900.572832:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172537728 00000100:00100000:2.0:1746144900.572837:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172537728 00000100:00100000:2.0:1746144900.572873:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1746144900.572887:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172537728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1746144900.572918:0:8435:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3856662528 avail 3854565376 00000100:00100000:2.0:1746144900.572952:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172537728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144900.572957:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1746144900.573511:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800935edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172537728:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1746144900.617920:0:7101:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1746144901.351596:0:3385:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 16h: mmap read after truncate file ======= 20:15:01 (1746144901) 00000100:00100000:3.0:1746144901.404013:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.404599:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175354624 00000100:00100000:2.0:1746144901.404607:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175354624 00000100:00100000:2.0:1746144901.404660:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48216 00000100:00100000:2.0:1746144901.404667:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+5:32227:x1830965175354624:12345-192.168.202.16@tcp:101:mkdir.0 00010000:00010000:2.0:1746144901.404684:0:10400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144901.404702:0:10400:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fba00/0x4076af67275159c6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af953eb expref: -99 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.404750:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fae00/0x4076af67275159cd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.404760:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fae00/0x4076af67275159cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.404787:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fae00/0x4076af67275159cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000004:00200000:2.0:1746144901.404842:0:10400:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:2.0:1746144901.404845:0:10400:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 24 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144901.404857:0:10400:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fae00/0x4076af67275159cd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.404886:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fba00/0x4076af67275159c6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953eb expref: 7 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.404897:0:10400:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fae00/0x4076af67275159cd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953eb expref: 6 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.404904:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800922d3700) 00010000:00010000:2.0:1746144901.404906:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746144901.404909:0:10400:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800916fae00, rc 0) 00000100:00100000:2.0:1746144901.404946:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+6:32227:x1830965175354624:12345-192.168.202.16@tcp:101:mkdir.0 Request processed in 279us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144901.404951:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48216 00000100:00080000:1.0:1746144901.405236:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144901.406905:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144901.407639:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144901.407944:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175354752 00000100:00100000:3.0:1746144901.407951:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175354752 00000100:00100000:3.0:1746144901.407980:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175355008 00000100:00100000:3.0:1746144901.407982:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175355008 00000100:00100000:3.0:1746144901.407996:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48217 00000100:00100000:3.0:1746144901.408003:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175354752:12345-192.168.202.16@tcp:41:mkdir.0 00000004:00000024:3.0:1746144901.408036:0:10400:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2260336640 avail 2258239488 00000100:00100000:3.0:1746144901.408074:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175354752:12345-192.168.202.16@tcp:41:mkdir.0 Request processed in 73us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144901.408080:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48217 00000100:00100000:3.0:1746144901.408090:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48218 00000100:00100000:3.0:1746144901.408094:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+6:32227:x1830965175355008:12345-192.168.202.16@tcp:36:mkdir.0 00010000:00010000:3.0:1746144901.408118:0:10400:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144901.408134:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fae00/0x4076af67275159cd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953eb expref: 6 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.408145:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800922d3700) 00010000:00010000:3.0:1746144901.408152:0:10400:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144901.408214:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159d4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.408223:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.408229:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.408237:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159db lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.408241:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.408245:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000004:00200000:3.0:1746144901.410845:0:10400:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x47:0x0]: returning size 512 00010000:00010000:3.0:1746144901.410856:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159d4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.410864:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159d4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.410881:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.410885:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009170ba00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144901.410889:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159d4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.410894:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159d4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.410905:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bb2b400) 00010000:00010000:3.0:1746144901.410908:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144901.410911:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159d4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.410915:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159d4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00000004:00010000:3.0:1746144901.410927:0:10400:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800935ef480 reply state ffff88013561f000 transno 4294987484 ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000100:00100000:3.0:1746144901.410932:0:10400:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746144901.410991:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+7:32227:x1830965175355008:12345-192.168.202.16@tcp:36:mkdir.0 Request processed in 2893us (3350us total) trans 4294987484 rc 0/0 00000100:00100000:3.0:1746144901.410998:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48218 00010000:00010000:2.0:1746144901.417924:0:3292:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159db lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.417937:0:3292:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159db lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.417944:0:3292:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.417950:0:3292:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009170a200 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144901.417954:0:3292:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159db lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.417960:0:3292:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159db lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.417973:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf9ce3d8f (ffff88009bb2b200) 00010000:00010000:2.0:1746144901.417976:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144901.417979:0:3292:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159db lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.417984:0:3292:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159db lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00000100:00100000:0.0:1746144901.431079:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144901.431292:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175355136 00000100:00100000:3.0:1746144901.431300:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175355136 00000100:00100000:3.0:1746144901.431339:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48219 00000100:00100000:3.0:1746144901.431347:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+6:32228:x1830965175355136:12345-192.168.202.16@tcp:101:cp.0 00010000:00010000:3.0:1746144901.431364:0:10400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144901.431379:0:10400:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d6cc00/0x4076af67275159e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af953f2 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.431423:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d6dc00/0x4076af67275159e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.431432:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130d6dc00/0x4076af67275159e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.431440:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d6dc00/0x4076af67275159e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000004:00200000:3.0:1746144901.431485:0:10400:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:3.0:1746144901.431489:0:10400:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144901.431502:0:10400:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880130d6dc00/0x4076af67275159e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.431519:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d6cc00/0x4076af67275159e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953f2 expref: 8 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.431530:0:10400:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130d6dc00/0x4076af67275159e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953f2 expref: 7 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.431536:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bb2b400) 00010000:00010000:3.0:1746144901.431538:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746144901.431541:0:10400:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130d6dc00, rc 0) 00000100:00100000:3.0:1746144901.432153:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+7:32228:x1830965175355136:12345-192.168.202.16@tcp:101:cp.0 Request processed in 805us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144901.432158:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48219 00000100:00100000:0.0:1746144901.436458:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144901.436564:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175355264 00000100:00100000:3.0:1746144901.436574:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175355264 00000100:00100000:3.0:1746144901.436627:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48220 00000100:00100000:3.0:1746144901.436636:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+7:32228:x1830965175355264:12345-192.168.202.16@tcp:101:cp.0 00010000:00010000:3.0:1746144901.436657:0:10400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144901.436677:0:10400:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130d6da00/0x4076af67275159f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af953f9 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.436741:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.436753:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437015:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437029:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437035:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437039:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437149:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a600/0x4076af6727515a05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437154:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a600/0x4076af6727515a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437158:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a600/0x4076af6727515a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000004:00200000:3.0:1746144901.437180:0:10400:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x47:0x0]: returning size 512 00000004:00200000:3.0:1746144901.437183:0:10400:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144901.437197:0:10400:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a600/0x4076af6727515a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437205:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437210:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437215:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437220:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009170a200 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144901.437223:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437229:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437240:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bb2b400) 00010000:00010000:3.0:1746144901.437243:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144901.437246:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437249:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a200/0x4076af67275159f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437259:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437262:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437266:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437270:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009170ba00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144901.437272:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437275:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437279:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf9ce3d8f (ffff88009bb2b200) 00010000:00010000:3.0:1746144901.437280:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144901.437282:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437285:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ba00/0x4076af67275159fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.437309:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d6da00/0x4076af67275159f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953f9 expref: 9 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.437320:0:10400:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170a600/0x4076af6727515a05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953f9 expref: 8 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.437326:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff88009bb2bf00) 00010000:00010000:3.0:1746144901.437328:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1746144901.437330:0:10400:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009170a600, rc 0) 00000100:00100000:3.0:1746144901.438014:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+8:32228:x1830965175355264:12345-192.168.202.16@tcp:101:cp.0 Request processed in 1376us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144901.438021:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48220 00000100:00100000:0.0:1746144901.439744:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144901.440844:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175355392 00000100:00100000:3.0:1746144901.440854:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175355392 00000100:00100000:3.0:1746144901.440914:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48221 00000100:00100000:3.0:1746144901.440923:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+8:32228:x1830965175355392:12345-192.168.202.16@tcp:101:cp.0 00010000:00010000:3.0:1746144901.440940:0:10400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144901.440961:0:10400:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf27000/0x4076af6727515a0c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95400 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.441026:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf97600/0x4076af6727515a13 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.441039:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf97600/0x4076af6727515a13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.441050:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf97600/0x4076af6727515a13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.442291:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515a1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.442308:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.442320:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.443003:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf97600/0x4076af6727515a13 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.443010:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf97600/0x4076af6727515a13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.443015:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf97600/0x4076af6727515a13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.443019:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cf97600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144901.443022:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf97600/0x4076af6727515a13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.443028:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf97600/0x4076af6727515a13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.443039:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff88009bb2bf00) 00010000:00010000:3.0:1746144901.443041:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144901.443044:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf97600/0x4076af6727515a13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.443049:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf97600/0x4076af6727515a13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.443058:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515a1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.443063:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515a1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.443067:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.443070:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b466600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144901.443072:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515a1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.443077:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515a1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.443082:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0xf9ce3da1 (ffff88009bb2b900) 00010000:00010000:3.0:1746144901.443083:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144901.443085:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515a1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.443088:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515a1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.443134:0:10400:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf27000/0x4076af6727515a0c lrc: 1/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95400 expref: 9 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.443141:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf27000/0x4076af6727515a0c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95400 expref: 9 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.443149:0:10400:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cf27000, rc 0) 00000100:00100000:3.0:1746144901.444193:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+8:32228:x1830965175355392:12345-192.168.202.16@tcp:101:cp.0 Request processed in 3265us (4450us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144901.444202:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48221 00000100:00100000:0.0:1746144901.448207:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144901.448259:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175355520 00000100:00100000:3.0:1746144901.448266:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175355520 00000100:00100000:3.0:1746144901.448311:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48222 00000100:00100000:3.0:1746144901.448318:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+8:32228:x1830965175355520:12345-192.168.202.16@tcp:101:cp.0 00010000:00010000:3.0:1746144901.448333:0:10400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144901.448346:0:10400:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467200/0x4076af6727515a21 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95407 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.448391:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466400/0x4076af6727515a28 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448401:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466400/0x4076af6727515a28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448410:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466400/0x4076af6727515a28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448419:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466200/0x4076af6727515a2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448424:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466200/0x4076af6727515a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448428:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466200/0x4076af6727515a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448473:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466400/0x4076af6727515a28 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448479:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466400/0x4076af6727515a28 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448489:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466400/0x4076af6727515a28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448494:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b466400 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144901.448497:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466400/0x4076af6727515a28 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448503:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466400/0x4076af6727515a28 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448511:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff88009bb2bf00) 00010000:00010000:3.0:1746144901.448513:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144901.448516:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466400/0x4076af6727515a28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448521:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466400/0x4076af6727515a28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448528:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466200/0x4076af6727515a2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448531:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466200/0x4076af6727515a2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448535:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466200/0x4076af6727515a2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448538:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b466200 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144901.448540:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466200/0x4076af6727515a2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448544:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466200/0x4076af6727515a2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448548:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0xf9ce3da1 (ffff88009bb2b100) 00010000:00010000:3.0:1746144901.448550:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144901.448552:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466200/0x4076af6727515a2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448556:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466200/0x4076af6727515a2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.448584:0:10400:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467200/0x4076af6727515a21 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95407 expref: 9 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.448590:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467200/0x4076af6727515a21 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95407 expref: 9 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.448596:0:10400:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b467200, rc 0) 00000100:00100000:3.0:1746144901.448644:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+8:32228:x1830965175355520:12345-192.168.202.16@tcp:101:cp.0 Request processed in 327us (445us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144901.448650:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48222 00000100:00100000:2.0:1746144901.450785:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144901.450979:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175355776 00000100:00100000:1.0:1746144901.450988:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175355776 00000100:00100000:1.0:1746144901.451032:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48223 00000100:00100000:1.0:1746144901.451039:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+8:32228:x1830965175355776:12345-192.168.202.16@tcp:101:cp.0 00010000:00010000:1.0:1746144901.451052:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144901.451063:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5321a00/0x4076af6727515a36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9540e expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144901.451147:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af6727515a3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.451156:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af6727515a3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.451164:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af6727515a3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.451178:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515a44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.451182:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515a44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.451185:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515a44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00080000:1.0:1746144901.452342:0:7113:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x19:0x0], index 1: 0 00010000:00010000:1.0:1746144901.452457:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091708a00/0x4076af6727515a4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.452465:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091708a00/0x4076af6727515a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.452472:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091708a00/0x4076af6727515a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.452491:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af6727515a3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.452496:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af6727515a3d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.452501:0:7113:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af6727515a3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.452505:0:7113:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4a6b400 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144901.452507:0:7113:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af6727515a3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.452512:0:7113:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af6727515a3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.452521:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff88009bb2bf00) 00010000:00010000:1.0:1746144901.452523:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144901.452526:0:7113:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af6727515a3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.452530:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af6727515a3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00000004:00010000:1.0:1746144901.452885:0:7113:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800925a8380 reply state ffff88009a901000 transno 4294987485 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515a44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000100:00100000:1.0:1746144901.452893:0:7113:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746144901.452918:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5321a00/0x4076af6727515a36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9540e expref: 11 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144901.452930:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091708a00/0x4076af6727515a4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9540e expref: 10 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144901.452935:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff88009bbcad00) 00010000:00010000:1.0:1746144901.452937:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144901.452939:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091708a00, rc 0) 00000100:00100000:1.0:1746144901.452994:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+11:32228:x1830965175355776:12345-192.168.202.16@tcp:101:cp.0 Request processed in 1954us (2237us total) trans 4294987485 rc 0/0 00000100:00100000:1.0:1746144901.453001:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48223 00010000:00010000:2.0:1746144901.455126:0:3293:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515a44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.455137:0:3293:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515a44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.455143:0:3293:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515a44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.455147:0:3293:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4a6ba00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144901.455150:0:3293:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515a44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.455155:0:3293:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515a44 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.455166:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0xf9ce3da1 (ffff88009bbcaa00) 00010000:00010000:2.0:1746144901.455167:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144901.455169:0:3293:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515a44 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.455173:0:3293:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515a44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00000100:00100000:0.0:1746144901.457304:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.457369:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175355904 00000100:00100000:2.0:1746144901.457378:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175355904 00000100:00100000:2.0:1746144901.457414:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5857 00000100:00100000:2.0:1746144901.457420:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:1981:x1830965175355904:12345-192.168.202.16@tcp:8:cp.0 00010000:00080000:2.0:1746144901.457447:0:8432:0:(ldlm_lib.c:1362:target_handle_connect()) lustre-OST0001: connection from 9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp t0 exp (null) cur 495 last 0 00000020:00000080:2.0:1746144901.457470:0:8432:0:(genops.c:1402:class_connect()) connect: client 9d7af19e-38f7-44a8-82cf-031a58749c81, cookie 0x4076af6727515a59 00002000:00100000:2.0:1746144901.457479:0:8432:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0001: cli 9d7af19e-38f7-44a8-82cf-031a58749c81/ffff880091a55000 ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 2103648 ocd_grant: 490340352 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1746144901.457489:0:8432:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:01000000:2.0:1746144901.457571:0:8432:0:(lprocfs_status_server.c:585:lprocfs_exp_setup()) using hash ffff88012b0afe40 00002000:00080000:2.0:1746144901.457578:0:8432:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1746144901.457598:0:8432:0:(import.c:66:import_set_state_nolock()) ffff880091a57000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1746144901.457650:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1981:x1830965175355904:12345-192.168.202.16@tcp:8:cp.0 Request processed in 229us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144901.457657:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5857 00000100:00100000:2.0:1746144901.459603:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144901.459624:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175356032 00000100:00100000:0.0:1746144901.459630:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175356032 00000100:00100000:0.0:1746144901.459684:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5858 00000100:00100000:0.0:1746144901.459691:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+6:0:x1830965175356032:12345-192.168.202.16@tcp:101:cp.0 00010000:00010000:0.0:1746144901.459704:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144901.459718:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727515a60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95415 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144901.459791:0:8432:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1746144901.459807:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144901.459809:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144901.459816:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727515a60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95415 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144901.459835:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727515a60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95415 expref: 7 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144901.459843:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad30c00, rc 0) 00000100:00100000:0.0:1746144901.459884:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:0:x1830965175356032:12345-192.168.202.16@tcp:101:cp.0 Request processed in 194us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144901.459889:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5858 00000100:00080000:1.0:1746144901.459955:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144901.462966:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.463018:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175356160 00000100:00100000:2.0:1746144901.463025:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175356160 00000100:00100000:2.0:1746144901.463075:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5859 00000100:00100000:2.0:1746144901.463081:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:32228:x1830965175356160:12345-192.168.202.16@tcp:101:cp.0 00010000:00010000:2.0:1746144901.463096:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144901.463110:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9541c expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.463132:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727515a60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95415 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144901.463139:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144901.463141:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144901.463143:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9541c expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.463168:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727515a60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95415 expref: 8 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144901.463178:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727515a60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95415 expref: 8 pid: 8432 timeout: 595 lvb_type: 1 00000100:00100000:2.0:1746144901.463189:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172537856:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144901.463278:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137345180 going to sleep for 11 seconds 00000100:00100000:2.0:1746144901.464694:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172537856:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144901.464714:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9541c expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.464726:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753800, rc 0) 00000100:00100000:2.0:1746144901.464783:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:32228:x1830965175356160:12345-192.168.202.16@tcp:101:cp.0 Request processed in 1682us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144901.464789:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5859 00000100:00100000:0.0:1746144901.465999:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144901.466186:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175356288 00000100:00100000:3.0:1746144901.466192:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175356288 00010000:00010000:3.0:1746144901.466221:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727515a60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95415 expref: 8 pid: 8432 timeout: 595 lvb_type: 1 00000100:00100000:3.0:1746144901.466256:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11270 00000100:00100000:3.0:1746144901.466262:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175356288:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144901.466273:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144901.466289:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727515a60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95415 expref: 8 pid: 8432 timeout: 595 lvb_type: 1 00010000:00010000:3.0:1746144901.466299:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727515a60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95415 expref: 8 pid: 8432 timeout: 595 lvb_type: 1 00010000:00010000:3.0:1746144901.466318:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727515a60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95415 expref: 8 pid: 8432 timeout: 595 lvb_type: 1 00010000:00010000:3.0:1746144901.466348:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144901.466350:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144901.466357:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9541c expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.466364:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9541c expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.466391:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9541c expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144901.466400:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172537984:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144901.467139:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4e26cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144901.470186:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172537984:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144901.470208:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144901.470246:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175356288:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3983us (4248us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144901.470255:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11270 00000100:00100000:0.0:1746144901.470455:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144901.470550:0:7114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175356544 00000100:00100000:3.0:1746144901.470555:0:7114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175356544 00000100:00100000:3.0:1746144901.470594:0:7114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 152 00000100:00100000:3.0:1746144901.470601:0:7114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:32228:x1830965175356544:12345-192.168.202.16@tcp:35:cp.0 00000100:00100000:3.0:1746144901.470858:0:7114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+11:32228:x1830965175356544:12345-192.168.202.16@tcp:35:cp.0 Request processed in 257us (402us total) trans 4294987486 rc 0/0 00000100:00100000:3.0:1746144901.470864:0:7114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 152 00000100:00100000:0.0:1746144901.501647:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144901.501716:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175356800 00000100:00100000:1.0:1746144901.501724:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175356800 00000100:00100000:1.0:1746144901.501865:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48224 00000100:00100000:1.0:1746144901.501885:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+11:32231:x1830965175356800:12345-192.168.202.16@tcp:101:mmap_cat.0 00010000:00010000:1.0:1746144901.501905:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144901.501920:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091708400/0x4076af6727515a6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95423 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144901.501988:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091709600/0x4076af6727515a75 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.501998:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091709600/0x4076af6727515a75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.502007:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091709600/0x4076af6727515a75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:1.0:1746144901.502015:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 1716 00010000:00010000:1.0:1746144901.502113:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091708400/0x4076af6727515a6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95423 expref: 14 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144901.502137:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091709600/0x4076af6727515a75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95423 expref: 13 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144901.502144:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff88009bbcad00) 00010000:00010000:1.0:1746144901.502146:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746144901.502148:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091709600, rc 0) 00000100:00100000:1.0:1746144901.502443:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+13:32231:x1830965175356800:12345-192.168.202.16@tcp:101:mmap_cat.0 Request processed in 558us (803us total) trans 4294987487 rc 0/0 00000100:00100000:1.0:1746144901.502449:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48224 00000100:00100000:0.0:1746144901.515222:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144901.515315:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175356928 00000100:00100000:1.0:1746144901.515324:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175356928 00000100:00080000:2.0:1746144901.515382:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746144901.515389:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48225 00000100:00100000:1.0:1746144901.515396:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:32235:x1830965175356928:12345-192.168.202.16@tcp:101:mmap_cat.0 00010000:00010000:1.0:1746144901.515417:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144901.515432:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091708c00/0x4076af6727515a83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9542a expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144901.515479:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af6727515a8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.515489:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af6727515a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.515499:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af6727515a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:1.0:1746144901.515543:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:1.0:1746144901.515546:0:7113:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 25 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144901.515559:0:7113:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af6727515a8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.515577:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091708c00/0x4076af6727515a83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9542a expref: 9 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144901.515603:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af6727515a8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9542a expref: 8 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144901.515610:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bb2b400) 00010000:00010000:1.0:1746144901.515613:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746144901.515615:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091709c00, rc 0) 00000100:00100000:1.0:1746144901.516368:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:32235:x1830965175356928:12345-192.168.202.16@tcp:101:mmap_cat.0 Request processed in 253us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144901.516377:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48225 00000100:00100000:0.0:1746144901.518247:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144901.518630:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175357056 00000100:00100000:1.0:1746144901.518638:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175357056 00000100:00100000:1.0:1746144901.518677:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48226 00000100:00100000:1.0:1746144901.518684:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:32235:x1830965175357056:12345-192.168.202.16@tcp:101:mmap_cat.0 00010000:00010000:1.0:1746144901.518699:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144901.518711:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091709e00/0x4076af6727515a91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95431 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144901.518756:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091709400/0x4076af6727515a98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.518795:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091709400/0x4076af6727515a98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.518803:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091709400/0x4076af6727515a98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.518814:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091708200/0x4076af6727515a9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.518819:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091708200/0x4076af6727515a9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.518823:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091708200/0x4076af6727515a9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.518918:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091708400/0x4076af6727515aa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.518924:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091708400/0x4076af6727515aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144901.518929:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091708400/0x4076af6727515aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:0.0:1746144901.519284:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x47:0x0]: returning size 512 00000004:00200000:0.0:1746144901.519288:0:7113:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144901.519303:0:7113:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091708400/0x4076af6727515aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144901.519312:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091709400/0x4076af6727515a98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144901.519317:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091709400/0x4076af6727515a98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144901.519322:0:7113:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091709400/0x4076af6727515a98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144901.519327:0:7113:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091709400 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144901.519329:0:7113:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091709400/0x4076af6727515a98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144901.519336:0:7113:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091709400/0x4076af6727515a98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144901.519345:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bb2b400) 00010000:00010000:0.0:1746144901.519347:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144901.519350:0:7113:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091709400/0x4076af6727515a98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144901.519354:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091709400/0x4076af6727515a98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144901.519452:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091708200/0x4076af6727515a9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144901.519457:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091708200/0x4076af6727515a9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144901.519461:0:7113:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091708200/0x4076af6727515a9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144901.519464:0:7113:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091708200 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144901.519466:0:7113:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091708200/0x4076af6727515a9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144901.519470:0:7113:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091708200/0x4076af6727515a9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144901.519476:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf9ce3d8f (ffff88009bbca500) 00010000:00010000:0.0:1746144901.519478:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144901.519480:0:7113:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091708200/0x4076af6727515a9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144901.519484:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091708200/0x4076af6727515a9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf9ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144901.519505:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091709e00/0x4076af6727515a91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95431 expref: 10 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144901.519514:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091708400/0x4076af6727515aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95431 expref: 9 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144901.519519:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff88009bb2bf00) 00010000:00010000:0.0:1746144901.519521:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746144901.519523:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091708400, rc 0) 00000100:00100000:0.0:1746144901.519569:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:32235:x1830965175357056:12345-192.168.202.16@tcp:101:mmap_cat.0 Request processed in 885us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144901.519575:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48226 00000100:00100000:0.0:1746144901.521747:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.522087:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175357184 00000100:00100000:2.0:1746144901.522094:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175357184 00000100:00100000:2.0:1746144901.522131:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48227 00000100:00100000:2.0:1746144901.522137:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:32235:x1830965175357184:12345-192.168.202.16@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746144901.522151:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144901.522162:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091753c00/0x4076af6727515aad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95438 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.522209:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091753e00/0x4076af6727515ab4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522218:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091753e00/0x4076af6727515ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522225:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091753e00/0x4076af6727515ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522235:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091752a00/0x4076af6727515abb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522240:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091752a00/0x4076af6727515abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522244:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091752a00/0x4076af6727515abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522315:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091752c00/0x4076af6727515ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522321:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091752c00/0x4076af6727515ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522326:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091752c00/0x4076af6727515ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:2.0:1746144901.522348:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 1716 00000004:00200000:2.0:1746144901.522351:0:7113:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144901.522363:0:7113:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091752c00/0x4076af6727515ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522369:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091752c00/0x4076af6727515ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522375:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091753e00/0x4076af6727515ab4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522380:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091753e00/0x4076af6727515ab4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522384:0:7113:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091753e00/0x4076af6727515ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522391:0:7113:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091753e00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144901.522394:0:7113:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091753e00/0x4076af6727515ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522399:0:7113:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091753e00/0x4076af6727515ab4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522407:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff88009bb2bf00) 00010000:00010000:2.0:1746144901.522409:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144901.522411:0:7113:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091753e00/0x4076af6727515ab4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522415:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091753e00/0x4076af6727515ab4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522441:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091752a00/0x4076af6727515abb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522445:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091752a00/0x4076af6727515abb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522449:0:7113:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091752a00/0x4076af6727515abb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522453:0:7113:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091752a00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144901.522455:0:7113:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091752a00/0x4076af6727515abb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522459:0:7113:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091752a00/0x4076af6727515abb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522464:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0xf9ce3da1 (ffff8800922d3700) 00010000:00010000:2.0:1746144901.522465:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144901.522468:0:7113:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091752a00/0x4076af6727515abb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522472:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091752a00/0x4076af6727515abb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.522491:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091753c00/0x4076af6727515aad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95438 expref: 11 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.522500:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091752c00/0x4076af6727515ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95438 expref: 10 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.522505:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff88009bbcad00) 00010000:00010000:2.0:1746144901.522507:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144901.522508:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:2.0:1746144901.522546:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:32235:x1830965175357184:12345-192.168.202.16@tcp:101:mmap_cat.0 Request processed in 409us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144901.522551:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48227 00000100:00100000:0.0:1746144901.525461:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.525567:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175357312 00000100:00100000:2.0:1746144901.525577:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175357312 00000100:00100000:2.0:1746144901.525613:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5860 00000100:00100000:2.0:1746144901.525620:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:1981:x1830965175357312:12345-192.168.202.16@tcp:8:mmap_cat.0 00010000:00080000:2.0:1746144901.525642:0:8432:0:(ldlm_lib.c:1362:target_handle_connect()) lustre-OST0001: connection from 7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp t0 exp (null) cur 495 last 0 00000020:00000080:2.0:1746144901.525661:0:8432:0:(genops.c:1402:class_connect()) connect: client 7454cbaf-97e3-4716-92c6-77cd48a94a90, cookie 0x4076af6727515ac9 00002000:00100000:2.0:1746144901.525669:0:8432:0:(ofd_obd.c:124:ofd_parse_connect_data()) lustre-OST0001: cli 7454cbaf-97e3-4716-92c6-77cd48a94a90/ffff880091a50000 ocd_connect_flags: 0xa0465af2e3640078 ocd_version: 2103648 ocd_grant: 149946368 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1746144901.525676:0:8432:0:(ofd_obd.c:222:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:01000000:2.0:1746144901.525806:0:8432:0:(lprocfs_status_server.c:585:lprocfs_exp_setup()) using hash ffff88012b0afe40 00002000:00080000:2.0:1746144901.525811:0:8432:0:(ofd_obd.c:365:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1746144901.525831:0:8432:0:(import.c:66:import_set_state_nolock()) ffff880091a56000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1746144901.525881:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1981:x1830965175357312:12345-192.168.202.16@tcp:8:mmap_cat.0 Request processed in 247us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144901.525891:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5860 00000100:00100000:0.0:1746144901.528503:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.529037:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175357440 00000100:00100000:2.0:1746144901.529045:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175357440 00000100:00080000:0.0:1746144901.529160:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746144901.529328:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5861 00000100:00100000:2.0:1746144901.529336:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:0:x1830965175357440:12345-192.168.202.16@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746144901.529349:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144901.529362:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091753c00/0x4076af6727515ad0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9543f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144901.529402:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172538112:192.168.202.16@tcp:106: 00000100:00100000:2.0:1746144901.529477:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137345000 going to sleep for 11 seconds 00002000:00010000:2.0:1746144901.532406:0:8432:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size: 0 -> 1716 00002000:00010000:2.0:1746144901.532411:0:8432:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb mtime: 0 -> 1746144901 00002000:00010000:2.0:1746144901.532413:0:8432:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb atime: 0 -> 1746144901 00002000:00010000:2.0:1746144901.532415:0:8432:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb ctime: 0 -> 1746144901 00000100:00100000:2.0:1746144901.532436:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172538112:192.168.202.16@tcp:106: 00010000:00010000:2.0:1746144901.532463:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091753c00/0x4076af6727515ad0 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9543f expref: 7 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144901.532475:0:8432:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091753c00/0x4076af6727515ad0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9543f expref: 7 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144901.532501:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753c00, rc 0) 00000100:00100000:2.0:1746144901.532675:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:0:x1830965175357440:12345-192.168.202.16@tcp:101:mmap_cat.0 Request processed in 3338us (4176us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144901.532683:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5861 00000100:00100000:0.0:1746144901.537394:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144901.537481:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175357696 00000100:00100000:3.0:1746144901.537494:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175357696 00000100:00100000:3.0:1746144901.538059:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48228 00000100:00100000:3.0:1746144901.538068:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:32235:x1830965175357696:12345-192.168.202.16@tcp:101:mmap_cat.0 00010000:00010000:3.0:1746144901.538084:0:10400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144901.538099:0:10400:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515ad7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95446 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.538169:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727515ade lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.538180:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727515ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.538190:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727515ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000004:00200000:3.0:1746144901.538198:0:10400:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 1716 00010000:00010000:3.0:1746144901.538287:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515ad7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95446 expref: 13 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.538317:0:10400:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727515ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95446 expref: 12 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.538323:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff88009bbcad00) 00010000:00010000:3.0:1746144901.538326:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144901.538329:0:10400:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b467c00, rc 0) 00000100:00100000:3.0:1746144901.538372:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:32235:x1830965175357696:12345-192.168.202.16@tcp:101:mmap_cat.0 Request processed in 306us (984us total) trans 4294987488 rc 0/0 00000100:00100000:3.0:1746144901.538378:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48228 00000100:00100000:0.0:1746144901.542257:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144901.542350:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175357824 00000100:00100000:3.0:1746144901.542358:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175357824 00000100:00100000:3.0:1746144901.542405:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 291 00000100:00100000:3.0:1746144901.542412:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1983:x1830965175357824:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144901.542424:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144901.542443:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727515ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95446 expref: 12 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.543476:0:7098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff88009bbcad00) 00010000:00010000:3.0:1746144901.543482:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144901.543933:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+11:1983:x1830965175357824:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1519us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144901.543940:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 291 00000100:00100000:0.0:1746144901.544412:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.544586:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175357952 00000100:00100000:2.0:1746144901.544592:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175357952 00000100:00100000:2.0:1746144901.544615:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5862 00000100:00100000:2.0:1746144901.544620:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175357952:12345-192.168.202.16@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746144901.544630:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144901.544642:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091752e00/0x4076af6727515aec lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9544d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144901.544678:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172538240:192.168.202.16@tcp:106: 00000100:00100000:2.0:1746144901.544717:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137345000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144901.549726:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172538240:192.168.202.16@tcp:106: 00010000:00010000:2.0:1746144901.549757:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091752e00/0x4076af6727515aec lrc: 1/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9544d expref: 7 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144901.549801:0:8432:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091752e00/0x4076af6727515aec lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9544d expref: 7 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144901.549815:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752e00, rc 0) 00000100:00100000:2.0:1746144901.549864:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175357952:12345-192.168.202.16@tcp:101:mmap_cat.0 Request processed in 5243us (5451us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144901.549879:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5862 00000100:00100000:0.0:1746144901.555592:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.555658:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175358080 00000100:00100000:2.0:1746144901.555666:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175358080 00000100:00100000:2.0:1746144901.555716:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5863 00000100:00100000:2.0:1746144901.555723:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:32235:x1830965175358080:12345-192.168.202.16@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746144901.555736:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144901.555750:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091752a00/0x4076af6727515af3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95454 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.556063:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9541c expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.556071:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144901.556072:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144901.556076:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091752a00/0x4076af6727515af3 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95454 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.556100:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9541c expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.556110:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9541c expref: 6 pid: 8432 timeout: 595 lvb_type: 0 00000100:00100000:2.0:1746144901.556327:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172538368:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144901.556416:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137345000 going to sleep for 11 seconds 00000100:00100000:2.0:1746144901.559074:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172538368:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144901.559100:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091752a00/0x4076af6727515af3 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95454 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.559114:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752a00, rc 0) 00000100:00100000:2.0:1746144901.559160:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:32235:x1830965175358080:12345-192.168.202.16@tcp:101:mmap_cat.0 Request processed in 3436us (3575us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144901.559168:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5863 00000100:00100000:0.0:1746144901.561882:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144901.561945:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175358208 00000100:00100000:1.0:1746144901.561953:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175358208 00002000:00100000:1.0:1746144901.561989:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x19:0x0] (0->1715) req@ffff880091c29500 x1830965175358208/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:542/0 lens 2208/0 e 0 to 0 dl 1746144912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 00002000:00100000:1.0:1746144901.561997:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c29500 with x1830965175358208 ext(0->1715) 00010000:00010000:1.0:1746144901.562005:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9541c expref: 7 pid: 8432 timeout: 595 lvb_type: 0 00010000:00010000:1.0:1746144901.562017:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9541c expref: 7 pid: 8432 timeout: 595 lvb_type: 0 00002000:00010000:1.0:1746144901.562024:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091c29500 00000100:00100000:1.0:1746144901.562051:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2267 00000100:00100000:1.0:1746144901.562058:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175358208:12345-192.168.202.16@tcp:4:cp.0 00000001:00100000:1.0:1746144901.595900:0:9875:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7454cbaf-97e3-4716-92c6-77cd48a94a90 00000001:00100000:1.0:1746144901.595908:0:9875:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9d7af19e-38f7-44a8-82cf-031a58749c81 00000001:00100000:1.0:1746144901.595912:0:9875:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9d7af19e-38f7-44a8-82cf-031a58749c81 00000020:00000080:1.0:1746144901.595914:0:9875:0:(genops.c:904:class_export_put()) final put ffff880093fdb000/9d7af19e-38f7-44a8-82cf-031a58749c81 00000001:00100000:1.0:1746144901.595927:0:9875:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7454cbaf-97e3-4716-92c6-77cd48a94a90 00000020:00000080:1.0:1746144901.595929:0:9875:0:(genops.c:904:class_export_put()) final put ffff880093e44800/7454cbaf-97e3-4716-92c6-77cd48a94a90 00000100:00100000:0.0:1746144901.596249:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175358208:12345-192.168.202.16@tcp:4:cp.0 Request processed in 34186us (34378us total) trans 4294968534 rc 0/0 00000100:00100000:0.0:1746144901.596260:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2267 00002000:00100000:0.0:1746144901.596270:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x19:0x0] (0->1715) req@ffff880091c29500 x1830965175358208/t4294968534(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:542/0 lens 2208/448 e 0 to 0 dl 1746144912 ref 1 fl Complete:H/200/0 rc 0/0 job:'cp.0' uid:0 gid:0 00002000:00100000:0.0:1746144901.596284:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c29500 with x1830965175358208 ext(0->1715) 00010000:00010000:0.0:1746144901.596292:0:31844:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9541c expref: 8 pid: 8432 timeout: 595 lvb_type: 0 00010000:00010000:0.0:1746144901.596305:0:31844:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9541c expref: 8 pid: 8432 timeout: 595 lvb_type: 0 00002000:00010000:0.0:1746144901.596311:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091c29500 00000020:00000080:0.0:1746144901.596333:0:294:0:(genops.c:863:class_export_destroy()) destroying export ffff880093fdb000/9d7af19e-38f7-44a8-82cf-031a58749c81 for lustre-OST0001 00000020:00000080:0.0:1746144901.596357:0:294:0:(genops.c:863:class_export_destroy()) destroying export ffff880093e44800/7454cbaf-97e3-4716-92c6-77cd48a94a90 for lustre-OST0001 00000020:00000080:0.0:1746144901.596369:0:294:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff880093fde800 for lustre-OST0001 00000020:00000080:0.0:1746144901.596373:0:294:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff880093e44000 for lustre-OST0001 00000100:00100000:0.0:1746144901.600285:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144901.600446:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175358336 00000100:00100000:3.0:1746144901.600454:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175358336 00010000:00010000:3.0:1746144901.600487:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9541c expref: 8 pid: 8432 timeout: 595 lvb_type: 0 00000100:00100000:3.0:1746144901.600510:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11271 00000100:00100000:3.0:1746144901.600517:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175358336:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144901.600529:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144901.600547:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9541c expref: 8 pid: 8432 timeout: 595 lvb_type: 0 00010000:00010000:3.0:1746144901.600561:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9541c expref: 8 pid: 8432 timeout: 595 lvb_type: 0 00010000:00010000:3.0:1746144901.600579:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515a67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9541c expref: 8 pid: 8432 timeout: 595 lvb_type: 0 00010000:00010000:3.0:1746144901.600590:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144901.600592:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144901.600597:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091752a00/0x4076af6727515af3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95454 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.600604:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091752a00/0x4076af6727515af3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95454 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.600629:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091752a00/0x4076af6727515af3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95454 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144901.600639:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172538496:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144901.601295:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b44a780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144901.603092:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172538496:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144901.603114:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144901.603158:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175358336:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2640us (2879us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144901.603167:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11271 00000100:00100000:0.0:1746144901.604163:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.604233:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175358592 00000100:00100000:2.0:1746144901.604239:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175358592 00002000:00100000:2.0:1746144901.604271:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x19:0x0] (0->4095) req@ffff880091c29880 x1830965175358592/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:542/0 lens 488/0 e 0 to 0 dl 1746144912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144901.604280:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c29880 with x1830965175358592 ext(0->4095) 00002000:00010000:2.0:1746144901.604283:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c29880 00000100:00100000:2.0:1746144901.604297:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4216 00000100:00100000:2.0:1746144901.604303:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175358592:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144901.604735:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175358592:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 430us (573us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144901.604741:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4216 00002000:00100000:2.0:1746144901.604746:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x19:0x0] (0->4095) req@ffff880091c29880 x1830965175358592/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:542/0 lens 488/4536 e 0 to 0 dl 1746144912 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144901.604753:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c29880 with x1830965175358592 ext(0->4095) 00002000:00010000:2.0:1746144901.604756:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c29880 00000100:00100000:0.0:1746144901.607194:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144901.607393:0:7114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175358848 00000100:00100000:3.0:1746144901.607401:0:7114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175358848 00000100:00100000:3.0:1746144901.607449:0:7114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 153 00000100:00100000:3.0:1746144901.607456:0:7114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+11:32235:x1830965175358848:12345-192.168.202.16@tcp:35:mmap_cat.0 00000100:00100000:3.0:1746144901.607615:0:7114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:32235:x1830965175358848:12345-192.168.202.16@tcp:35:mmap_cat.0 Request processed in 159us (428us total) trans 4294987489 rc 0/0 00000100:00100000:3.0:1746144901.607621:0:7114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 153 00000100:00100000:0.0:1746144901.619548:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:0.0:1746144901.620795:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746144901.620854:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175359104 00000100:00100000:3.0:1746144901.620875:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175359104 00000100:00100000:3.0:1746144901.620922:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48229 00000100:00100000:3.0:1746144901.620929:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+13:32238:x1830965175359104:12345-192.168.202.16@tcp:36:truncate.0 00010000:00010000:3.0:1746144901.620978:0:10400:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144901.620997:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091708a00/0x4076af6727515a4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9540e expref: 13 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.621017:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff88009bbcad00) 00010000:00010000:3.0:1746144901.621020:0:10400:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144901.621168:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515afa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.621179:0:10400:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091752c00/0x4076af6727515ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95438 expref: 11 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.621185:0:10400:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515afa lrc: 4/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144901.621208:0:10400:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091752c00/0x4076af6727515ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95438 expref: 11 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.621217:0:10400:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091752c00/0x4076af6727515ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95438 expref: 11 pid: 7113 timeout: 595 lvb_type: 0 00000100:00100000:3.0:1746144901.621229:0:10400:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10400:1830965172538624:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144901.621310:0:10400:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b44a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144901.624951:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.625012:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175359232 00000100:00100000:2.0:1746144901.625018:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175359232 00010000:00010000:2.0:1746144901.625047:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091752c00/0x4076af6727515ac2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95438 expref: 12 pid: 7113 timeout: 595 lvb_type: 0 00000100:00100000:3.0:1746144901.625058:0:10400:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10400:1830965172538624:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144901.625069:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11272 00000100:00100000:2.0:1746144901.625074:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1985:x1830965175359232:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144901.625080:0:10400:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515afa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.625084:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144901.625089:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091752c00/0x4076af6727515ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95438 expref: 12 pid: 7113 timeout: 595 lvb_type: 0 00010000:00010000:2.0:1746144901.625098:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091752c00/0x4076af6727515ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95438 expref: 12 pid: 7113 timeout: 595 lvb_type: 0 00010000:00010000:2.0:1746144901.625114:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091752c00/0x4076af6727515ac2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95438 expref: 12 pid: 7113 timeout: 595 lvb_type: 0 00010000:00010000:2.0:1746144901.625137:0:7098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff88009bbcad00) 00010000:00010000:2.0:1746144901.625142:0:7098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515afa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.625154:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515afa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.625159:0:7098:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515afa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.625182:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144901.625202:0:10400:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515afa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.625209:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515afa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000001:00080000:0.0:1746144901.625302:0:10400:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294987490 00000004:00010000:0.0:1746144901.625339:0:10400:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093fa1c00 reply state ffff88013565f000 transno 4294987491 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515afa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000100:00100000:2.0:1746144901.625347:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+11:1985:x1830965175359232:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 271us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144901.625349:0:10400:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746144901.625352:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11272 00000100:00100000:0.0:1746144901.625405:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+15:32238:x1830965175359104:12345-192.168.202.16@tcp:36:truncate.0 Request processed in 4476us (5865us total) trans 4294987491 rc 0/0 00000100:00100000:0.0:1746144901.625411:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48229 00000020:00080000:0.0:1746144901.625414:0:10400:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1746144901.626717:0:3292:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515afa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.626725:0:3292:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515afa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.626731:0:3292:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515afa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.626735:0:3292:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b467600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144901.626739:0:3292:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515afa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.626744:0:3292:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515afa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.626754:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff88009bbcad00) 00010000:00010000:2.0:1746144901.626756:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144901.626758:0:3292:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515afa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144901.626775:0:3292:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467600/0x4076af6727515afa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00000100:00100000:0.0:1746144901.628074:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.628257:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175359360 00000100:00100000:2.0:1746144901.628263:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175359360 00000100:00100000:2.0:1746144901.628294:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5864 00000100:00100000:2.0:1746144901.628300:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:32238:x1830965175359360:12345-192.168.202.16@tcp:101:truncate.0 00010000:00010000:2.0:1746144901.628312:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144901.628325:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515b01 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9545b expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.628346:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091752a00/0x4076af6727515af3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95454 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.628352:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144901.628354:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144901.628356:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515b01 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9545b expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.628376:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091752a00/0x4076af6727515af3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95454 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.628386:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091752a00/0x4076af6727515af3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95454 expref: 5 pid: 8432 timeout: 595 lvb_type: 0 00000100:00100000:2.0:1746144901.628395:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172538752:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144901.628462:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137345b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144901.629479:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172538752:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144901.629498:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515b01 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9545b expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.629509:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753800, rc 0) 00000100:00100000:2.0:1746144901.629533:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:32238:x1830965175359360:12345-192.168.202.16@tcp:101:truncate.0 Request processed in 1232us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144901.629539:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5864 00000100:00100000:0.0:1746144901.629813:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144901.630152:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175359488 00000100:00100000:3.0:1746144901.630158:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175359488 00010000:00010000:3.0:1746144901.630179:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091752a00/0x4076af6727515af3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95454 expref: 6 pid: 8432 timeout: 595 lvb_type: 0 00000100:00100000:3.0:1746144901.630199:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11273 00000100:00100000:3.0:1746144901.630203:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175359488:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144901.630211:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144901.630225:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091752a00/0x4076af6727515af3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95454 expref: 6 pid: 8432 timeout: 595 lvb_type: 0 00010000:00010000:3.0:1746144901.630233:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091752a00/0x4076af6727515af3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95454 expref: 6 pid: 8432 timeout: 595 lvb_type: 0 00010000:00010000:3.0:1746144901.630247:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091752a00/0x4076af6727515af3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95454 expref: 6 pid: 8432 timeout: 595 lvb_type: 0 00010000:00010000:3.0:1746144901.630267:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144901.630269:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144901.630273:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515b01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9545b expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.630280:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515b01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9545b expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.630298:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515b01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9545b expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144901.630305:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172538880:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144901.630730:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b44a780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144901.632230:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144901.632307:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172538880:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144901.632311:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175359616 00000100:00100000:2.0:1746144901.632316:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175359616 00010000:00010000:3.0:1746144901.632325:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:2.0:1746144901.632341:0:31844:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/25 (858->18446744073709551615) 00002000:00100000:2.0:1746144901.632344:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0e00 with x1830965175359616 ext(858->18446744073709551615) 00002000:00010000:2.0:1746144901.632350:0:31844:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093fa0e00. 00000100:00100000:2.0:1746144901.632377:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4217 00000100:00100000:2.0:1746144901.632383:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175359616:12345-192.168.202.16@tcp:10:truncate.0 00000100:00100000:3.0:1746144901.632463:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175359488:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2257us (2649us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144901.632471:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11273 00002000:00010000:2.0:1746144901.632758:0:31844:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb size from disk: 1716 -> 858 00002000:00010000:2.0:1746144901.632794:0:31844:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb mtime from disk: 1746144901 -> 1746144902 00002000:00010000:2.0:1746144901.632797:0:31844:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb atime from disk: 1746144901 -> 0 00002000:00010000:2.0:1746144901.632799:0:31844:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb ctime from disk: 1746144901 -> 1746144902 00002000:00010000:2.0:1746144901.632801:0:31844:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746144901.632833:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175359616:12345-192.168.202.16@tcp:10:truncate.0 Request processed in 449us (606us total) trans 4294968535 rc 0/0 00000100:00100000:2.0:1746144901.632839:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4217 00002000:00010000:2.0:1746144901.632841:0:31844:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/25 (858->18446744073709551615) 00002000:00100000:2.0:1746144901.632843:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa0e00 with x1830965175359616 ext(858->18446744073709551615) 00002000:00010000:2.0:1746144901.632847:0:31844:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093fa0e00. 00000100:00100000:1.0:1746144901.644048:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144901.644132:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175359744 00000100:00100000:0.0:1746144901.644139:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175359744 00000100:00100000:0.0:1746144901.644184:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48230 00000100:00100000:0.0:1746144901.644191:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+14:32240:x1830965175359744:12345-192.168.202.16@tcp:101:mmap_cat.0 00010000:00010000:0.0:1746144901.644209:0:10400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144901.644225:0:10400:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c1c00/0x4076af6727515b08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95462 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144901.644274:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8c00/0x4076af6727515b0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644284:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8c00/0x4076af6727515b0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644293:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8c00/0x4076af6727515b0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644303:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8800/0x4076af6727515b16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644308:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8800/0x4076af6727515b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644314:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8800/0x4076af6727515b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644394:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8400/0x4076af6727515b1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644400:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8400/0x4076af6727515b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644405:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8400/0x4076af6727515b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000004:00200000:0.0:1746144901.644429:0:10400:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 858 00000004:00200000:0.0:1746144901.644432:0:10400:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144901.644444:0:10400:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8400/0x4076af6727515b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644451:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8400/0x4076af6727515b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644457:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8c00/0x4076af6727515b0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644462:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8c00/0x4076af6727515b0f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644467:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8c00/0x4076af6727515b0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644472:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0d8c00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144901.644476:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8c00/0x4076af6727515b0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644482:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8c00/0x4076af6727515b0f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644491:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff88009bb2bf00) 00010000:00010000:0.0:1746144901.644493:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144901.644496:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8c00/0x4076af6727515b0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644501:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8c00/0x4076af6727515b0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644528:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8800/0x4076af6727515b16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644532:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8800/0x4076af6727515b16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644537:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8800/0x4076af6727515b16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644541:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0d8800 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144901.644543:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8800/0x4076af6727515b16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644547:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8800/0x4076af6727515b16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644553:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0xf9ce3da1 (ffff88008a389b00) 00010000:00010000:0.0:1746144901.644554:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144901.644557:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8800/0x4076af6727515b16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644561:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8800/0x4076af6727515b16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:0.0:1746144901.644583:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943c1c00/0x4076af6727515b08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95462 expref: 16 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144901.644594:0:10400:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d0d8400/0x4076af6727515b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95462 expref: 15 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144901.644599:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff88009bbcad00) 00010000:00010000:0.0:1746144901.644601:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746144901.644603:0:10400:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d0d8400, rc 0) 00000100:00100000:0.0:1746144901.644653:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+15:32240:x1830965175359744:12345-192.168.202.16@tcp:101:mmap_cat.0 Request processed in 463us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144901.644659:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48230 00000100:00100000:0.0:1746144901.650382:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.650451:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175360000 00000100:00100000:2.0:1746144901.650458:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175360000 00002000:00100000:2.0:1746144901.650494:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x19:0x0] (0->4095) req@ffff880093fa3100 x1830965175360000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:542/0 lens 488/0 e 0 to 0 dl 1746144912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cp.0' uid:0 gid:0 00002000:00100000:2.0:1746144901.650502:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa3100 with x1830965175360000 ext(0->4095) 00002000:00010000:2.0:1746144901.650506:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093fa3100 00000100:00100000:2.0:1746144901.650578:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4218 00000100:00100000:2.0:1746144901.650586:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175360000:12345-192.168.202.16@tcp:3:cp.0 00000100:00100000:2.0:1746144901.651337:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175360000:12345-192.168.202.16@tcp:3:cp.0 Request processed in 750us (960us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144901.651343:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4218 00002000:00100000:2.0:1746144901.651349:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x19:0x0] (0->4095) req@ffff880093fa3100 x1830965175360000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:542/0 lens 488/4536 e 0 to 0 dl 1746144912 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cp.0' uid:0 gid:0 00002000:00100000:2.0:1746144901.651355:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa3100 with x1830965175360000 ext(0->4095) 00002000:00010000:2.0:1746144901.651358:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093fa3100 00000100:00100000:0.0:1746144901.668468:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.668577:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175360128 00000100:00100000:2.0:1746144901.668586:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175360128 00000100:00100000:2.0:1746144901.668625:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48231 00000100:00100000:2.0:1746144901.668632:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+11:32244:x1830965175360128:12345-192.168.202.16@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746144901.668653:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144901.668668:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091752e00/0x4076af6727515b24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95469 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.668715:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091753000/0x4076af6727515b2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668725:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091753000/0x4076af6727515b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668739:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091753000/0x4076af6727515b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668750:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091752200/0x4076af6727515b32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668754:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091752200/0x4076af6727515b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668759:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091752200/0x4076af6727515b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668856:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091753e00/0x4076af6727515b39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668862:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091753e00/0x4076af6727515b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668878:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091753e00/0x4076af6727515b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:2.0:1746144901.668900:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 858 00000004:00200000:2.0:1746144901.668904:0:7113:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144901.668916:0:7113:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091753e00/0x4076af6727515b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668922:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091753e00/0x4076af6727515b39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668929:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091753000/0x4076af6727515b2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668934:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091753000/0x4076af6727515b2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668939:0:7113:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091753000/0x4076af6727515b2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668944:0:7113:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091753000 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144901.668947:0:7113:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091753000/0x4076af6727515b2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668952:0:7113:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091753000/0x4076af6727515b2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668960:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff88009bb2bf00) 00010000:00010000:2.0:1746144901.668962:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144901.668965:0:7113:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091753000/0x4076af6727515b2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668968:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091753000/0x4076af6727515b2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668991:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091752200/0x4076af6727515b32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.668996:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091752200/0x4076af6727515b32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.669000:0:7113:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091752200/0x4076af6727515b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.669003:0:7113:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091752200 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144901.669005:0:7113:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091752200/0x4076af6727515b32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.669009:0:7113:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091752200/0x4076af6727515b32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.669014:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0xf9ce3da1 (ffff8800922d3900) 00010000:00010000:2.0:1746144901.669016:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144901.669018:0:7113:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091752200/0x4076af6727515b32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.669021:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091752200/0x4076af6727515b32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0xf9ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.669042:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091752e00/0x4076af6727515b24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95469 expref: 13 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.669053:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091753e00/0x4076af6727515b39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95469 expref: 12 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.669058:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff88009bbcad00) 00010000:00010000:2.0:1746144901.669060:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144901.669061:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091753e00, rc 0) 00000100:00100000:2.0:1746144901.669431:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:32244:x1830965175360128:12345-192.168.202.16@tcp:101:mmap_cat.0 Request processed in 798us (968us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144901.669437:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48231 00000100:00100000:0.0:1746144901.671315:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.671429:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175360256 00000100:00100000:2.0:1746144901.671435:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175360256 00000100:00100000:2.0:1746144901.671462:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5865 00000100:00100000:2.0:1746144901.671468:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175360256:12345-192.168.202.16@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746144901.671481:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144901.671492:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091752c00/0x4076af6727515b40 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95470 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144901.671531:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172539008:192.168.202.16@tcp:106: 00000100:00100000:2.0:1746144901.671798:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137345780 going to sleep for 11 seconds 00002000:00010000:2.0:1746144901.672814:0:8432:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x19:0x0] updating lvb atime: 0 -> 1746144902 00000100:00100000:2.0:1746144901.672832:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172539008:192.168.202.16@tcp:106: 00010000:00010000:2.0:1746144901.672859:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091752c00/0x4076af6727515b40 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95470 expref: 6 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144901.672880:0:8432:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091752c00/0x4076af6727515b40 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95470 expref: 6 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144901.672889:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091752c00, rc 0) 00000100:00100000:2.0:1746144901.672927:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175360256:12345-192.168.202.16@tcp:101:mmap_cat.0 Request processed in 1458us (1617us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144901.672932:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5865 00000100:00100000:0.0:1746144901.674418:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.674466:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175360512 00000100:00100000:2.0:1746144901.674471:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175360512 00000100:00100000:2.0:1746144901.674513:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48232 00000100:00100000:2.0:1746144901.674525:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:32244:x1830965175360512:12345-192.168.202.16@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746144901.674541:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144901.674554:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30e00/0x4076af6727515b47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95477 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.674622:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad31a00/0x4076af6727515b4e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.674633:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad31a00/0x4076af6727515b4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144901.674641:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad31a00/0x4076af6727515b4e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:2.0:1746144901.674649:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 858 00010000:00010000:2.0:1746144901.674737:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30e00/0x4076af6727515b47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x47:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95477 expref: 15 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.674750:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad31a00/0x4076af6727515b4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95477 expref: 14 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.674755:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff88009bbcad00) 00010000:00010000:2.0:1746144901.674758:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746144901.674760:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad31a00, rc 0) 00000100:00100000:2.0:1746144901.674817:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:32244:x1830965175360512:12345-192.168.202.16@tcp:101:mmap_cat.0 Request processed in 298us (403us total) trans 4294987492 rc 0/0 00000100:00100000:2.0:1746144901.674822:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48232 00000100:00100000:0.0:1746144901.676451:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.676530:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175360640 00000100:00100000:2.0:1746144901.676535:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175360640 00000100:00100000:2.0:1746144901.676566:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5866 00000100:00100000:2.0:1746144901.676572:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175360640:12345-192.168.202.16@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746144901.676584:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144901.676719:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad31600/0x4076af6727515b5c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9547e expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144901.676785:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172539136:192.168.202.16@tcp:106: 00000100:00100000:2.0:1746144901.676878:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137345780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144901.678525:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172539136:192.168.202.16@tcp:106: 00010000:00010000:2.0:1746144901.678549:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad31600/0x4076af6727515b5c lrc: 1/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9547e expref: 6 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144901.678561:0:8432:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad31600/0x4076af6727515b5c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9547e expref: 6 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144901.678582:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad31600, rc 0) 00000100:00100000:2.0:1746144901.678611:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175360640:12345-192.168.202.16@tcp:101:mmap_cat.0 Request processed in 2038us (2162us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144901.678617:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5866 00000100:00100000:0.0:1746144901.681423:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.681553:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175360768 00000100:00100000:2.0:1746144901.681560:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175360768 00000100:00100000:2.0:1746144901.681699:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5867 00000100:00100000:2.0:1746144901.681707:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:32244:x1830965175360768:12345-192.168.202.16@tcp:101:mmap_cat.0 00010000:00010000:2.0:1746144901.681723:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144901.681737:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad31200/0x4076af6727515b63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95485 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.681792:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515b01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9545b expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.681800:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144901.681801:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144901.681805:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad31200/0x4076af6727515b63 lrc: 4/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95485 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.681828:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515b01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9545b expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.681838:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515b01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9545b expref: 8 pid: 8432 timeout: 595 lvb_type: 0 00000100:00100000:2.0:1746144901.681848:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172539264:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144901.681927:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137345780 going to sleep for 11 seconds 00000100:00100000:0.0:1746144901.684065:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144901.684126:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175360896 00000100:00100000:3.0:1746144901.684133:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175360896 00000100:00100000:2.0:1746144901.684154:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172539264:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144901.684167:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515b01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9545b expref: 9 pid: 8432 timeout: 595 lvb_type: 0 00010000:00010000:2.0:1746144901.684176:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad31200/0x4076af6727515b63 lrc: 3/0,0 mode: --/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95485 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144901.684187:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad31200, rc 0) 00000100:00100000:3.0:1746144901.684188:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11274 00000100:00100000:3.0:1746144901.684194:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175360896:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144901.684203:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144901.684220:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515b01 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9545b expref: 9 pid: 8432 timeout: 595 lvb_type: 0 00000100:00100000:2.0:1746144901.684231:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:32244:x1830965175360768:12345-192.168.202.16@tcp:101:mmap_cat.0 Request processed in 2524us (3536us total) trans 0 rc 0/0 00010000:00010000:3.0:1746144901.684233:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515b01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9545b expref: 9 pid: 8432 timeout: 595 lvb_type: 0 00000100:00100000:2.0:1746144901.684237:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5867 00010000:00010000:3.0:1746144901.684251:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091753800/0x4076af6727515b01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9545b expref: 9 pid: 8432 timeout: 595 lvb_type: 0 00010000:00010000:3.0:1746144901.684263:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144901.684265:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144901.684270:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad31200/0x4076af6727515b63 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95485 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.684276:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad31200/0x4076af6727515b63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95485 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144901.684299:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad31200/0x4076af6727515b63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95485 expref: 5 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144901.684308:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172539392:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144901.684349:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009b44a780 going to sleep for 11 seconds 00000100:00100000:3.0:1746144901.687916:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172539392:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144901.687940:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144901.687981:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175360896:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3786us (3921us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144901.688351:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11274 00000100:00100000:0.0:1746144901.688425:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144901.688790:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175361152 00000100:00100000:2.0:1746144901.688796:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175361152 00002000:00100000:2.0:1746144901.688827:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x19:0x0] (0->4095) req@ffff880093fa2300 x1830965175361152/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:542/0 lens 488/0 e 0 to 0 dl 1746144912 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144901.688841:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa2300 with x1830965175361152 ext(0->4095) 00002000:00010000:2.0:1746144901.688845:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093fa2300 00000100:00100000:2.0:1746144901.688877:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4219 00000100:00100000:2.0:1746144901.688884:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175361152:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 00000100:00100000:2.0:1746144901.689031:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1985:x1830965175361152:12345-192.168.202.16@tcp:3:ptlrpcd_01_01.0 Request processed in 147us (606us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144901.689036:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4219 00002000:00100000:2.0:1746144901.689041:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x19:0x0] (0->4095) req@ffff880093fa2300 x1830965175361152/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:542/0 lens 488/4536 e 0 to 0 dl 1746144912 ref 1 fl Complete:/200/0 rc 4096/4096 job:'ptlrpcd_01_01.0' uid:4294967295 gid:4294967295 00002000:00100000:2.0:1746144901.689048:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa2300 with x1830965175361152 ext(0->4095) 00002000:00010000:2.0:1746144901.689051:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093fa2300 00000100:00100000:0.0:1746144902.077915:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172539520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746144902.077965:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746144902.078085:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172539520 00000100:00100000:2.0:1746144902.078091:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172539520 00000100:00100000:2.0:1746144902.078133:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1746144902.078139:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1830965172539520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1746144902.078165:0:8435:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 378077184 pending 0 free 3855613952 avail 3853516800 00000100:00100000:2.0:1746144902.078195:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1830965172539520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144902.078199:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1746144902.078247:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144902.078273:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172539520:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1746144902.621893:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144902.878545:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144902.878589:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144902.878618:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144902.878634:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144902.878661:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144902.878673:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144902.878716:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144902.878737:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175361408 00000100:00100000:0.0:1746144902.878743:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175361408 00000100:00100000:0.0:1746144902.878798:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175361792 00000100:00100000:0.0:1746144902.878800:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175361792 00000100:00100000:0.0:1746144902.878813:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 325 00000100:00100000:0.0:1746144902.878818:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+15:1985:x1830965175361408:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144902.878893:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+15:1985:x1830965175361408:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 74us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144902.878899:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 325 00000100:00100000:0.0:1746144902.878912:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 326 00000100:00100000:0.0:1746144902.878916:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1984:x1830965175361792:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144902.878939:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1984:x1830965175361792:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 23us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144902.878944:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 326 00000100:00100000:0.0:1746144902.879044:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175361664 00000100:00100000:0.0:1746144902.879047:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175361664 00000100:00100000:0.0:1746144902.879064:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175361536 00000100:00100000:0.0:1746144902.879065:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175361536 00000100:00100000:0.0:1746144902.879077:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175361920 00000100:00100000:0.0:1746144902.879079:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175361920 00000100:00100000:0.0:1746144902.879090:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175362048 00000100:00100000:0.0:1746144902.879091:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175362048 00000100:00100000:0.0:1746144902.879100:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 396 00000100:00100000:0.0:1746144902.879104:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175361664:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144902.879127:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175361664:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 23us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144902.879133:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 396 00000100:00100000:0.0:1746144902.879141:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 397 00000100:00100000:0.0:1746144902.879145:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1984:x1830965175361536:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144902.879162:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1984:x1830965175361536:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 16us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144902.879166:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 397 00000100:00100000:0.0:1746144902.879173:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 398 00000100:00100000:0.0:1746144902.879176:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175361920:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144902.879190:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1985:x1830965175361920:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 13us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144902.879194:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 398 00000100:00100000:0.0:1746144902.879199:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 399 00000100:00100000:0.0:1746144902.879202:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175362048:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144902.879215:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175362048:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 12us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144902.879218:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 399 00000100:00080000:0.0:1746144902.879231:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746144902.879400:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175361280 00000100:00100000:3.0:1746144902.879405:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175361280 00000100:00100000:3.0:1746144902.879427:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 375 00000100:00100000:3.0:1746144902.879432:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4574b85-29c1-4863-b96a-3fe350afea52+12:1984:x1830965175361280:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1746144902.879458:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4574b85-29c1-4863-b96a-3fe350afea52+12:1984:x1830965175361280:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 25us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144902.879463:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 375 00000001:00080000:2.0:1746144902.954303:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294968054 is committed 00000001:00080000:2.0:1746144903.456932:0:7157:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294987491 is committed 00000001:00080000:2.0:1746144903.456949:0:7157:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294987492 is committed 00010000:00010000:3.0:1746144903.624373:0:7101:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1746144903.985141:0:3716:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 16i: read after truncate file ============ 20:15:03 (1746144903) 00000100:00100000:1.0:1746144904.016901:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144904.017039:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175362304 00000100:00100000:3.0:1746144904.017046:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175362304 00000100:00080000:0.0:1746144904.017094:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746144904.017095:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48233 00000100:00100000:3.0:1746144904.017103:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:406:x1830965175362304:12345-192.168.202.16@tcp:36:mkdir.0 00010000:00010000:3.0:1746144904.017147:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144904.017195:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130d6dc00/0x4076af67275159e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af953f2 expref: 9 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.017209:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bb2b400) 00010000:00010000:3.0:1746144904.017213:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144904.017288:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515b6a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.017299:0:7113:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af6727515a8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9542a expref: 10 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.017305:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515b6a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.017614:0:7113:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af6727515a8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9542a expref: 10 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.017631:0:7113:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af6727515a8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9542a expref: 10 pid: 7113 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1746144904.017734:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7113:1830965172539648:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144904.017830:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008bae73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144904.019445:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144904.019468:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7113:1830965172539648:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144904.019494:0:7113:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515b6a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000100:00100000:3.0:1746144904.019513:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175362432 00000100:00100000:3.0:1746144904.019517:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175362432 00010000:00010000:3.0:1746144904.019547:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af6727515a8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9542a expref: 11 pid: 7113 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1746144904.019579:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11275 00000100:00100000:3.0:1746144904.019585:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+11:1985:x1830965175362432:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144904.019596:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144904.019600:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af6727515a8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9542a expref: 11 pid: 7113 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1746144904.019610:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af6727515a8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9542a expref: 11 pid: 7113 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1746144904.019625:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091709c00/0x4076af6727515a8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9542a expref: 11 pid: 7113 timeout: 598 lvb_type: 0 00000100:00080000:0.0:1746144904.019851:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1746144904.019901:0:7098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bb2b400) 00010000:00010000:3.0:1746144904.019906:0:7098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515b6a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.019913:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515b6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.019919:0:7098:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515b6a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.019936:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144904.019968:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1985:x1830965175362432:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 382us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144904.019974:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11275 00010000:00010000:3.0:1746144904.019992:0:7113:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515b6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.019997:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515b6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.020009:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515b71 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.020017:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515b71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.020023:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515b71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:3.0:1746144904.020963:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 512 00010000:00010000:3.0:1746144904.020971:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515b6a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.020977:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515b6a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.020986:0:7113:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515b6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.020991:0:7113:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0f2a00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144904.020993:0:7113:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515b6a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.020999:0:7113:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515b6a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.021007:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bb2b400) 00010000:00010000:3.0:1746144904.021010:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144904.021012:0:7113:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515b6a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.021016:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515b6a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00000004:00010000:3.0:1746144904.021026:0:7113:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880087c5f480 reply state ffff880091a9c000 transno 4294987493 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515b71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000100:00100000:3.0:1746144904.021032:0:7113:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1746144904.021086:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+10:406:x1830965175362304:12345-192.168.202.16@tcp:36:mkdir.0 Request processed in 3983us (4195us total) trans 4294987493 rc 0/0 00000100:00100000:3.0:1746144904.021092:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48233 00010000:00010000:3.0:1746144904.024787:0:3293:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515b71 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.024799:0:3293:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515b71 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.024806:0:3293:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515b71 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.024812:0:3293:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b466600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144904.024815:0:3293:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515b71 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.024821:0:3293:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515b71 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.024835:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ce3d8f (ffff88009bb2b200) 00010000:00010000:3.0:1746144904.024838:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144904.024842:0:3293:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515b71 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.024873:0:3293:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515b71 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00000100:00100000:1.0:1746144904.032094:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144904.032344:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175362560 00000100:00100000:3.0:1746144904.032352:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175362560 00000100:00100000:3.0:1746144904.032390:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48234 00000100:00100000:3.0:1746144904.032398:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:408:x1830965175362560:12345-192.168.202.16@tcp:101:cp.0 00010000:00010000:3.0:1746144904.032415:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144904.032430:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099312a00/0x4076af6727515b78 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9548c expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.032475:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099312600/0x4076af6727515b7f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.032485:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099312600/0x4076af6727515b7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.032494:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099312600/0x4076af6727515b7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:3.0:1746144904.032539:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:3.0:1746144904.032542:0:7113:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 26 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144904.032553:0:7113:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099312600/0x4076af6727515b7f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.032570:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099312a00/0x4076af6727515b78 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9548c expref: 11 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.032580:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099312600/0x4076af6727515b7f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9548c expref: 10 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.032586:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bb2b100) 00010000:00010000:3.0:1746144904.032588:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746144904.032591:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099312600, rc 0) 00000100:00100000:3.0:1746144904.032626:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+10:408:x1830965175362560:12345-192.168.202.16@tcp:101:cp.0 Request processed in 229us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144904.032632:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48234 00000100:00100000:0.0:1746144904.037357:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144904.037385:0:20492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175362688 00000100:00100000:0.0:1746144904.037392:0:20492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175362688 00000100:00100000:0.0:1746144904.037432:0:20492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48235 00000100:00100000:0.0:1746144904.037440:0:20492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+10:408:x1830965175362688:12345-192.168.202.16@tcp:101:cp.0 00010000:00010000:0.0:1746144904.037457:0:20492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144904.037472:0:20492:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7bc00/0x4076af6727515b86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95493 expref: -99 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144904.037521:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b800/0x4076af6727515b8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037532:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b800/0x4076af6727515b8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037542:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b800/0x4076af6727515b8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037551:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b000/0x4076af6727515b94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037557:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b000/0x4076af6727515b94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037562:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b000/0x4076af6727515b94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037651:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167e00/0x4076af6727515b9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037658:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093167e00/0x4076af6727515b9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037664:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093167e00/0x4076af6727515b9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00000004:00200000:0.0:1746144904.037686:0:20492:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 512 00000004:00200000:0.0:1746144904.037689:0:20492:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144904.037701:0:20492:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880093167e00/0x4076af6727515b9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037709:0:20492:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b800/0x4076af6727515b8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037714:0:20492:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b800/0x4076af6727515b8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037719:0:20492:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b800/0x4076af6727515b8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037723:0:20492:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ba7b800 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144904.037727:0:20492:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b800/0x4076af6727515b8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037733:0:20492:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b800/0x4076af6727515b8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037742:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bb2b100) 00010000:00010000:0.0:1746144904.037745:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144904.037748:0:20492:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b800/0x4076af6727515b8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037752:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b800/0x4076af6727515b8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037775:0:20492:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b000/0x4076af6727515b94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037781:0:20492:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b000/0x4076af6727515b94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037785:0:20492:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b000/0x4076af6727515b94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037793:0:20492:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ba7b000 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144904.037795:0:20492:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b000/0x4076af6727515b94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037799:0:20492:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b000/0x4076af6727515b94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037805:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ce3d8f (ffff88008a389d00) 00010000:00010000:0.0:1746144904.037807:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144904.037809:0:20492:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b000/0x4076af6727515b94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037819:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7b000/0x4076af6727515b94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:0.0:1746144904.037841:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7bc00/0x4076af6727515b86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95493 expref: 12 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144904.037859:0:20492:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167e00/0x4076af6727515b9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95493 expref: 11 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144904.037865:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff88008a389f00) 00010000:00010000:0.0:1746144904.037866:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1746144904.037868:0:20492:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093167e00, rc 0) 00000100:00100000:0.0:1746144904.038089:0:20492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+11:408:x1830965175362688:12345-192.168.202.16@tcp:101:cp.0 Request processed in 649us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144904.038095:0:20492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48235 00000100:00100000:0.0:1746144904.039487:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144904.039579:0:20492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175362816 00000100:00100000:1.0:1746144904.039585:0:20492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175362816 00000100:00100000:1.0:1746144904.039623:0:20492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48236 00000100:00100000:1.0:1746144904.039630:0:20492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+11:408:x1830965175362816:12345-192.168.202.16@tcp:101:cp.0 00010000:00010000:1.0:1746144904.039644:0:20492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144904.039656:0:20492:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8200/0x4076af6727515ba2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9549a expref: -99 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144904.039694:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8400/0x4076af6727515ba9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039703:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8400/0x4076af6727515ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039711:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8400/0x4076af6727515ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039720:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8800/0x4076af6727515bb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039724:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8800/0x4076af6727515bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039729:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8800/0x4076af6727515bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039790:0:20492:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8400/0x4076af6727515ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039796:0:20492:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8400/0x4076af6727515ba9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039801:0:20492:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8400/0x4076af6727515ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039809:0:20492:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800943b8400 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144904.039812:0:20492:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8400/0x4076af6727515ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039817:0:20492:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8400/0x4076af6727515ba9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039825:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff88008a389f00) 00010000:00010000:1.0:1746144904.039828:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144904.039830:0:20492:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8400/0x4076af6727515ba9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039835:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8400/0x4076af6727515ba9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039854:0:20492:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8800/0x4076af6727515bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039858:0:20492:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8800/0x4076af6727515bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039863:0:20492:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8800/0x4076af6727515bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039866:0:20492:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800943b8800 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144904.039868:0:20492:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8800/0x4076af6727515bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039872:0:20492:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8800/0x4076af6727515bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039877:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x2ce3da1 (ffff88009bbcab00) 00010000:00010000:1.0:1746144904.039880:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144904.039882:0:20492:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8800/0x4076af6727515bb0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039885:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8800/0x4076af6727515bb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:1.0:1746144904.039913:0:20492:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8200/0x4076af6727515ba2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9549a expref: 12 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144904.039918:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800943b8200/0x4076af6727515ba2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9549a expref: 12 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144904.039925:0:20492:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800943b8200, rc 0) 00000100:00100000:1.0:1746144904.039954:0:20492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+11:408:x1830965175362816:12345-192.168.202.16@tcp:101:cp.0 Request processed in 324us (470us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144904.039959:0:20492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48236 00000100:00100000:0.0:1746144904.041651:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144904.041731:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175362944 00000100:00100000:3.0:1746144904.041737:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175362944 00000100:00100000:3.0:1746144904.041778:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48237 00000100:00100000:3.0:1746144904.041784:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+11:408:x1830965175362944:12345-192.168.202.16@tcp:101:cp.0 00010000:00010000:3.0:1746144904.041796:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144904.041806:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515bb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af954a1 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.041841:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099312e00/0x4076af6727515bbe lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041863:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099312e00/0x4076af6727515bbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041872:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099312e00/0x4076af6727515bbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041882:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515bc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041888:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041893:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041930:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099312e00/0x4076af6727515bbe lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041935:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099312e00/0x4076af6727515bbe lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041940:0:7113:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099312e00/0x4076af6727515bbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041944:0:7113:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099312e00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144904.041947:0:7113:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099312e00/0x4076af6727515bbe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041952:0:7113:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099312e00/0x4076af6727515bbe lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041959:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff88008a389f00) 00010000:00010000:3.0:1746144904.041962:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144904.041964:0:7113:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099312e00/0x4076af6727515bbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041969:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099312e00/0x4076af6727515bbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041977:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041981:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515bc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041985:0:7113:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041989:0:7113:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a41edc00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144904.041991:0:7113:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.041995:0:7113:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515bc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.042000:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x2ce3da1 (ffff88009bb2be00) 00010000:00010000:3.0:1746144904.042002:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144904.042003:0:7113:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515bc5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.042007:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515bc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.042029:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515bb7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954a1 expref: 12 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.042036:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0f2a00/0x4076af6727515bb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954a1 expref: 12 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.042042:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0f2a00, rc 0) 00000100:00100000:3.0:1746144904.042448:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+11:408:x1830965175362944:12345-192.168.202.16@tcp:101:cp.0 Request processed in 663us (800us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144904.042454:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48237 00000100:00100000:0.0:1746144904.045356:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144904.045502:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175363200 00000100:00100000:3.0:1746144904.045510:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175363200 00000100:00100000:3.0:1746144904.045614:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48238 00000100:00100000:3.0:1746144904.045621:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+11:408:x1830965175363200:12345-192.168.202.16@tcp:101:cp.0 00010000:00010000:3.0:1746144904.045636:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144904.045650:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed600/0x4076af6727515bcc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af954a8 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.046053:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515bd3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.046065:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515bd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.046074:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515bd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.046084:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ec400/0x4076af6727515bda lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.046090:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ec400/0x4076af6727515bda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.046095:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ec400/0x4076af6727515bda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00080000:3.0:1746144904.046636:0:7113:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x19:0x0], index 0: 0 00010000:00010000:3.0:1746144904.046750:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481e00/0x4076af6727515be1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.046907:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481e00/0x4076af6727515be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.046914:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481e00/0x4076af6727515be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.046939:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515bd3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.046945:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515bd3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.046950:0:7113:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515bd3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.046954:0:7113:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a41ed000 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144904.046957:0:7113:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515bd3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.046962:0:7113:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515bd3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.046970:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff88008a389f00) 00010000:00010000:3.0:1746144904.046973:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144904.046976:0:7113:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515bd3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.046980:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515bd3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00000004:00010000:3.0:1746144904.046988:0:7113:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009258c380 reply state ffff880091a98000 transno 4294987494 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ec400/0x4076af6727515bda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000100:00100000:3.0:1746144904.046993:0:7113:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746144904.047013:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed600/0x4076af6727515bcc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954a8 expref: 14 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.047022:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481e00/0x4076af6727515be1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954a8 expref: 13 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.047028:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff88009bb2ba00) 00010000:00010000:3.0:1746144904.047030:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144904.047032:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5481e00, rc 0) 00000100:00100000:3.0:1746144904.047789:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+14:408:x1830965175363200:12345-192.168.202.16@tcp:101:cp.0 Request processed in 2167us (2437us total) trans 4294987494 rc 0/0 00000100:00100000:3.0:1746144904.047795:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48238 00010000:00010000:3.0:1746144904.050574:0:3292:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ec400/0x4076af6727515bda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.050586:0:3292:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ec400/0x4076af6727515bda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.050592:0:3292:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ec400/0x4076af6727515bda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.050596:0:3292:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a41ec400 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144904.050600:0:3292:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ec400/0x4076af6727515bda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.050605:0:3292:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ec400/0x4076af6727515bda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.050617:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x2ce3da1 (ffff88009bb2b900) 00010000:00010000:3.0:1746144904.050619:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144904.050622:0:3292:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ec400/0x4076af6727515bda lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.050630:0:3292:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ec400/0x4076af6727515bda lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00000100:00100000:1.0:1746144904.053180:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144904.053206:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175363328 00000100:00100000:1.0:1746144904.053213:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175363328 00000100:00100000:1.0:1746144904.053729:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5868 00000100:00100000:1.0:1746144904.053737:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1985:x1830965175363328:12345-192.168.202.16@tcp:101:cp.0 00010000:00010000:1.0:1746144904.053751:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144904.053789:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093f06000/0x4076af6727515bef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af954af expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144904.053811:0:10401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1746144904.053827:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144904.053829:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144904.053836:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093f06000/0x4076af6727515bef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954af expref: 6 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144904.053860:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093f06000/0x4076af6727515bef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954af expref: 6 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144904.053870:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093f06000, rc 0) 00000100:00100000:1.0:1746144904.053907:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1985:x1830965175363328:12345-192.168.202.16@tcp:101:cp.0 Request processed in 171us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144904.053913:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5868 00000100:00080000:1.0:1746144904.053930:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144904.057697:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144904.057736:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175363456 00000100:00100000:0.0:1746144904.057743:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175363456 00000100:00100000:0.0:1746144904.057794:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5869 00000100:00100000:0.0:1746144904.057802:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+6:408:x1830965175363456:12345-192.168.202.16@tcp:101:cp.0 00010000:00010000:0.0:1746144904.057814:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144904.057828:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af954b6 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144904.057861:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093f06000/0x4076af6727515bef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954af expref: 7 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144904.057869:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144904.057871:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144904.057874:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954b6 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144904.057896:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093f06000/0x4076af6727515bef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954af expref: 7 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144904.057906:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093f06000/0x4076af6727515bef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954af expref: 7 pid: 10401 timeout: 598 lvb_type: 1 00000100:00100000:0.0:1746144904.057916:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009258d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172539776:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144904.057982:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43b1780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144904.059859:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009258d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172539776:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144904.059885:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954b6 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.059899:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093167600, rc 0) 00000100:00100000:2.0:1746144904.059932:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+7:408:x1830965175363456:12345-192.168.202.16@tcp:101:cp.0 Request processed in 2131us (2243us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144904.059939:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5869 00000100:00100000:1.0:1746144904.061709:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144904.061786:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175363584 00000100:00100000:3.0:1746144904.061792:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175363584 00010000:00010000:3.0:1746144904.061817:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093f06000/0x4076af6727515bef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954af expref: 7 pid: 10401 timeout: 598 lvb_type: 1 00000100:00100000:3.0:1746144904.061839:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11276 00000100:00100000:3.0:1746144904.061857:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175363584:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144904.061867:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144904.061885:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093f06000/0x4076af6727515bef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954af expref: 7 pid: 10401 timeout: 598 lvb_type: 1 00010000:00010000:3.0:1746144904.061895:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093f06000/0x4076af6727515bef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954af expref: 7 pid: 10401 timeout: 598 lvb_type: 1 00010000:00010000:3.0:1746144904.061915:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093f06000/0x4076af6727515bef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954af expref: 7 pid: 10401 timeout: 598 lvb_type: 1 00010000:00010000:3.0:1746144904.061925:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144904.061926:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144904.061932:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954b6 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.061938:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954b6 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.061968:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954b6 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144904.061978:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172539904:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144904.062037:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008bae73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144904.063084:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172539904:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144904.063097:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144904.063132:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175363584:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1287us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144904.063139:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11276 00000100:00100000:2.0:1746144904.064348:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144904.064417:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175363840 00000100:00100000:1.0:1746144904.064422:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175363840 00000100:00100000:1.0:1746144904.064451:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 154 00000100:00100000:1.0:1746144904.064458:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a621d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+13:408:x1830965175363840:12345-192.168.202.16@tcp:35:cp.0 00000100:00100000:1.0:1746144904.065200:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a621d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+14:408:x1830965175363840:12345-192.168.202.16@tcp:35:cp.0 Request processed in 741us (853us total) trans 4294987495 rc 0/0 00000100:00100000:1.0:1746144904.065206:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 154 00000100:00100000:0.0:1746144904.088353:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144904.088414:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175364096 00000100:00100000:3.0:1746144904.088422:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175364096 00000100:00100000:3.0:1746144904.088470:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48239 00000100:00100000:3.0:1746144904.088477:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+14:411:x1830965175364096:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:3.0:1746144904.088498:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144904.088513:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x4076af6727515bfd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af954bd expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.088595:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480400/0x4076af6727515c04 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.088604:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480400/0x4076af6727515c04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.088613:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480400/0x4076af6727515c04 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:3.0:1746144904.088624:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4a:0x0]: returning size 1716 00010000:00010000:3.0:1746144904.089574:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x4076af6727515bfd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954bd expref: 17 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.089603:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480400/0x4076af6727515c04 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4a:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954bd expref: 16 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.089609:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff88009bb2ba00) 00010000:00010000:3.0:1746144904.089611:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746144904.089613:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5480400, rc 0) 00000100:00100000:3.0:1746144904.089669:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+16:411:x1830965175364096:12345-192.168.202.16@tcp:101:dd.0 Request processed in 1191us (1323us total) trans 4294987496 rc 0/0 00000100:00100000:3.0:1746144904.089676:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48239 00000100:00100000:0.0:1746144904.135077:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144904.135531:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175364224 00000100:00100000:3.0:1746144904.135540:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175364224 00000100:00100000:3.0:1746144904.135736:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48240 00000100:00100000:3.0:1746144904.135744:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:415:x1830965175364224:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:3.0:1746144904.135759:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144904.135810:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481c00/0x4076af6727515c12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af954c4 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.135870:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x4076af6727515c19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.135881:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x4076af6727515c19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.135889:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x4076af6727515c19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:3.0:1746144904.135937:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:3.0:1746144904.135941:0:7113:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 26 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144904.135953:0:7113:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x4076af6727515c19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144904.135971:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481c00/0x4076af6727515c12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954c4 expref: 12 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.136006:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x4076af6727515c19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954c4 expref: 11 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.136013:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bb2b100) 00010000:00010000:3.0:1746144904.136016:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746144904.136018:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a5480800, rc 0) 00000100:00100000:3.0:1746144904.136058:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+11:415:x1830965175364224:12345-192.168.202.16@tcp:101:dd.0 Request processed in 315us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144904.136064:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48240 00000100:00100000:0.0:1746144904.140366:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144904.140572:0:20492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175364352 00000100:00100000:2.0:1746144904.140580:0:20492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175364352 00000100:00100000:2.0:1746144904.140628:0:20492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48241 00000100:00100000:2.0:1746144904.140636:0:20492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+11:415:x1830965175364352:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1746144904.140651:0:20492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144904.140666:0:20492:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3400/0x4076af6727515c20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af954cb expref: -99 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.140712:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.140722:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.140731:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.140741:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2400/0x4076af6727515c2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.140745:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2400/0x4076af6727515c2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.140753:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2400/0x4076af6727515c2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.140887:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3000/0x4076af6727515c35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.140893:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3000/0x4076af6727515c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.140900:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3000/0x4076af6727515c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00000004:00200000:2.0:1746144904.140923:0:20492:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 512 00000004:00200000:2.0:1746144904.140926:0:20492:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144904.140937:0:20492:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3000/0x4076af6727515c35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.140944:0:20492:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.140949:0:20492:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c27 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.140954:0:20492:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.140958:0:20492:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931b2c00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144904.140961:0:20492:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.140966:0:20492:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c27 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.140974:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bb2b100) 00010000:00010000:2.0:1746144904.140977:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144904.140980:0:20492:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.140983:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.141006:0:20492:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2400/0x4076af6727515c2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.141010:0:20492:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2400/0x4076af6727515c2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.141013:0:20492:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2400/0x4076af6727515c2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.141017:0:20492:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931b2400 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144904.141019:0:20492:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2400/0x4076af6727515c2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.141023:0:20492:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2400/0x4076af6727515c2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.141028:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2ce3d8f (ffff880099b35600) 00010000:00010000:2.0:1746144904.141030:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144904.141031:0:20492:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2400/0x4076af6727515c2e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.141035:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2400/0x4076af6727515c2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2ce3d8f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.141054:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3400/0x4076af6727515c20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954cb expref: 13 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.141065:0:20492:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3000/0x4076af6727515c35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954cb expref: 12 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.141071:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff88008a389f00) 00010000:00010000:2.0:1746144904.141072:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1746144904.141074:0:20492:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b3000, rc 0) 00000100:00100000:2.0:1746144904.141112:0:20492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:415:x1830965175364352:12345-192.168.202.16@tcp:101:dd.0 Request processed in 478us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144904.141117:0:20492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48241 00000100:00100000:0.0:1746144904.142432:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144904.142508:0:20492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175364608 00000100:00100000:2.0:1746144904.142513:0:20492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175364608 00000100:00100000:2.0:1746144904.142548:0:20492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48242 00000100:00100000:2.0:1746144904.142553:0:20492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:415:x1830965175364608:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1746144904.142564:0:20492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144904.142573:0:20492:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2a00/0x4076af6727515c3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af954d2 expref: -99 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.142627:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3200/0x4076af6727515c43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142634:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3200/0x4076af6727515c43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142641:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3200/0x4076af6727515c43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142651:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515c4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142660:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142665:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142725:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142732:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142737:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00000004:00200000:2.0:1746144904.142742:0:20492:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4a:0x0]: returning size 1716 00010000:00010000:2.0:1746144904.142893:0:20492:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3200/0x4076af6727515c43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142899:0:20492:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3200/0x4076af6727515c43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142904:0:20492:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3200/0x4076af6727515c43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142908:0:20492:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931b3200 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144904.142911:0:20492:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3200/0x4076af6727515c43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142916:0:20492:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3200/0x4076af6727515c43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142924:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff88008a389f00) 00010000:00010000:2.0:1746144904.142927:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144904.142930:0:20492:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3200/0x4076af6727515c43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142934:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3200/0x4076af6727515c43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142943:0:20492:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142947:0:20492:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515c4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142951:0:20492:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142954:0:20492:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b466600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144904.142956:0:20492:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142961:0:20492:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515c4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142965:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x2ce3da1 (ffff880099b35500) 00010000:00010000:2.0:1746144904.142967:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144904.142968:0:20492:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515c4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142972:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515c4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.142995:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2a00/0x4076af6727515c3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d2 expref: 15 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.143005:0:20492:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d2 expref: 14 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.143010:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff88009bb2ba00) 00010000:00010000:2.0:1746144904.143012:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144904.143014:0:20492:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093167800, rc 0) 00000100:00100000:2.0:1746144904.143575:0:20492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:415:x1830965175364608:12345-192.168.202.16@tcp:101:dd.0 Request processed in 1018us (1143us total) trans 4294987497 rc 0/0 00000100:00100000:2.0:1746144904.143583:0:20492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48242 00000100:00100000:0.0:1746144904.146752:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144904.146877:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175364736 00000100:00100000:2.0:1746144904.146886:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175364736 00000100:00080000:1.0:1746144904.146923:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746144904.146941:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5870 00000100:00100000:2.0:1746144904.146947:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:415:x1830965175364736:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1746144904.146961:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144904.146974:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af6727515c5f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af954d9 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.146995:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954b6 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.147001:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144904.147003:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144904.147005:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af6727515c5f lrc: 4/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d9 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.147025:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954b6 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.147035:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954b6 expref: 5 pid: 10401 timeout: 598 lvb_type: 0 00000100:00100000:2.0:1746144904.147046:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172540032:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144904.147116:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137345240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144904.148028:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172540032:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144904.148046:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af6727515c5f lrc: 3/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d9 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.148055:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b2c00, rc 0) 00000100:00100000:2.0:1746144904.148078:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:415:x1830965175364736:12345-192.168.202.16@tcp:101:dd.0 Request processed in 1131us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144904.148084:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5870 00000100:00100000:0.0:1746144904.148544:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144904.148590:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175364864 00000100:00100000:1.0:1746144904.148595:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175364864 00002000:00100000:1.0:1746144904.148622:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x19:0x0] (0->1715) req@ffff88008e830000 x1830965175364864/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:545/0 lens 2208/0 e 0 to 0 dl 1746144915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144904.148629:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e830000 with x1830965175364864 ext(0->1715) 00010000:00010000:1.0:1746144904.148635:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954b6 expref: 6 pid: 10401 timeout: 598 lvb_type: 0 00010000:00010000:1.0:1746144904.148828:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954b6 expref: 6 pid: 10401 timeout: 598 lvb_type: 0 00002000:00010000:1.0:1746144904.148835:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e830000 00000100:00100000:1.0:1746144904.148865:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 2268 00000100:00100000:1.0:1746144904.148871:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1985:x1830965175364864:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144904.149272:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175364864:12345-192.168.202.16@tcp:4:dd.0 Request processed in 400us (728us total) trans 4294968055 rc 0/0 00000100:00100000:1.0:1746144904.149281:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 2268 00002000:00100000:1.0:1746144904.149286:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x19:0x0] (0->1715) req@ffff88008e830000 x1830965175364864/t4294968055(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:545/0 lens 2208/448 e 0 to 0 dl 1746144915 ref 1 fl Complete:H/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144904.149293:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e830000 with x1830965175364864 ext(0->1715) 00010000:00010000:1.0:1746144904.149297:0:31840:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954b6 expref: 8 pid: 10401 timeout: 598 lvb_type: 0 00010000:00010000:1.0:1746144904.149306:0:31840:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954b6 expref: 8 pid: 10401 timeout: 598 lvb_type: 0 00002000:00010000:1.0:1746144904.149311:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008e830000 00000100:00100000:0.0:1746144904.150657:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144904.150725:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175364992 00000100:00100000:3.0:1746144904.150731:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175364992 00010000:00010000:3.0:1746144904.150752:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954b6 expref: 8 pid: 10401 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1746144904.150801:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11277 00000100:00100000:3.0:1746144904.150807:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175364992:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144904.150817:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746144904.150829:0:7098:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb size from disk: 0 -> 1716 00002000:00010000:3.0:1746144904.150831:0:7098:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb mtime from disk: 0 -> 1746144904 00002000:00010000:3.0:1746144904.150833:0:7098:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb atime from disk: 0 -> 1746144904 00002000:00010000:3.0:1746144904.150835:0:7098:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb ctime from disk: 0 -> 1746144904 00010000:00010000:3.0:1746144904.150839:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954b6 expref: 8 pid: 10401 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1746144904.150859:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954b6 expref: 8 pid: 10401 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1746144904.150877:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093167600/0x4076af6727515bf6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954b6 expref: 8 pid: 10401 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1746144904.150892:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144904.150894:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144904.150899:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af6727515c5f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d9 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.150906:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af6727515c5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d9 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.150931:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af6727515c5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d9 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144904.150941:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172540160:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144904.150998:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008bae7840 going to sleep for 11 seconds 00000100:00100000:3.0:1746144904.152233:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172540160:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144904.152247:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144904.152272:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175364992:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 1464us (1619us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144904.152282:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11277 00000100:00100000:0.0:1746144904.152452:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144904.152542:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175365248 00000100:00100000:1.0:1746144904.152547:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175365248 00002000:00100000:1.0:1746144904.152572:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x19:0x0] (0->4095) req@ffff88008e830e00 x1830965175365248/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:545/0 lens 488/0 e 0 to 0 dl 1746144915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144904.152581:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e830e00 with x1830965175365248 ext(0->4095) 00002000:00010000:1.0:1746144904.152584:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e830e00 00000100:00100000:1.0:1746144904.152608:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4220 00000100:00100000:1.0:1746144904.152614:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175365248:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:1.0:1746144904.152728:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175365248:12345-192.168.202.16@tcp:3:dd.0 Request processed in 114us (275us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746144904.152734:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4220 00002000:00100000:1.0:1746144904.152739:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x19:0x0] (0->4095) req@ffff88008e830e00 x1830965175365248/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:545/0 lens 488/4536 e 0 to 0 dl 1746144915 ref 1 fl Complete:/200/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144904.152745:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e830e00 with x1830965175365248 ext(0->4095) 00002000:00010000:1.0:1746144904.152748:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e830e00 00000100:00100000:0.0:1746144904.176883:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144904.177004:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175365504 00000100:00100000:1.0:1746144904.177012:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175365504 00000100:00100000:1.0:1746144904.177060:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 155 00000100:00100000:1.0:1746144904.177066:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:415:x1830965175365504:12345-192.168.202.16@tcp:35:dd.0 00000100:00100000:1.0:1746144904.178198:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+15:415:x1830965175365504:12345-192.168.202.16@tcp:35:dd.0 Request processed in 1129us (1321us total) trans 4294987498 rc 0/0 00000100:00100000:1.0:1746144904.178205:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 155 00000100:00100000:0.0:1746144904.184073:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144904.184215:0:20492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175365760 00000100:00100000:2.0:1746144904.184224:0:20492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175365760 00000100:00100000:2.0:1746144904.184272:0:20492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48243 00000100:00100000:2.0:1746144904.184279:0:20492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+16:418:x1830965175365760:12345-192.168.202.16@tcp:36:truncate.0 00010000:00010000:2.0:1746144904.184322:0:20492:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144904.184344:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481e00/0x4076af6727515be1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954a8 expref: 16 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.184371:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff88009bb2ba00) 00010000:00010000:2.0:1746144904.184375:0:20492:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144904.184520:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.184531:0:20492:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d2 expref: 14 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.184542:0:20492:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c66 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.184565:0:20492:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d2 expref: 14 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.184574:0:20492:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d2 expref: 14 pid: 20492 timeout: 598 lvb_type: 0 00000100:00100000:2.0:1746144904.184585:0:20492:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20492:1830965172540288:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144904.185296:0:20492:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137345240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144904.187040:0:20492:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:20492:1830965172540288:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144904.187065:0:20492:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00000100:00100000:0.0:1746144904.187143:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144904.187199:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175365888 00000100:00100000:3.0:1746144904.187204:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175365888 00010000:00010000:3.0:1746144904.187228:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d2 expref: 15 pid: 20492 timeout: 598 lvb_type: 0 00000100:00100000:3.0:1746144904.187304:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11278 00000100:00100000:3.0:1746144904.187310:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+15:1985:x1830965175365888:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144904.187320:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144904.187325:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d2 expref: 15 pid: 20492 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1746144904.187334:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d2 expref: 15 pid: 20492 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1746144904.187350:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d2 expref: 15 pid: 20492 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1746144904.187439:0:7098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff88009bb2ba00) 00010000:00010000:3.0:1746144904.187443:0:7098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:3.0:1746144904.187450:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20492 initiator: MDT0 00010000:00010000:3.0:1746144904.187456:0:7098:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c66 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 20492 initiator: MDT0 00010000:00010000:3.0:1746144904.187486:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144904.187519:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1985:x1830965175365888:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 208us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144904.187525:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11278 00010000:00010000:2.0:1746144904.187562:0:20492:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.187568:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00000001:00080000:2.0:1746144904.187675:0:20492:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294987499 00000004:00010000:2.0:1746144904.187710:0:20492:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008e831f80 reply state ffff8800993c4000 transno 4294987500 ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00000100:00100000:2.0:1746144904.187717:0:20492:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746144904.187794:0:20492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+18:418:x1830965175365760:12345-192.168.202.16@tcp:36:truncate.0 Request processed in 3515us (3728us total) trans 4294987500 rc 0/0 00000100:00100000:2.0:1746144904.187801:0:20492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48243 00000020:00080000:2.0:1746144904.187805:0:20492:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746144904.188991:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:3.0:1746144904.189045:0:3293:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:3.0:1746144904.189052:0:3293:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20492 initiator: MDT0 00010000:00010000:3.0:1746144904.189058:0:3293:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:3.0:1746144904.189062:0:3293:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093167600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144904.189070:0:3293:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:3.0:1746144904.189076:0:3293:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20492 initiator: MDT0 00010000:00010000:3.0:1746144904.189085:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff88009bb2ba00) 00010000:00010000:3.0:1746144904.189088:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144904.189091:0:3293:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:3.0:1746144904.189095:0:3293:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00000100:00100000:2.0:1746144904.189097:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175366016 00000100:00100000:2.0:1746144904.189101:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175366016 00000100:00100000:2.0:1746144904.189125:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5871 00000100:00100000:2.0:1746144904.189131:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+7:418:x1830965175366016:12345-192.168.202.16@tcp:101:truncate.0 00010000:00010000:2.0:1746144904.189144:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144904.189154:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800931b3200/0x4076af6727515c6d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af954e0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.189174:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af6727515c5f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d9 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.189180:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144904.189181:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144904.189184:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3200/0x4076af6727515c6d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954e0 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.189203:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af6727515c5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d9 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.189212:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af6727515c5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d9 expref: 5 pid: 10401 timeout: 598 lvb_type: 0 00000100:00100000:2.0:1746144904.189221:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172540416:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144904.189337:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137345240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144904.190702:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144904.190703:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172540416:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144904.190723:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3200/0x4076af6727515c6d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954e0 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144904.190735:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b3200, rc 0) 00000100:00100000:3.0:1746144904.190776:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175366144 00000100:00100000:3.0:1746144904.190780:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175366144 00010000:00010000:3.0:1746144904.190796:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af6727515c5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d9 expref: 6 pid: 10401 timeout: 598 lvb_type: 0 00000100:00100000:0.0:1746144904.190911:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+8:418:x1830965175366016:12345-192.168.202.16@tcp:101:truncate.0 Request processed in 1779us (1921us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144904.190917:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5871 00000100:00100000:3.0:1746144904.190960:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11279 00000100:00100000:3.0:1746144904.190967:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175366144:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144904.190976:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144904.190992:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af6727515c5f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d9 expref: 6 pid: 10401 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1746144904.191001:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af6727515c5f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d9 expref: 6 pid: 10401 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1746144904.191015:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b2c00/0x4076af6727515c5f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954d9 expref: 6 pid: 10401 timeout: 598 lvb_type: 0 00010000:00010000:3.0:1746144904.191022:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144904.191023:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144904.191027:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3200/0x4076af6727515c6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954e0 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.191033:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3200/0x4076af6727515c6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954e0 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144904.191051:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3200/0x4076af6727515c6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954e0 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144904.191059:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172540544:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144904.191118:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008bae7840 going to sleep for 11 seconds 00000100:00100000:0.0:1746144904.193698:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172540544:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144904.193716:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144904.193747:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:1984:x1830965175366144:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2779us (3047us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144904.193754:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11279 00000100:00100000:1.0:1746144904.193865:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144904.193904:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175366272 00000100:00100000:2.0:1746144904.193910:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175366272 00002000:00010000:2.0:1746144904.193934:0:31844:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/25 (858->18446744073709551615) 00002000:00100000:2.0:1746144904.193937:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ce00 with x1830965175366272 ext(858->18446744073709551615) 00002000:00010000:2.0:1746144904.193944:0:31844:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5ce00. 00000100:00100000:2.0:1746144904.193969:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4221 00000100:00100000:2.0:1746144904.193975:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175366272:12345-192.168.202.16@tcp:10:truncate.0 00002000:00010000:2.0:1746144904.194154:0:31844:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb size from disk: 1716 -> 858 00002000:00010000:2.0:1746144904.194157:0:31844:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb mtime from disk: 1746144904 -> 1746144904 00002000:00010000:2.0:1746144904.194159:0:31844:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb atime from disk: 1746144904 -> 1746144904 00002000:00010000:2.0:1746144904.194161:0:31844:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb ctime from disk: 1746144904 -> 1746144904 00002000:00010000:2.0:1746144904.194162:0:31844:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x19:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1746144904.194183:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175366272:12345-192.168.202.16@tcp:10:truncate.0 Request processed in 208us (319us total) trans 4294968056 rc 0/0 00000100:00100000:2.0:1746144904.194188:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4221 00002000:00010000:2.0:1746144904.194190:0:31844:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/25 (858->18446744073709551615) 00002000:00100000:2.0:1746144904.194192:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ce00 with x1830965175366272 ext(858->18446744073709551615) 00002000:00010000:2.0:1746144904.194196:0:31844:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5ce00. 00000100:00100000:0.0:1746144904.200570:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144904.200679:0:20492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175366528 00000100:00100000:2.0:1746144904.200687:0:20492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175366528 00000100:00100000:2.0:1746144904.200733:0:20492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48244 00000100:00100000:2.0:1746144904.200740:0:20492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+17:420:x1830965175366528:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1746144904.200819:0:20492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144904.200833:0:20492:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af954e7 expref: -99 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.200923:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.200931:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.200938:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.200945:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.200948:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.200951:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201006:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167a00/0x4076af6727515c89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201009:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093167a00/0x4076af6727515c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201013:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093167a00/0x4076af6727515c89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00000004:00200000:2.0:1746144904.201018:0:20492:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4a:0x0]: returning size 858 00010000:00010000:2.0:1746144904.201092:0:20492:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201098:0:20492:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c7b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201106:0:20492:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201111:0:20492:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093167600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144904.201114:0:20492:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201120:0:20492:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c7b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201128:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff88008a389f00) 00010000:00010000:2.0:1746144904.201131:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144904.201310:0:20492:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201315:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201337:0:20492:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201341:0:20492:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201345:0:20492:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201351:0:20492:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093167800 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144904.201353:0:20492:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201359:0:20492:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201368:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x2ce3da1 (ffff880099b35100) 00010000:00010000:2.0:1746144904.201370:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144904.201372:0:20492:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201375:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093167800/0x4076af6727515c82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.201402:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954e7 expref: 20 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.201410:0:20492:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167a00/0x4076af6727515c89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954e7 expref: 19 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.201415:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff88009bb2ba00) 00010000:00010000:2.0:1746144904.201416:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144904.201418:0:20492:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093167a00, rc 0) 00000100:00100000:2.0:1746144904.201460:0:20492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+19:420:x1830965175366528:12345-192.168.202.16@tcp:101:dd.0 Request processed in 721us (896us total) trans 4294987501 rc 0/0 00000100:00100000:2.0:1746144904.201465:0:20492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48244 00000100:00100000:0.0:1746144904.202905:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144904.202967:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175366784 00000100:00100000:1.0:1746144904.202974:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175366784 00000100:00100000:1.0:1746144904.203012:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 156 00000100:00100000:1.0:1746144904.203017:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+19:420:x1830965175366784:12345-192.168.202.16@tcp:35:dd.0 00000100:00100000:1.0:1746144904.203144:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+20:420:x1830965175366784:12345-192.168.202.16@tcp:35:dd.0 Request processed in 126us (241us total) trans 4294987502 rc 0/0 00000100:00100000:1.0:1746144904.203150:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 156 00000100:00100000:0.0:1746144904.204986:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144904.205049:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175367040 00000100:00100000:2.0:1746144904.205055:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175367040 00002000:00100000:2.0:1746144904.205084:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x19:0x0] (0->4095) req@ffff88008e830700 x1830965175367040/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:545/0 lens 488/0 e 0 to 0 dl 1746144915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144904.205093:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e830700 with x1830965175367040 ext(0->4095) 00002000:00010000:2.0:1746144904.205097:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e830700 00000100:00100000:2.0:1746144904.205124:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4222 00000100:00100000:2.0:1746144904.205130:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175367040:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:2.0:1746144904.205270:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175367040:12345-192.168.202.16@tcp:3:dd.0 Request processed in 140us (288us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746144904.205276:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4222 00002000:00100000:2.0:1746144904.205281:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x19:0x0] (0->4095) req@ffff88008e830700 x1830965175367040/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:545/0 lens 488/4536 e 0 to 0 dl 1746144915 ref 1 fl Complete:/200/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144904.205288:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e830700 with x1830965175367040 ext(0->4095) 00002000:00010000:2.0:1746144904.205291:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e830700 00000100:00100000:0.0:1746144904.234210:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144904.235238:0:20492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175367296 00000100:00100000:2.0:1746144904.235246:0:20492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175367296 00000100:00100000:2.0:1746144904.235292:0:20492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48245 00000100:00100000:2.0:1746144904.235298:0:20492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:424:x1830965175367296:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1746144904.235318:0:20492:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144904.235333:0:20492:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af954ee expref: -99 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.235408:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235417:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235426:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235437:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2e00/0x4076af6727515ca5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235442:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2e00/0x4076af6727515ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235449:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2e00/0x4076af6727515ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235520:0:20492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fe6800/0x4076af6727515cac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235526:0:20492:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fe6800/0x4076af6727515cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235532:0:20492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fe6800/0x4076af6727515cac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20492 initiator: MDT0 00000004:00200000:2.0:1746144904.235539:0:20492:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4a:0x0]: returning size 858 00010000:00010000:2.0:1746144904.235603:0:20492:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235609:0:20492:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235614:0:20492:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235617:0:20492:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931b2c00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144904.235620:0:20492:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235625:0:20492:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235633:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff88008a389f00) 00010000:00010000:2.0:1746144904.235635:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144904.235637:0:20492:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235644:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af6727515c9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235668:0:20492:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2e00/0x4076af6727515ca5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235673:0:20492:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2e00/0x4076af6727515ca5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235678:0:20492:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2e00/0x4076af6727515ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235682:0:20492:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931b2e00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144904.235684:0:20492:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2e00/0x4076af6727515ca5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235688:0:20492:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2e00/0x4076af6727515ca5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235694:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x2ce3da1 (ffff880099b35400) 00010000:00010000:2.0:1746144904.235696:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144904.235698:0:20492:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2e00/0x4076af6727515ca5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235702:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2e00/0x4076af6727515ca5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x2ce3da1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20492 initiator: MDT0 00010000:00010000:2.0:1746144904.235731:0:20492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727515c97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954ee expref: 17 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.235742:0:20492:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4fe6800/0x4076af6727515cac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954ee expref: 16 pid: 20492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.235752:0:20492:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff88009bb2ba00) 00010000:00010000:2.0:1746144904.235753:0:20492:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144904.235755:0:20492:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4fe6800, rc 0) 00000100:00100000:2.0:1746144904.235816:0:20492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:424:x1830965175367296:12345-192.168.202.16@tcp:101:dd.0 Request processed in 518us (1612us total) trans 4294987503 rc 0/0 00000100:00100000:2.0:1746144904.235822:0:20492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48245 00000100:00100000:0.0:1746144904.239151:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144904.239234:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175367424 00000100:00100000:2.0:1746144904.239242:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175367424 00000100:00100000:2.0:1746144904.239292:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5872 00000100:00100000:2.0:1746144904.239299:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+5:424:x1830965175367424:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1746144904.239313:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144904.239325:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091751400/0x4076af6727515cba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af954f5 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.239344:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3200/0x4076af6727515c6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954e0 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.239348:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144904.239350:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144904.239352:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091751400/0x4076af6727515cba lrc: 4/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954f5 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.239371:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800931b3200/0x4076af6727515c6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954e0 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.239377:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800931b3200/0x4076af6727515c6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954e0 expref: 8 pid: 10401 timeout: 598 lvb_type: 0 00000100:00100000:2.0:1746144904.239385:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172540672:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144904.239462:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137345780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144904.242931:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172540672:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144904.242969:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091751400/0x4076af6727515cba lrc: 3/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954f5 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.242983:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091751400, rc 0) 00000100:00100000:2.0:1746144904.243033:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:424:x1830965175367424:12345-192.168.202.16@tcp:101:dd.0 Request processed in 3733us (3887us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144904.243040:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5872 00000100:00100000:0.0:1746144904.243563:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144904.244084:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175367552 00000100:00100000:2.0:1746144904.244090:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175367552 00010000:00010000:2.0:1746144904.244123:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800931b3200/0x4076af6727515c6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954e0 expref: 9 pid: 10401 timeout: 598 lvb_type: 0 00000100:00100000:2.0:1746144904.244154:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11280 00000100:00100000:2.0:1746144904.244161:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175367552:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144904.244170:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144904.244186:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800931b3200/0x4076af6727515c6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954e0 expref: 9 pid: 10401 timeout: 598 lvb_type: 0 00010000:00010000:2.0:1746144904.244200:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800931b3200/0x4076af6727515c6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954e0 expref: 9 pid: 10401 timeout: 598 lvb_type: 0 00010000:00010000:2.0:1746144904.244225:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800931b3200/0x4076af6727515c6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954e0 expref: 9 pid: 10401 timeout: 598 lvb_type: 0 00010000:00010000:2.0:1746144904.244251:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144904.244253:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144904.244258:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091751400/0x4076af6727515cba lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954f5 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.244432:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091751400/0x4076af6727515cba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954f5 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144904.244459:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091751400/0x4076af6727515cba lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954f5 expref: 5 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144904.244468:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172540800:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144904.244735:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff880137345780 going to sleep for 11 seconds 00000100:00100000:2.0:1746144904.246361:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800925a9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172540800:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144904.246377:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144904.246423:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175367552:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2261us (2860us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144904.246431:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11280 00000100:00100000:0.0:1746144904.246656:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144904.247336:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175367808 00000100:00100000:3.0:1746144904.247342:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175367808 00002000:00100000:3.0:1746144904.247373:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x19:0x0] (0->4095) req@ffff88008e832d80 x1830965175367808/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:545/0 lens 488/0 e 0 to 0 dl 1746144915 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144904.247382:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e832d80 with x1830965175367808 ext(0->4095) 00002000:00010000:3.0:1746144904.247386:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e832d80 00000100:00100000:3.0:1746144904.247414:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4223 00000100:00100000:3.0:1746144904.247420:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175367808:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:3.0:1746144904.247742:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1984:x1830965175367808:12345-192.168.202.16@tcp:3:dd.0 Request processed in 322us (1086us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746144904.247748:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4223 00002000:00100000:3.0:1746144904.247752:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x19:0x0] (0->4095) req@ffff88008e832d80 x1830965175367808/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:545/0 lens 488/4536 e 0 to 0 dl 1746144915 ref 1 fl Complete:/200/0 rc 4096/4096 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144904.247758:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e832d80 with x1830965175367808 ext(0->4095) 00002000:00010000:3.0:1746144904.247776:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e832d80 00000100:00100000:0.0:1746144904.271410:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144904.271549:0:7114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175368064 00000100:00100000:3.0:1746144904.271557:0:7114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175368064 00000100:00100000:3.0:1746144904.271604:0:7114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 157 00000100:00100000:3.0:1746144904.271610:0:7114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:424:x1830965175368064:12345-192.168.202.16@tcp:35:dd.0 00000100:00100000:3.0:1746144904.271801:0:7114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:424:x1830965175368064:12345-192.168.202.16@tcp:35:dd.0 Request processed in 190us (398us total) trans 4294987504 rc 0/0 00000100:00100000:3.0:1746144904.271807:0:7114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 157 00010000:00010000:2.0:1746144904.627218:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746144905.532158:0:3308:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2566f13b-362a-4e88-b0dd-c558bbe87895:3308:1830965172540928:0@lo:400:kworker.0 00000100:00100000:3.0:1746144905.532160:0:3309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1830965172541056:0@lo:400:kworker.0 00000100:00100000:1.0:1746144905.532173:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172541312:0@lo:400:kworker.0 00000100:00100000:1.0:1746144905.532208:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144905.532209:0:3309:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144905.532210:0:3308:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144905.532239:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1830965172541184:0@lo:400:kworker.0 00000100:00100000:0.0:1746144905.532264:0:3308:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1830965172541440:0@lo:400:kworker.0 00000100:00100000:2.0:1746144905.532268:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172541312 00000100:00100000:2.0:1746144905.532275:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172541312 00000100:00100000:0.0:1746144905.532289:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172540928 00000100:00100000:0.0:1746144905.532292:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172540928 00000100:00100000:2.0:1746144905.532318:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:0.0:1746144905.532318:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1746144905.532323:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2566f13b-362a-4e88-b0dd-c558bbe87895+18:3308:x1830965172540928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746144905.532324:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172541312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144905.532357:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2566f13b-362a-4e88-b0dd-c558bbe87895+18:3308:x1830965172540928:12345-0@lo:400:kworker.0 Request processed in 34us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144905.532361:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172541312:12345-0@lo:400:kworker.0 Request processed in 38us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144905.532361:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1746144905.532367:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00080000:0.0:1746144905.532391:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746144905.532427:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144905.532434:0:3309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801358ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172541568:0@lo:400:kworker.0 00000100:00100000:1.0:1746144905.532435:0:3307:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294968054 gen 2 00000004:00080000:1.0:1746144905.532440:0:3307:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092f72d80, transno 4294968054 00000100:00100000:0.0:1746144905.532447:0:3308:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144905.532448:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172541312:0@lo:400:kworker.0 00000100:00100000:3.0:1746144905.532452:0:3309:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144905.532460:0:3308:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2566f13b-362a-4e88-b0dd-c558bbe87895:3308:1830965172540928:0@lo:400:kworker.0 00000100:00100000:3.0:1746144905.532477:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172541056 00000100:00100000:3.0:1746144905.532480:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172541056 00000100:00100000:3.0:1746144905.532644:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172541184 00000100:00100000:3.0:1746144905.532646:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172541184 00000100:00100000:0.0:1746144905.532707:0:21078:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172541440 00000100:00100000:0.0:1746144905.532710:0:21078:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172541440 00000100:00100000:2.0:1746144905.532722:0:20492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1746144905.532728:0:20492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1830965172541056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144905.532733:0:21078:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1746144905.532738:0:21078:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1830965172541184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746144905.532759:0:20492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1830965172541056:12345-0@lo:400:kworker.0 Request processed in 31us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144905.532782:0:20492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1746144905.532784:0:21078:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_006:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1830965172541184:12345-0@lo:400:kworker.0 Request processed in 45us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144905.532792:0:21078:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1746144905.532795:0:20492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1746144905.532799:0:20492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1830965172541440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746144905.532805:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172541568 00000100:00100000:0.0:1746144905.532807:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172541568 00000100:00100000:2.0:1746144905.532823:0:20492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1830965172541440:12345-0@lo:400:kworker.0 Request processed in 24us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144905.532825:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1746144905.532828:0:20492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1746144905.532840:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1830965172541568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746144905.532864:0:3309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1830965172541056:0@lo:400:kworker.0 00000100:00100000:0.0:1746144905.532864:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1830965172541568:12345-0@lo:400:kworker.0 Request processed in 35us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144905.532869:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1746144905.532875:0:3309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801358ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172541568:0@lo:400:kworker.0 00000100:00100000:0.0:1746144905.532886:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1830965172541184:0@lo:400:kworker.0 00000100:00100000:0.0:1746144905.532899:0:3308:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087c5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1830965172541440:0@lo:400:kworker.0 00000100:00080000:0.0:1746144905.532913:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746144905.532916:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746144905.580302:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965172541696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746144905.580359:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144905.580412:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172541696 00000100:00100000:0.0:1746144905.580418:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172541696 00000100:00100000:0.0:1746144905.580450:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1746144905.580457:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1830965172541696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746144905.580484:0:8435:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 50921472 pending 1703936 free 3856662528 avail 3854565376 00000100:00100000:0.0:1746144905.580517:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1830965172541696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144905.580522:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1746144905.580621:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093fa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965172541696:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1746144905.628079:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1746144906.590607:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968534 is committed 00000001:00080000:1.0:1746144906.590620:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968535 is committed 00010000:00010000:3.0:1746144906.630205:0:7101:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1746144906.689055:0:3987:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanityn test 16j: race dio with buffered i/o ========== 20:15:06 (1746144906) 00000100:00100000:0.0:1746144906.762027:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144906.762094:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175368320 00000100:00100000:1.0:1746144906.762105:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175368320 00000100:00100000:1.0:1746144906.762179:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48246 00000100:00100000:1.0:1746144906.762187:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1090:x1830965175368320:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1746144906.762204:0:21076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144906.762207:0:21076:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746144906.762228:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099312600/0x4076af6727515b7f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9548c expref: 20 pid: 7113 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746144906.762228:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746144906.762241:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bb2b100) 00010000:00010000:1.0:1746144906.762245:0:21076:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144906.762254:0:21076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093936000/0x4076af6727515cc1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af954fc expref: -99 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.762349:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093937600/0x4076af6727515cc8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.762359:0:21076:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x4076af6727515c19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954c4 expref: 16 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.762368:0:21076:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093937600/0x4076af6727515cc8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.762393:0:21076:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x4076af6727515c19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954c4 expref: 16 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.762402:0:21076:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x4076af6727515c19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954c4 expref: 16 pid: 7113 timeout: 600 lvb_type: 0 00000100:00100000:1.0:1746144906.762413:0:21076:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801358ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21076:1830965172541824:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144906.762506:0:21076:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f10240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144906.763794:0:21076:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801358ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21076:1830965172541824:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144906.763810:0:21076:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093937600/0x4076af6727515cc8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000100:00100000:0.0:1746144906.764140:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144906.764498:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175368448 00000100:00100000:2.0:1746144906.764507:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175368448 00010000:00010000:2.0:1746144906.764556:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x4076af6727515c19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954c4 expref: 17 pid: 7113 timeout: 600 lvb_type: 0 00000100:00100000:2.0:1746144906.764590:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11281 00000100:00100000:2.0:1746144906.764598:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1984:x1830965175368448:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144906.764610:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144906.764616:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x4076af6727515c19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954c4 expref: 17 pid: 7113 timeout: 600 lvb_type: 0 00010000:00010000:2.0:1746144906.764626:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x4076af6727515c19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954c4 expref: 17 pid: 7113 timeout: 600 lvb_type: 0 00010000:00010000:2.0:1746144906.764647:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5480800/0x4076af6727515c19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954c4 expref: 17 pid: 7113 timeout: 600 lvb_type: 0 00010000:00010000:2.0:1746144906.764661:0:7098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bb2b100) 00010000:00010000:2.0:1746144906.764665:0:7098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093937600/0x4076af6727515cc8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144906.764675:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093937600/0x4076af6727515cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144906.764682:0:7098:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093937600/0x4076af6727515cc8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144906.764700:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:0.0:1746144906.764798:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746144906.764837:0:21076:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093937600/0x4076af6727515cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.764845:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093937600/0x4076af6727515cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.764863:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481e00/0x4076af6727515ccf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.764872:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481e00/0x4076af6727515ccf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.764880:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481e00/0x4076af6727515ccf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000100:00100000:2.0:1746144906.764992:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1984:x1830965175368448:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 394us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144906.765000:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11281 00010000:00010000:1.0:1746144906.767182:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82be00/0x4076af6727515cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.767195:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82be00/0x4076af6727515cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.767204:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82be00/0x4076af6727515cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000004:00200000:1.0:1746144906.767212:0:21076:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 0 00010000:00010000:1.0:1746144906.767230:0:21076:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093937600/0x4076af6727515cc8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.767235:0:21076:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093937600/0x4076af6727515cc8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.767240:0:21076:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093937600/0x4076af6727515cc8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.767244:0:21076:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093937600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144906.767248:0:21076:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093937600/0x4076af6727515cc8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.767253:0:21076:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093937600/0x4076af6727515cc8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.767263:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bb2b100) 00010000:00010000:1.0:1746144906.767266:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144906.767269:0:21076:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093937600/0x4076af6727515cc8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.767273:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093937600/0x4076af6727515cc8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00000004:00010000:1.0:1746144906.767284:0:21076:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093fa1f80 reply state ffff8800934bc000 transno 4294987505 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481e00/0x4076af6727515ccf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000100:00100000:1.0:1746144906.767290:0:21076:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746144906.767316:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093936000/0x4076af6727515cc1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954fc expref: 22 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.767331:0:21076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82be00/0x4076af6727515cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954fc expref: 21 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.767336:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca100) 00010000:00010000:1.0:1746144906.767338:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144906.767340:0:21076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b82be00, rc 0) 00000100:00100000:1.0:1746144906.767402:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1090:x1830965175368320:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 5215us (5385us total) trans 4294987505 rc 0/0 00000100:00100000:1.0:1746144906.767409:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48246 00010000:00010000:3.0:1746144906.769334:0:3292:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481e00/0x4076af6727515ccf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144906.769344:0:3292:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481e00/0x4076af6727515ccf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144906.769350:0:3292:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481e00/0x4076af6727515ccf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144906.769354:0:3292:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5481e00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144906.769357:0:3292:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481e00/0x4076af6727515ccf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144906.769362:0:3292:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481e00/0x4076af6727515ccf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144906.769371:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6ecf (ffff88009bbca400) 00010000:00010000:3.0:1746144906.769373:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144906.769376:0:3292:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481e00/0x4076af6727515ccf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144906.769380:0:3292:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5481e00/0x4076af6727515ccf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00000100:00100000:0.0:1746144906.772162:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144906.773064:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175368704 00000100:00100000:1.0:1746144906.773075:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175368704 00000100:00100000:1.0:1746144906.773116:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48247 00000100:00100000:1.0:1746144906.773123:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1090:x1830965175368704:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1746144906.773143:0:21076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144906.773161:0:21076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b600/0x4076af6727515ce4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95503 expref: -99 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.773230:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea47e00/0x4076af6727515ceb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.773242:0:21076:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82be00/0x4076af6727515cd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954fc expref: 22 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.773249:0:21076:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea47e00/0x4076af6727515ceb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.773274:0:21076:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82be00/0x4076af6727515cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954fc expref: 22 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.773285:0:21076:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82be00/0x4076af6727515cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954fc expref: 22 pid: 21076 timeout: 600 lvb_type: 0 00000100:00100000:1.0:1746144906.773295:0:21076:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801358ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21076:1830965172541952:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144906.773381:0:21076:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f10480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144906.775934:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144906.775995:0:21076:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801358ef100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21076:1830965172541952:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144906.776018:0:21076:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea47e00/0x4076af6727515ceb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000100:00100000:2.0:1746144906.776097:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175368832 00000100:00100000:2.0:1746144906.776109:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175368832 00010000:00010000:2.0:1746144906.776149:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82be00/0x4076af6727515cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954fc expref: 23 pid: 21076 timeout: 600 lvb_type: 0 00000100:00100000:2.0:1746144906.776192:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11282 00000100:00100000:2.0:1746144906.776200:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965175368832:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144906.776215:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144906.776221:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82be00/0x4076af6727515cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954fc expref: 23 pid: 21076 timeout: 600 lvb_type: 0 00010000:00010000:2.0:1746144906.776232:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82be00/0x4076af6727515cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954fc expref: 23 pid: 21076 timeout: 600 lvb_type: 0 00010000:00010000:2.0:1746144906.776253:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82be00/0x4076af6727515cd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af954fc expref: 23 pid: 21076 timeout: 600 lvb_type: 0 00010000:00010000:2.0:1746144906.776267:0:7098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca100) 00010000:00010000:2.0:1746144906.776272:0:7098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea47e00/0x4076af6727515ceb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144906.776280:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea47e00/0x4076af6727515ceb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144906.776286:0:7098:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea47e00/0x4076af6727515ceb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144906.776314:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144906.776373:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1984:x1830965175368832:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 173us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144906.776380:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11282 00010000:00010000:1.0:1746144906.777457:0:21076:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea47e00/0x4076af6727515ceb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.777467:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea47e00/0x4076af6727515ceb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000004:00200000:1.0:1746144906.777485:0:21076:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 0 00000004:00080000:1.0:1746144906.777614:0:21076:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a:0x0], index 0: 0 00000004:00080000:1.0:1746144906.777620:0:21076:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a:0x0], index 1: 0 00010000:00010000:1.0:1746144906.777715:0:21076:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea47e00/0x4076af6727515ceb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.777722:0:21076:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea47e00/0x4076af6727515ceb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.777732:0:21076:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea47e00/0x4076af6727515ceb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.777737:0:21076:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea47e00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144906.777740:0:21076:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea47e00/0x4076af6727515ceb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.777745:0:21076:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea47e00/0x4076af6727515ceb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.777757:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca100) 00010000:00010000:1.0:1746144906.777759:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144906.777796:0:21076:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea47e00/0x4076af6727515ceb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.777801:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea47e00/0x4076af6727515ceb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.777852:0:21076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b600/0x4076af6727515ce4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95503 expref: 22 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.777859:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b600/0x4076af6727515ce4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95503 expref: 22 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.777870:0:21076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b82b600, rc 0) 00000100:00100000:1.0:1746144906.777915:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1090:x1830965175368704:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 4792us (5763us total) trans 4294987506 rc 301/301 00000100:00100000:1.0:1746144906.777922:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48247 00000100:00100000:2.0:1746144906.782425:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144906.782716:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175369088 00000100:00100000:1.0:1746144906.782726:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175369088 00000100:00100000:1.0:1746144906.782914:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 158 00000100:00100000:1.0:1746144906.782923:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1090:x1830965175369088:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1746144906.783226:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1090:x1830965175369088:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 303us (811us total) trans 4294987507 rc 0/0 00000100:00100000:1.0:1746144906.783233:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 158 00000100:00100000:0.0:1746144906.784743:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144906.784984:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175369216 00000100:00100000:1.0:1746144906.784990:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175369216 00000100:00100000:1.0:1746144906.785021:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48248 00000100:00100000:1.0:1746144906.785027:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1090:x1830965175369216:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1746144906.785044:0:21076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144906.785064:0:21076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094198000/0x4076af6727515cf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9550a expref: -99 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.785120:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094198000/0x4076af6727515cf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9550a expref: 23 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.785132:0:21076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094198000/0x4076af6727515cf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9550a expref: 23 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.785149:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca000) 00010000:00010000:1.0:1746144906.785151:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746144906.785154:0:21076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094198000, rc 0) 00000100:00100000:1.0:1746144906.785196:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1090:x1830965175369216:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 169us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144906.785203:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48248 00000100:00100000:0.0:1746144906.789215:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144906.789288:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175369472 00000100:00100000:1.0:1746144906.789298:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175369472 00000100:00100000:1.0:1746144906.789353:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 159 00000100:00100000:1.0:1746144906.789361:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1090:x1830965175369472:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1746144906.789587:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1090:x1830965175369472:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 225us (379us total) trans 4294987508 rc 0/0 00000100:00100000:1.0:1746144906.789593:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 159 00000100:00100000:0.0:1746144906.809394:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144906.809671:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175369600 00000100:00100000:3.0:1746144906.809681:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175369600 00000100:00100000:3.0:1746144906.810083:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48249 00000100:00100000:3.0:1746144906.810092:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1098:x1830965175369600:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:3.0:1746144906.810119:0:10400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144906.810141:0:10400:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094236a00/0x4076af6727515d00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95511 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144906.810207:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099501800/0x4076af6727515d07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.810219:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099501800/0x4076af6727515d07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.810230:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099501800/0x4076af6727515d07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000004:00200000:3.0:1746144906.810319:0:10400:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:3.0:1746144906.810322:0:10400:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144906.810343:0:10400:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099501800/0x4076af6727515d07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.810363:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094236a00/0x4076af6727515d00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95511 expref: 26 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144906.810413:0:10400:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099501800/0x4076af6727515d07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95511 expref: 25 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144906.810420:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009a8b7c00) 00010000:00010000:3.0:1746144906.810423:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746144906.810426:0:10400:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099501800, rc 0) 00000100:00100000:3.0:1746144906.810578:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1098:x1830965175369600:12345-192.168.202.16@tcp:101:dd.0 Request processed in 487us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144906.810585:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48249 00000100:00100000:0.0:1746144906.815061:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144906.815151:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175369856 00000100:00100000:3.0:1746144906.815161:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175369856 00000100:00100000:3.0:1746144906.815215:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48250 00000100:00100000:3.0:1746144906.815223:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1098:x1830965175369856:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:3.0:1746144906.815242:0:10400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144906.815246:0:10400:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746144906.815271:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099501800/0x4076af6727515d07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95511 expref: 25 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144906.815291:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009a8b7c00) 00010000:00010000:3.0:1746144906.815299:0:10400:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144906.815308:0:10400:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099501a00/0x4076af6727515d0e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95518 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144906.815469:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099500e00/0x4076af6727515d15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815480:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099500e00/0x4076af6727515d15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815488:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099500e00/0x4076af6727515d15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815499:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099500c00/0x4076af6727515d1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815504:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099500c00/0x4076af6727515d1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815509:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099500c00/0x4076af6727515d1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815571:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094236a00/0x4076af6727515d23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815577:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094236a00/0x4076af6727515d23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815583:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094236a00/0x4076af6727515d23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000004:00200000:3.0:1746144906.815591:0:10400:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 0 00010000:00010000:3.0:1746144906.815679:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099500e00/0x4076af6727515d15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815685:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099500e00/0x4076af6727515d15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815691:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099500e00/0x4076af6727515d15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815697:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099500e00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144906.815701:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099500e00/0x4076af6727515d15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815707:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099500e00/0x4076af6727515d15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815714:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009a8b7100) 00010000:00010000:3.0:1746144906.815716:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144906.815719:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099500e00/0x4076af6727515d15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815723:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099500e00/0x4076af6727515d15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815729:0:10400:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099500c00/0x4076af6727515d1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815733:0:10400:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099500c00/0x4076af6727515d1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815741:0:10400:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099500c00/0x4076af6727515d1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815745:0:10400:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099500c00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144906.815747:0:10400:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099500c00/0x4076af6727515d1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815750:0:10400:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099500c00/0x4076af6727515d1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815754:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6ecf (ffff88009a8b7d00) 00010000:00010000:3.0:1746144906.815756:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144906.815757:0:10400:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099500c00/0x4076af6727515d1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815788:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099500c00/0x4076af6727515d1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144906.815829:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099501a00/0x4076af6727515d0e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95518 expref: 27 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144906.815841:0:10400:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094236a00/0x4076af6727515d23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95518 expref: 26 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144906.815846:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca000) 00010000:00010000:3.0:1746144906.815848:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144906.815850:0:10400:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094236a00, rc 0) 00000100:00100000:3.0:1746144906.815896:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1098:x1830965175369856:12345-192.168.202.16@tcp:101:dd.0 Request processed in 673us (846us total) trans 4294987509 rc 0/0 00000100:00100000:3.0:1746144906.815903:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48250 00000100:00100000:0.0:1746144906.817608:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144906.817667:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175370112 00000100:00100000:1.0:1746144906.817673:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175370112 00000100:00100000:1.0:1746144906.817715:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48251 00000100:00100000:1.0:1746144906.817722:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1098:x1830965175370112:12345-192.168.202.16@tcp:36:dd.0 00010000:00010000:1.0:1746144906.817759:0:21076:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144906.817809:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094236a00/0x4076af6727515d23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95518 expref: 26 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.817840:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca000) 00010000:00010000:1.0:1746144906.817843:0:21076:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144906.818000:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b600/0x4076af6727515d31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.818009:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b600/0x4076af6727515d31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144906.818015:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b600/0x4076af6727515d31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000001:00080000:1.0:1746144906.818057:0:21076:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294987510 00000004:00010000:1.0:1746144906.818074:0:21076:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009258ce00 reply state ffff8800934be000 transno 4294987511 ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b600/0x4076af6727515d31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000100:00100000:1.0:1746144906.818080:0:21076:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746144906.818134:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1098:x1830965175370112:12345-192.168.202.16@tcp:36:dd.0 Request processed in 411us (530us total) trans 4294987511 rc 0/0 00000100:00100000:1.0:1746144906.818140:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48251 00000020:00080000:1.0:1746144906.818144:0:21076:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746144906.819646:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:3.0:1746144906.819708:0:3293:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b600/0x4076af6727515d31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144906.819715:0:3293:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b600/0x4076af6727515d31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144906.819721:0:3293:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b600/0x4076af6727515d31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144906.819725:0:3293:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b82b600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144906.819729:0:3293:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b600/0x4076af6727515d31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144906.819733:0:3293:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b600/0x4076af6727515d31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144906.819743:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca000) 00010000:00010000:3.0:1746144906.819745:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144906.819747:0:3293:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b600/0x4076af6727515d31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144906.819751:0:3293:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b600/0x4076af6727515d31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00000100:00100000:1.0:1746144906.819969:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175370240 00000100:00100000:1.0:1746144906.819975:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175370240 00000100:00100000:1.0:1746144906.820031:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5873 00000100:00080000:0.0:1746144906.820031:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746144906.820038:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1098:x1830965175370240:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1746144906.820049:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144906.820063:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b82a200/0x4076af6727515d38 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9551f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144906.820086:0:8432:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1746144906.820104:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144906.820106:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144906.820111:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b82a200/0x4076af6727515d38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9551f expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.820123:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b82a200/0x4076af6727515d38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9551f expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.820132:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b82a200, rc 0) 00000100:00100000:1.0:1746144906.820173:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1098:x1830965175370240:12345-192.168.202.16@tcp:101:dd.0 Request processed in 135us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144906.820179:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5873 00000100:00100000:0.0:1746144906.821254:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144906.821297:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175370368 00000100:00100000:1.0:1746144906.821302:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175370368 00000100:00080000:0.0:1746144906.821319:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746144906.821332:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5874 00000100:00100000:1.0:1746144906.821338:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1098:x1830965175370368:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1746144906.821347:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144906.821360:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094199a00/0x4076af6727515d3f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95526 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144906.821377:0:8432:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1746144906.821389:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144906.821390:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144906.821394:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094199a00/0x4076af6727515d3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95526 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.821404:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094199a00/0x4076af6727515d3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95526 expref: 6 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144906.821411:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094199a00, rc 0) 00000100:00100000:1.0:1746144906.821446:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1098:x1830965175370368:12345-192.168.202.16@tcp:101:dd.0 Request processed in 108us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144906.821452:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5874 00000100:00100000:0.0:1746144906.823422:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144906.823500:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144906.823541:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175370496 00000100:00100000:1.0:1746144906.823547:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175370496 00000100:00100000:3.0:1746144906.823564:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175370624 00000100:00100000:3.0:1746144906.823568:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175370624 00002000:00010000:1.0:1746144906.823576:0:31840:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/26 (0->18446744073709551615) 00002000:00010000:3.0:1746144906.823579:0:31844:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/26 (0->18446744073709551615) 00002000:00100000:1.0:1746144906.823580:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e39f80 with x1830965175370496 ext(0->18446744073709551615) 00002000:00100000:3.0:1746144906.823581:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e39500 with x1830965175370624 ext(0->18446744073709551615) 00002000:00010000:3.0:1746144906.823588:0:31844:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e39500. 00002000:00010000:1.0:1746144906.823589:0:31840:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e39f80. 00000100:00100000:3.0:1746144906.823605:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4224 00000100:00100000:3.0:1746144906.823611:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1985:x1830965175370624:12345-192.168.202.16@tcp:10:dd.0 00000100:00100000:1.0:1746144906.823618:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4225 00000100:00100000:1.0:1746144906.823623:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175370496:12345-192.168.202.16@tcp:10:dd.0 00002000:00010000:1.0:1746144906.823906:0:31840:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746144906.823908:0:31840:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb mtime from disk: 0 -> 1746144907 00002000:00010000:1.0:1746144906.823911:0:31840:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746144906.823914:0:31840:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb ctime from disk: 0 -> 1746144907 00002000:00010000:1.0:1746144906.823915:0:31840:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:3.0:1746144906.823932:0:31844:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746144906.823934:0:31844:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb mtime from disk: 0 -> 1746144907 00002000:00010000:3.0:1746144906.823936:0:31844:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746144906.823937:0:31844:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb ctime from disk: 0 -> 1746144907 00002000:00010000:3.0:1746144906.823939:0:31844:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1746144906.823946:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175370496:12345-192.168.202.16@tcp:10:dd.0 Request processed in 323us (530us total) trans 4294968057 rc 0/0 00000100:00100000:3.0:1746144906.823951:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175370624:12345-192.168.202.16@tcp:10:dd.0 Request processed in 341us (451us total) trans 4294968536 rc 0/0 00000100:00100000:1.0:1746144906.823953:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4225 00000100:00100000:3.0:1746144906.823956:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4224 00002000:00010000:1.0:1746144906.823956:0:31840:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/26 (0->18446744073709551615) 00002000:00010000:3.0:1746144906.823958:0:31844:0:(ofd_dev.c:2706:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/26 (0->18446744073709551615) 00002000:00100000:1.0:1746144906.823958:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e39f80 with x1830965175370496 ext(0->18446744073709551615) 00002000:00100000:3.0:1746144906.823960:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e39500 with x1830965175370624 ext(0->18446744073709551615) 00002000:00010000:1.0:1746144906.823961:0:31840:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e39f80. 00002000:00010000:3.0:1746144906.823963:0:31844:0:(ofd_dev.c:2711:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e39500. 00000100:00100000:1.0:1746144907.084362:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880087e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172542080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746144907.084432:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144907.085691:0:8434:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172542080 00000100:00100000:3.0:1746144907.085701:0:8434:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172542080 00000100:00100000:3.0:1746144907.085776:0:8434:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1746144907.085785:0:8434:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801358ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172542080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746144907.085835:0:8434:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 381485056 pending 1703936 free 3855613952 avail 3853516800 00000100:00100000:3.0:1746144907.085880:0:8434:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801358ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172542080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (1448us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144907.085887:0:8434:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00080000:0.0:1746144907.085954:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746144907.086011:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880087e3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172542080:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746144907.130061:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.130263:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175370880 00000100:00100000:1.0:1746144907.130272:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175370880 00002000:00100000:1.0:1746144907.130323:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (0->1048575) req@ffff880087e38000 x1830965175370880/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.130332:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38000 with x1830965175370880 ext(0->1048575) 00002000:00010000:1.0:1746144907.130337:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e38000 00000100:00100000:1.0:1746144907.130372:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4226 00000100:00100000:1.0:1746144907.130380:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1983:x1830965175370880:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144907.136758:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.136845:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175371136 00000100:00100000:3.0:1746144907.136855:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175371136 00002000:00100000:3.0:1746144907.136915:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1a:0x0] (0->1048575) req@ffff880087e38700 x1830965175371136/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.136925:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38700 with x1830965175371136 ext(0->1048575) 00002000:00010000:3.0:1746144907.136931:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e38700 00000100:00100000:3.0:1746144907.136966:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4227 00000100:00100000:3.0:1746144907.136973:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175371136:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144907.147120:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1983:x1830965175370880:12345-192.168.202.16@tcp:4:dd.0 Request processed in 16730us (17057us total) trans 4294968058 rc 0/0 00000100:00100000:1.0:1746144907.147133:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4226 00002000:00100000:1.0:1746144907.147144:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (0->1048575) req@ffff880087e38000 x1830965175370880/t4294968058(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.147159:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38000 with x1830965175370880 ext(0->1048575) 00002000:00010000:1.0:1746144907.147165:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e38000 00000100:00100000:2.0:1746144907.150707:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.150802:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175371392 00000100:00100000:1.0:1746144907.150812:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175371392 00002000:00100000:1.0:1746144907.150872:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (1048576->2097151) req@ffff8800925a9c00 x1830965175371392/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.150881:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9c00 with x1830965175371392 ext(1048576->2097151) 00002000:00010000:1.0:1746144907.150885:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925a9c00 00000100:00100000:1.0:1746144907.150917:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4228 00000100:00100000:1.0:1746144907.150924:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1982:x1830965175371392:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144907.155291:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.155396:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175371648 00000100:00100000:2.0:1746144907.155405:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175371648 00002000:00100000:2.0:1746144907.155512:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (1048576->2097151) req@ffff880087e3a680 x1830965175371648/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.155522:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3a680 with x1830965175371648 ext(1048576->2097151) 00002000:00010000:2.0:1746144907.155528:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e3a680 00000100:00100000:2.0:1746144907.155550:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4229 00000100:00100000:2.0:1746144907.155681:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175371648:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144907.159620:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1983:x1830965175371136:12345-192.168.202.16@tcp:4:dd.0 Request processed in 22633us (22856us total) trans 4294968537 rc 0/0 00000100:00100000:2.0:1746144907.159632:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4227 00002000:00100000:2.0:1746144907.159642:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1a:0x0] (0->1048575) req@ffff880087e38700 x1830965175371136/t4294968537(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.159650:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38700 with x1830965175371136 ext(0->1048575) 00002000:00010000:2.0:1746144907.159656:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e38700 00000100:00100000:1.0:1746144907.161388:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+14:1982:x1830965175371392:12345-192.168.202.16@tcp:4:dd.0 Request processed in 10457us (10685us total) trans 4294968059 rc 0/0 00000100:00100000:1.0:1746144907.161397:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4228 00002000:00100000:1.0:1746144907.161405:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (1048576->2097151) req@ffff8800925a9c00 x1830965175371392/t4294968059(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.161414:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9c00 with x1830965175371392 ext(1048576->2097151) 00002000:00010000:1.0:1746144907.161417:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925a9c00 00000100:00100000:2.0:1746144907.161900:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.161953:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175371904 00000100:00100000:1.0:1746144907.161960:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175371904 00002000:00100000:1.0:1746144907.161985:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (2097152->3145727) req@ffff8800925a9880 x1830965175371904/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.161993:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9880 with x1830965175371904 ext(2097152->3145727) 00002000:00010000:1.0:1746144907.161996:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925a9880 00000100:00100000:1.0:1746144907.162021:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4230 00000100:00100000:1.0:1746144907.162027:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+14:1985:x1830965175371904:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144907.163183:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1984:x1830965175371648:12345-192.168.202.16@tcp:4:dd.0 Request processed in 7622us (7898us total) trans 4294968538 rc 0/0 00000100:00100000:2.0:1746144907.163192:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4229 00002000:00100000:2.0:1746144907.163199:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (1048576->2097151) req@ffff880087e3a680 x1830965175371648/t4294968538(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.163206:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3a680 with x1830965175371648 ext(1048576->2097151) 00002000:00010000:2.0:1746144907.163210:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e3a680 00000100:00100000:1.0:1746144907.167898:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1985:x1830965175371904:12345-192.168.202.16@tcp:4:dd.0 Request processed in 5863us (5991us total) trans 4294968060 rc 0/0 00000100:00100000:1.0:1746144907.167908:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4230 00002000:00100000:1.0:1746144907.167917:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (2097152->3145727) req@ffff8800925a9880 x1830965175371904/t4294968060(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.167925:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a9880 with x1830965175371904 ext(2097152->3145727) 00002000:00010000:1.0:1746144907.167931:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925a9880 00000100:00100000:0.0:1746144907.169677:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.169728:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175372160 00000100:00100000:1.0:1746144907.169736:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175372160 00002000:00100000:1.0:1746144907.169799:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (2097152->3145727) req@ffff880087e3b800 x1830965175372160/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.169808:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3b800 with x1830965175372160 ext(2097152->3145727) 00002000:00010000:1.0:1746144907.169812:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e3b800 00000100:00100000:1.0:1746144907.169851:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4231 00000100:00100000:1.0:1746144907.169858:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1984:x1830965175372160:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144907.175105:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+13:1984:x1830965175372160:12345-192.168.202.16@tcp:4:dd.0 Request processed in 5239us (5424us total) trans 4294968539 rc 0/0 00000100:00100000:1.0:1746144907.175117:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4231 00002000:00100000:1.0:1746144907.175127:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (2097152->3145727) req@ffff880087e3b800 x1830965175372160/t4294968539(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.175136:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3b800 with x1830965175372160 ext(2097152->3145727) 00002000:00010000:1.0:1746144907.175142:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e3b800 00000100:00100000:0.0:1746144907.176454:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.176714:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175372416 00000100:00100000:1.0:1746144907.176721:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175372416 00002000:00100000:1.0:1746144907.176749:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (3145728->4194303) req@ffff880087e3b480 x1830965175372416/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.176756:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3b480 with x1830965175372416 ext(3145728->4194303) 00002000:00010000:1.0:1746144907.176874:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e3b480 00000100:00100000:1.0:1746144907.176985:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4232 00000100:00100000:1.0:1746144907.176992:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1985:x1830965175372416:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144907.184018:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1985:x1830965175372416:12345-192.168.202.16@tcp:4:dd.0 Request processed in 7017us (7560us total) trans 4294968061 rc 0/0 00000100:00100000:1.0:1746144907.184028:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4232 00002000:00100000:1.0:1746144907.184038:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (3145728->4194303) req@ffff880087e3b480 x1830965175372416/t4294968061(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.184046:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3b480 with x1830965175372416 ext(3145728->4194303) 00002000:00010000:1.0:1746144907.184051:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e3b480 00000100:00100000:0.0:1746144907.185287:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.185364:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175372672 00000100:00100000:1.0:1746144907.185371:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175372672 00002000:00100000:1.0:1746144907.185400:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (3145728->4194303) req@ffff880087e3bb80 x1830965175372672/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.185408:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3bb80 with x1830965175372672 ext(3145728->4194303) 00002000:00010000:1.0:1746144907.185412:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e3bb80 00000100:00100000:1.0:1746144907.185469:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4233 00000100:00100000:1.0:1746144907.185477:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+13:1985:x1830965175372672:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144907.191229:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.191298:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175372928 00000100:00100000:3.0:1746144907.191306:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175372928 00002000:00100000:3.0:1746144907.191342:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (4194304->5242879) req@ffff880087e38e00 x1830965175372928/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.191352:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38e00 with x1830965175372928 ext(4194304->5242879) 00002000:00010000:3.0:1746144907.191357:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e38e00 00000100:00100000:2.0:1746144907.191948:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+15:1985:x1830965175372672:12345-192.168.202.16@tcp:4:dd.0 Request processed in 6470us (6663us total) trans 4294968540 rc 0/0 00000100:00100000:2.0:1746144907.191957:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4233 00002000:00100000:2.0:1746144907.191963:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (3145728->4194303) req@ffff880087e3bb80 x1830965175372672/t4294968540(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.191971:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3bb80 with x1830965175372672 ext(3145728->4194303) 00002000:00010000:2.0:1746144907.191975:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e3bb80 00000100:00100000:2.0:1746144907.191991:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4234 00000100:00100000:2.0:1746144907.191998:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1984:x1830965175372928:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144907.199085:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1984:x1830965175372928:12345-192.168.202.16@tcp:4:dd.0 Request processed in 7080us (7857us total) trans 4294968062 rc 0/0 00000100:00100000:2.0:1746144907.199095:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4234 00002000:00100000:2.0:1746144907.199105:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (4194304->5242879) req@ffff880087e38e00 x1830965175372928/t4294968062(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.199114:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38e00 with x1830965175372928 ext(4194304->5242879) 00002000:00010000:2.0:1746144907.199119:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e38e00 00000100:00100000:0.0:1746144907.200192:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.200237:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175373184 00000100:00100000:2.0:1746144907.200245:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175373184 00002000:00100000:2.0:1746144907.200275:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (4194304->5242879) req@ffff880087e39180 x1830965175373184/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.200283:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e39180 with x1830965175373184 ext(4194304->5242879) 00002000:00010000:2.0:1746144907.200287:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e39180 00000100:00100000:2.0:1746144907.200312:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4235 00000100:00100000:2.0:1746144907.200318:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+15:1985:x1830965175373184:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144907.205902:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.206292:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175373440 00000100:00100000:1.0:1746144907.206301:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175373440 00002000:00100000:1.0:1746144907.206336:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1a:0x0] (5242880->6291455) req@ffff8800925ab480 x1830965175373440/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.206345:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab480 with x1830965175373440 ext(5242880->6291455) 00002000:00010000:1.0:1746144907.206349:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925ab480 00000100:00100000:2.0:1746144907.207379:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1985:x1830965175373184:12345-192.168.202.16@tcp:4:dd.0 Request processed in 7056us (7185us total) trans 4294968541 rc 0/0 00000100:00100000:2.0:1746144907.207386:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4235 00002000:00100000:2.0:1746144907.207393:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (4194304->5242879) req@ffff880087e39180 x1830965175373184/t4294968541(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.207400:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e39180 with x1830965175373184 ext(4194304->5242879) 00002000:00010000:2.0:1746144907.207404:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e39180 00000100:00100000:2.0:1746144907.207421:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4236 00000100:00100000:2.0:1746144907.207427:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1984:x1830965175373440:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144907.212832:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.214850:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175373696 00000100:00100000:1.0:1746144907.214861:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175373696 00002000:00100000:1.0:1746144907.214900:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1a:0x0] (5242880->6291455) req@ffff880087e3b100 x1830965175373696/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.214910:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3b100 with x1830965175373696 ext(5242880->6291455) 00002000:00010000:1.0:1746144907.214915:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e3b100 00000100:00100000:1.0:1746144907.214949:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4237 00000100:00100000:1.0:1746144907.214957:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+17:1984:x1830965175373696:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144907.216436:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1984:x1830965175373440:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9004us (10535us total) trans 4294968063 rc 0/0 00000100:00100000:0.0:1746144907.216444:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4236 00002000:00100000:0.0:1746144907.216451:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (5242880->6291455) req@ffff8800925ab480 x1830965175373440/t4294968063(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144907.216458:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925ab480 with x1830965175373440 ext(5242880->6291455) 00002000:00010000:0.0:1746144907.216463:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925ab480 00000100:00100000:0.0:1746144907.218350:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.220172:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175373952 00000100:00100000:1.0:1746144907.220182:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175373952 00002000:00100000:1.0:1746144907.220220:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (6291456->7340031) req@ffff880087e38a80 x1830965175373952/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.220227:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38a80 with x1830965175373952 ext(6291456->7340031) 00002000:00010000:1.0:1746144907.220232:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e38a80 00000100:00100000:1.0:1746144907.220265:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4238 00000100:00100000:1.0:1746144907.220272:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1984:x1830965175373952:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144907.222726:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1984:x1830965175373696:12345-192.168.202.16@tcp:4:dd.0 Request processed in 7761us (9902us total) trans 4294968542 rc 0/0 00000100:00100000:1.0:1746144907.222736:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4237 00002000:00100000:1.0:1746144907.222746:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1a:0x0] (5242880->6291455) req@ffff880087e3b100 x1830965175373696/t4294968542(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.222755:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3b100 with x1830965175373696 ext(5242880->6291455) 00002000:00010000:1.0:1746144907.222772:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e3b100 00000100:00100000:0.0:1746144907.224785:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.225031:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175374208 00000100:00100000:1.0:1746144907.225040:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175374208 00002000:00100000:1.0:1746144907.225072:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1a:0x0] (6291456->7340031) req@ffff880087e3ad80 x1830965175374208/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.225081:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3ad80 with x1830965175374208 ext(6291456->7340031) 00002000:00010000:1.0:1746144907.225086:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e3ad80 00000100:00100000:1.0:1746144907.225116:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4239 00000100:00100000:1.0:1746144907.225122:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1985:x1830965175374208:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144907.228559:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1984:x1830965175373952:12345-192.168.202.16@tcp:4:dd.0 Request processed in 8279us (10207us total) trans 4294968064 rc 0/0 00000100:00100000:1.0:1746144907.228570:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4238 00002000:00100000:1.0:1746144907.228580:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (6291456->7340031) req@ffff880087e38a80 x1830965175373952/t4294968064(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.228589:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38a80 with x1830965175373952 ext(6291456->7340031) 00002000:00010000:1.0:1746144907.228598:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e38a80 00000100:00100000:1.0:1746144907.231938:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1985:x1830965175374208:12345-192.168.202.16@tcp:4:dd.0 Request processed in 6807us (7174us total) trans 4294968543 rc 0/0 00000100:00100000:1.0:1746144907.231949:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4239 00002000:00100000:1.0:1746144907.231958:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1a:0x0] (6291456->7340031) req@ffff880087e3ad80 x1830965175374208/t4294968543(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.231966:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3ad80 with x1830965175374208 ext(6291456->7340031) 00002000:00010000:1.0:1746144907.231972:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e3ad80 00000100:00100000:2.0:1746144907.232063:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.232224:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175374464 00000100:00100000:1.0:1746144907.232230:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175374464 00002000:00100000:1.0:1746144907.232255:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1a:0x0] (7340032->8388607) req@ffff8800925aaa00 x1830965175374464/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.232262:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925aaa00 with x1830965175374464 ext(7340032->8388607) 00002000:00010000:1.0:1746144907.232265:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925aaa00 00000100:00100000:1.0:1746144907.232873:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4240 00000100:00100000:1.0:1746144907.232881:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1984:x1830965175374464:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144907.239219:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.239847:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1984:x1830965175374464:12345-192.168.202.16@tcp:4:dd.0 Request processed in 6966us (7783us total) trans 4294968065 rc 0/0 00000100:00100000:1.0:1746144907.239857:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4240 00002000:00100000:1.0:1746144907.239866:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1a:0x0] (7340032->8388607) req@ffff8800925aaa00 x1830965175374464/t4294968065(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.239875:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925aaa00 with x1830965175374464 ext(7340032->8388607) 00002000:00010000:1.0:1746144907.239879:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925aaa00 00000100:00100000:1.0:1746144907.239895:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175374720 00000100:00100000:1.0:1746144907.239900:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175374720 00002000:00100000:1.0:1746144907.239919:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1a:0x0] (7340032->8388607) req@ffff8800925a8e00 x1830965175374720/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.239925:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a8e00 with x1830965175374720 ext(7340032->8388607) 00002000:00010000:1.0:1746144907.239927:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800925a8e00 00000100:00100000:1.0:1746144907.239945:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4241 00000100:00100000:1.0:1746144907.239950:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+21:1984:x1830965175374720:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144907.246528:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.246709:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175374976 00000100:00100000:3.0:1746144907.246716:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175374976 00002000:00100000:3.0:1746144907.246749:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (8388608->9437183) req@ffff880087e39c00 x1830965175374976/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.246759:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e39c00 with x1830965175374976 ext(8388608->9437183) 00002000:00010000:3.0:1746144907.246791:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e39c00 00000100:00100000:3.0:1746144907.246810:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4242 00000100:00100000:3.0:1746144907.246825:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1985:x1830965175374976:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144907.249352:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965175374720:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9395us (10134us total) trans 4294968544 rc 0/0 00000100:00100000:1.0:1746144907.249363:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4241 00002000:00100000:1.0:1746144907.249371:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1a:0x0] (7340032->8388607) req@ffff8800925a8e00 x1830965175374720/t4294968544(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.249380:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a8e00 with x1830965175374720 ext(7340032->8388607) 00002000:00010000:1.0:1746144907.249384:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800925a8e00 00000100:00100000:0.0:1746144907.254139:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.254206:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175375232 00000100:00100000:1.0:1746144907.254214:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175375232 00002000:00100000:1.0:1746144907.254247:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1a:0x0] (8388608->9437183) req@ffff880087e38380 x1830965175375232/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.254256:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38380 with x1830965175375232 ext(8388608->9437183) 00002000:00010000:1.0:1746144907.254261:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e38380 00000100:00100000:1.0:1746144907.254288:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4243 00000100:00100000:1.0:1746144907.254295:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965175375232:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144907.255909:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1985:x1830965175374976:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9079us (9386us total) trans 4294968066 rc 0/0 00000100:00100000:2.0:1746144907.255917:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4242 00002000:00100000:2.0:1746144907.255923:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (8388608->9437183) req@ffff880087e39c00 x1830965175374976/t4294968066(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.255930:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e39c00 with x1830965175374976 ext(8388608->9437183) 00002000:00010000:2.0:1746144907.255934:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e39c00 00000100:00100000:2.0:1746144907.263034:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.263832:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175375488 00000100:00100000:3.0:1746144907.263840:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175375488 00002000:00100000:3.0:1746144907.263876:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (9437184->10485759) req@ffff8800935efb80 x1830965175375488/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.263885:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935efb80 with x1830965175375488 ext(9437184->10485759) 00002000:00010000:3.0:1746144907.263890:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935efb80 00000100:00100000:3.0:1746144907.263920:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4244 00000100:00100000:3.0:1746144907.263926:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1985:x1830965175375488:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144907.264010:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1984:x1830965175375232:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9708us (9873us total) trans 4294968545 rc 0/0 00000100:00100000:1.0:1746144907.264020:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4243 00002000:00100000:1.0:1746144907.264029:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1a:0x0] (8388608->9437183) req@ffff880087e38380 x1830965175375232/t4294968545(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.264038:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e38380 with x1830965175375232 ext(8388608->9437183) 00002000:00010000:1.0:1746144907.264043:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087e38380 00000100:00100000:2.0:1746144907.270365:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.270524:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175375744 00000100:00100000:3.0:1746144907.270533:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175375744 00002000:00100000:3.0:1746144907.270568:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (9437184->10485759) req@ffff8800935edc00 x1830965175375744/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.270581:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935edc00 with x1830965175375744 ext(9437184->10485759) 00002000:00010000:3.0:1746144907.270587:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935edc00 00000100:00100000:3.0:1746144907.270619:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4245 00000100:00100000:3.0:1746144907.270625:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800935edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1984:x1830965175375744:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144907.271677:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1985:x1830965175375488:12345-192.168.202.16@tcp:4:dd.0 Request processed in 7747us (8648us total) trans 4294968067 rc 0/0 00000100:00100000:2.0:1746144907.271684:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4244 00002000:00100000:2.0:1746144907.271690:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (9437184->10485759) req@ffff8800935efb80 x1830965175375488/t4294968067(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.271698:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935efb80 with x1830965175375488 ext(9437184->10485759) 00002000:00010000:2.0:1746144907.271701:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800935efb80 00000100:00100000:0.0:1746144907.277630:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.277822:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175376000 00000100:00100000:3.0:1746144907.277831:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175376000 00002000:00100000:3.0:1746144907.277868:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (10485760->11534335) req@ffff880087e3aa00 x1830965175376000/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.277878:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3aa00 with x1830965175376000 ext(10485760->11534335) 00002000:00010000:3.0:1746144907.277882:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e3aa00 00000100:00100000:3.0:1746144907.277911:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4246 00000100:00100000:3.0:1746144907.277917:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1985:x1830965175376000:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144907.284453:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.284775:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175376256 00000100:00100000:1.0:1746144907.284826:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175376256 00002000:00100000:1.0:1746144907.284875:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1a:0x0] (10485760->11534335) req@ffff88008f38c000 x1830965175376256/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.284886:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38c000 with x1830965175376256 ext(10485760->11534335) 00002000:00010000:1.0:1746144907.284892:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f38c000 00000100:00100000:1.0:1746144907.284927:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4247 00000100:00100000:1.0:1746144907.284934:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1984:x1830965175376256:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144907.286492:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800935edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+29:1984:x1830965175375744:12345-192.168.202.16@tcp:4:dd.0 Request processed in 15861us (16129us total) trans 4294968546 rc 0/0 00000100:00100000:3.0:1746144907.286502:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4245 00002000:00100000:3.0:1746144907.286512:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (9437184->10485759) req@ffff8800935edc00 x1830965175375744/t4294968546(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.286520:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800935edc00 with x1830965175375744 ext(9437184->10485759) 00002000:00010000:3.0:1746144907.286525:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800935edc00 00000100:00100000:3.0:1746144907.290247:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1985:x1830965175376000:12345-192.168.202.16@tcp:4:dd.0 Request processed in 12319us (12612us total) trans 4294968068 rc 0/0 00000100:00100000:3.0:1746144907.290263:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4246 00002000:00100000:3.0:1746144907.290274:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (10485760->11534335) req@ffff880087e3aa00 x1830965175376000/t4294968068(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.290285:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087e3aa00 with x1830965175376000 ext(10485760->11534335) 00002000:00010000:3.0:1746144907.290291:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087e3aa00 00000100:00100000:2.0:1746144907.292548:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.293557:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175376512 00000100:00100000:3.0:1746144907.293566:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175376512 00002000:00100000:3.0:1746144907.293600:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (11534336->12582911) req@ffff880093369f80 x1830965175376512/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.293609:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369f80 with x1830965175376512 ext(11534336->12582911) 00002000:00010000:3.0:1746144907.293613:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093369f80 00000100:00100000:3.0:1746144907.293637:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4248 00000100:00100000:3.0:1746144907.293643:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1985:x1830965175376512:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144907.296491:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+29:1984:x1830965175376256:12345-192.168.202.16@tcp:4:dd.0 Request processed in 11543us (12035us total) trans 4294968547 rc 0/0 00000100:00100000:1.0:1746144907.296512:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4247 00002000:00100000:1.0:1746144907.297020:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1a:0x0] (10485760->11534335) req@ffff88008f38c000 x1830965175376256/t4294968547(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.297031:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38c000 with x1830965175376256 ext(10485760->11534335) 00002000:00010000:1.0:1746144907.297038:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f38c000 00000100:00100000:0.0:1746144907.298420:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.299092:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175376768 00000100:00100000:2.0:1746144907.299103:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175376768 00002000:00100000:2.0:1746144907.299144:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1a:0x0] (11534336->12582911) req@ffff88009bae1880 x1830965175376768/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.299155:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae1880 with x1830965175376768 ext(11534336->12582911) 00002000:00010000:2.0:1746144907.299160:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bae1880 00000100:00100000:2.0:1746144907.299178:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4249 00000100:00100000:2.0:1746144907.299186:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+29:1985:x1830965175376768:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144907.302315:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1985:x1830965175376512:12345-192.168.202.16@tcp:4:dd.0 Request processed in 8662us (9767us total) trans 4294968069 rc 0/0 00000100:00100000:3.0:1746144907.302325:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4248 00002000:00100000:3.0:1746144907.302335:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (11534336->12582911) req@ffff880093369f80 x1830965175376512/t4294968069(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.302344:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369f80 with x1830965175376512 ext(11534336->12582911) 00002000:00010000:3.0:1746144907.302349:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093369f80 00000100:00100000:2.0:1746144907.305025:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.305064:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.305129:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175377280 00000100:00100000:3.0:1746144907.305134:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175377152 00000100:00100000:1.0:1746144907.305137:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175377280 00000100:00100000:3.0:1746144907.305138:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175377152 00002000:00100000:3.0:1746144907.305166:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (12582912->13631487) req@ffff880093369c00 x1830965175377152/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00000100:00100000:1.0:1746144907.305170:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 160 00000100:00100000:1.0:1746144907.305176:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a621cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1098:x1830965175377280:12345-192.168.202.16@tcp:35:dd.0 00002000:00100000:3.0:1746144907.305177:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369c00 with x1830965175377152 ext(12582912->13631487) 00002000:00010000:3.0:1746144907.305180:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093369c00 00000100:00100000:3.0:1746144907.305195:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4250 00000100:00100000:3.0:1746144907.305198:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1985:x1830965175377152:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144907.305409:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a621cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1098:x1830965175377280:12345-192.168.202.16@tcp:35:dd.0 Request processed in 233us (391us total) trans 4294987512 rc 0/0 00000100:00100000:1.0:1746144907.305416:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 160 00000100:00100000:3.0:1746144907.305673:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965175376768:12345-192.168.202.16@tcp:4:dd.0 Request processed in 6488us (7260us total) trans 4294968548 rc 0/0 00000100:00100000:3.0:1746144907.305677:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4249 00002000:00100000:3.0:1746144907.305681:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1a:0x0] (11534336->12582911) req@ffff88009bae1880 x1830965175376768/t4294968548(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.305686:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae1880 with x1830965175376768 ext(11534336->12582911) 00002000:00010000:3.0:1746144907.305688:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bae1880 00000100:00100000:3.0:1746144907.314171:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093369c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1985:x1830965175377152:12345-192.168.202.16@tcp:4:dd.0 Request processed in 8961us (9095us total) trans 4294968070 rc 0/0 00000100:00100000:3.0:1746144907.314181:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4250 00002000:00100000:3.0:1746144907.314190:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (12582912->13631487) req@ffff880093369c00 x1830965175377152/t4294968070(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.314198:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369c00 with x1830965175377152 ext(12582912->13631487) 00002000:00010000:3.0:1746144907.314203:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093369c00 00000100:00100000:0.0:1746144907.325670:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.325799:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175377408 00000100:00100000:3.0:1746144907.325807:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175377408 00000100:00100000:3.0:1746144907.325869:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48252 00000100:00100000:3.0:1746144907.325877:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1103:x1830965175377408:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1746144907.325899:0:10400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144907.325919:0:10400:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c400/0x4076af6727515d46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9552d expref: -99 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.325974:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d4d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144907.325985:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144907.325995:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000004:00200000:3.0:1746144907.326037:0:10400:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:3.0:1746144907.326039:0:10400:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 27 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144907.326051:0:10400:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d4d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:3.0:1746144907.326067:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c400/0x4076af6727515d46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9552d expref: 30 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.326081:0:10400:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d4d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9552d expref: 29 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.326088:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009a8b7300) 00010000:00010000:3.0:1746144907.326090:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746144907.326093:0:10400:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:3.0:1746144907.326130:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+29:1103:x1830965175377408:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 254us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144907.326135:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48252 00010000:00010000:2.0:1746144907.633070:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746144907.665176:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.665273:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175377664 00000100:00100000:0.0:1746144907.665280:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175377664 00000100:00100000:0.0:1746144907.665324:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48253 00000100:00100000:0.0:1746144907.665330:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+29:1114:x1830965175377664:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1746144907.665346:0:21076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144907.665349:0:21076:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746144907.665370:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d4d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9552d expref: 29 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144907.665383:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009a8b7300) 00010000:00010000:0.0:1746144907.665392:0:21076:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746144907.665401:0:21076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ec400/0x4076af6727515d54 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95534 expref: -99 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144907.665491:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515d5b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.665498:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515d5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.665504:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515d5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.665510:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515d62 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.665513:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515d62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.665516:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515d62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.665864:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7bc00/0x4076af6727515d69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.665871:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7bc00/0x4076af6727515d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.665877:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7bc00/0x4076af6727515d69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000004:00200000:0.0:1746144907.665884:0:21076:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 0 00010000:00010000:0.0:1746144907.665898:0:21076:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515d5b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.665904:0:21076:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515d5b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.665909:0:21076:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515d5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.665914:0:21076:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a41edc00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144907.665917:0:21076:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515d5b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.665923:0:21076:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515d5b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.665930:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800917b0400) 00010000:00010000:0.0:1746144907.665932:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144907.665934:0:21076:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515d5b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.665938:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41edc00/0x4076af6727515d5b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00000004:00010000:0.0:1746144907.665944:0:21076:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880093368700 reply state ffff88009b70b000 transno 4294987513 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515d62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000100:00100000:0.0:1746144907.665949:0:21076:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746144907.665965:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ec400/0x4076af6727515d54 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95534 expref: 31 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144907.665976:0:21076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7bc00/0x4076af6727515d69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95534 expref: 30 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144907.665981:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8800917b0f00) 00010000:00010000:0.0:1746144907.665983:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746144907.665984:0:21076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ba7bc00, rc 0) 00000100:00100000:0.0:1746144907.666034:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1114:x1830965175377664:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 703us (863us total) trans 4294987513 rc 0/0 00000100:00100000:0.0:1746144907.666039:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48253 00010000:00010000:3.0:1746144907.667447:0:3292:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515d62 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.667457:0:3292:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515d62 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.667462:0:3292:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515d62 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.667465:0:3292:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a41ed000 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144907.667468:0:3292:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515d62 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.667471:0:3292:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515d62 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.667480:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff8800917b0500) 00010000:00010000:3.0:1746144907.667482:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144907.667484:0:3292:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515d62 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.667488:0:3292:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a41ed000/0x4076af6727515d62 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00000100:00100000:0.0:1746144907.668061:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.668121:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175377920 00000100:00100000:2.0:1746144907.668127:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175377920 00000100:00100000:2.0:1746144907.668164:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48254 00000100:00100000:2.0:1746144907.668171:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1114:x1830965175377920:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1746144907.668186:0:21076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144907.668196:0:21076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5f400/0x4076af6727515d77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9553b expref: -99 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.668249:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5e600/0x4076af6727515d7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.668261:0:21076:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7bc00/0x4076af6727515d69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95534 expref: 31 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.668266:0:21076:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5e600/0x4076af6727515d7e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.668288:0:21076:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7bc00/0x4076af6727515d69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95534 expref: 31 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.668297:0:21076:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7bc00/0x4076af6727515d69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95534 expref: 31 pid: 21076 timeout: 601 lvb_type: 0 00000100:00100000:2.0:1746144907.668312:0:21076:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093368e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21076:1830965172542208:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144907.668371:0:21076:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3240 going to sleep for 11 seconds 00000100:00100000:2.0:1746144907.669516:0:21076:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093368e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21076:1830965172542208:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144907.669538:0:21076:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5e600/0x4076af6727515d7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000100:00100000:0.0:1746144907.669641:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.669699:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175378048 00000100:00100000:2.0:1746144907.669702:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175378048 00010000:00010000:2.0:1746144907.669717:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7bc00/0x4076af6727515d69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95534 expref: 32 pid: 21076 timeout: 601 lvb_type: 0 00000100:00100000:2.0:1746144907.669735:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11283 00000100:00100000:2.0:1746144907.669740:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1985:x1830965175378048:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144907.669747:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144907.669751:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7bc00/0x4076af6727515d69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95534 expref: 32 pid: 21076 timeout: 601 lvb_type: 0 00010000:00010000:2.0:1746144907.669780:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7bc00/0x4076af6727515d69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95534 expref: 32 pid: 21076 timeout: 601 lvb_type: 0 00010000:00010000:2.0:1746144907.669793:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ba7bc00/0x4076af6727515d69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95534 expref: 32 pid: 21076 timeout: 601 lvb_type: 0 00010000:00010000:2.0:1746144907.669803:0:7098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8800917b0f00) 00010000:00010000:2.0:1746144907.669806:0:7098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5e600/0x4076af6727515d7e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.669825:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5e600/0x4076af6727515d7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.669830:0:7098:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5e600/0x4076af6727515d7e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.669850:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144907.669871:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965175378048:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 130us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144907.669877:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11283 00010000:00010000:3.0:1746144907.669967:0:21076:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5e600/0x4076af6727515d7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.669974:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5e600/0x4076af6727515d7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000004:00200000:3.0:1746144907.669986:0:21076:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 0 00000004:00080000:3.0:1746144907.670109:0:21076:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b:0x0], index 1: 0 00000004:00080000:3.0:1746144907.670115:0:21076:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b:0x0], index 0: 0 00010000:00010000:3.0:1746144907.670205:0:21076:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5e600/0x4076af6727515d7e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.670215:0:21076:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5e600/0x4076af6727515d7e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.670220:0:21076:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5e600/0x4076af6727515d7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.670225:0:21076:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5e600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144907.670228:0:21076:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5e600/0x4076af6727515d7e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.670234:0:21076:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5e600/0x4076af6727515d7e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.670241:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff8800917b0f00) 00010000:00010000:3.0:1746144907.670243:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144907.670246:0:21076:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5e600/0x4076af6727515d7e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.670256:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5e600/0x4076af6727515d7e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.670291:0:21076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5f400/0x4076af6727515d77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9553b expref: 31 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.670299:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5f400/0x4076af6727515d77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9553b expref: 31 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.670307:0:21076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5f400, rc 0) 00000100:00100000:3.0:1746144907.670337:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1114:x1830965175377920:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 2167us (2278us total) trans 4294987514 rc 301/301 00000100:00100000:3.0:1746144907.670343:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48254 00000100:00100000:0.0:1746144907.671144:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.671180:0:7114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175378304 00000100:00100000:2.0:1746144907.671184:0:7114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175378304 00000100:00100000:2.0:1746144907.671213:0:7114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 161 00000100:00100000:2.0:1746144907.671219:0:7114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1114:x1830965175378304:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1746144907.671361:0:7114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1114:x1830965175378304:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 142us (217us total) trans 4294987515 rc 0/0 00000100:00100000:2.0:1746144907.671367:0:7114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 161 00000100:00100000:0.0:1746144907.672805:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.672874:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175378432 00000100:00100000:3.0:1746144907.672878:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175378432 00000100:00100000:3.0:1746144907.672943:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48255 00000100:00100000:3.0:1746144907.672948:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1114:x1830965175378432:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1746144907.672960:0:21076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144907.672972:0:21076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a800/0x4076af6727515d8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95542 expref: -99 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.673005:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a800/0x4076af6727515d8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95542 expref: 32 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.673016:0:21076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a800/0x4076af6727515d8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95542 expref: 32 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.673029:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff88009a8b7c00) 00010000:00010000:3.0:1746144907.673031:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144907.673033:0:21076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009930a800, rc 0) 00000100:00100000:3.0:1746144907.673223:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1114:x1830965175378432:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 273us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144907.673228:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48255 00000100:00100000:0.0:1746144907.675416:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.675468:0:7114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175378688 00000100:00100000:2.0:1746144907.675474:0:7114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175378688 00000100:00100000:2.0:1746144907.675513:0:7114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 162 00000100:00100000:2.0:1746144907.675520:0:7114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1114:x1830965175378688:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1746144907.675652:0:7114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1114:x1830965175378688:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 132us (238us total) trans 4294987516 rc 0/0 00000100:00100000:2.0:1746144907.675658:0:7114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 162 00000100:00100000:0.0:1746144907.681925:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.682034:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175378816 00000100:00100000:3.0:1746144907.682042:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175378816 00000100:00100000:3.0:1746144907.682074:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48256 00000100:00100000:3.0:1746144907.682079:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1116:x1830965175378816:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:3.0:1746144907.682096:0:21076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144907.682111:0:21076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009930b600/0x4076af6727515d93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95549 expref: -99 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.682163:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d9a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.682174:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.682182:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000004:00200000:3.0:1746144907.682227:0:21076:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:3.0:1746144907.682229:0:21076:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 28 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144907.682240:0:21076:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d9a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144907.682256:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009930b600/0x4076af6727515d93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95549 expref: 18 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.682268:0:21076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95549 expref: 17 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.682274:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009a8b7300) 00010000:00010000:3.0:1746144907.682276:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1746144907.682279:0:21076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:3.0:1746144907.682314:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1116:x1830965175378816:12345-192.168.202.16@tcp:101:dd.0 Request processed in 234us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144907.682319:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48256 00000100:00100000:1.0:1746144907.682558:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.682593:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175378944 00000100:00100000:2.0:1746144907.682597:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175378944 00000100:00100000:2.0:1746144907.682621:0:10400:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48257 00000100:00100000:2.0:1746144907.682626:0:10400:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1115:x1830965175378944:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1746144907.682635:0:10400:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144907.682641:0:10400:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b6800/0x4076af6727515da1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95550 expref: -99 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.682662:0:10400:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7400/0x4076af6727515da8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144907.682669:0:10400:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7400/0x4076af6727515da8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144907.682675:0:10400:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7400/0x4076af6727515da8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00000004:00200000:2.0:1746144907.682699:0:10400:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 12800 00000004:00200000:2.0:1746144907.682701:0:10400:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 28 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144907.682707:0:10400:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7400/0x4076af6727515da8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10400 initiator: MDT0 00010000:00010000:2.0:1746144907.682719:0:10400:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b6800/0x4076af6727515da1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95550 expref: 35 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.682734:0:10400:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7400/0x4076af6727515da8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95550 expref: 34 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.682739:0:10400:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009a8b7300) 00010000:00010000:2.0:1746144907.682742:0:10400:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746144907.682743:0:10400:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d3b7400, rc 0) 00000100:00100000:2.0:1746144907.682855:0:10400:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1115:x1830965175378944:12345-192.168.202.16@tcp:101:dd.0 Request processed in 227us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144907.682860:0:10400:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48257 00000100:00100000:0.0:1746144907.684248:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.684281:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.684341:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175379328 00000100:00100000:3.0:1746144907.684346:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175379328 00000100:00100000:3.0:1746144907.684366:0:10400:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175379456 00000100:00100000:3.0:1746144907.684368:0:10400:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175379456 00000100:00100000:2.0:1746144907.684403:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48258 00000100:00100000:2.0:1746144907.684410:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1115:x1830965175379328:12345-192.168.202.16@tcp:101:dd.0 00000100:00100000:1.0:1746144907.684415:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48259 00010000:00010000:2.0:1746144907.684420:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144907.684421:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1116:x1830965175379456:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1746144907.684428:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7200/0x4076af6727515daf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95557 expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.684429:0:21076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144907.684434:0:21076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099537200/0x4076af6727515db6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9555e expref: -99 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.684483:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7000/0x4076af6727515dbd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.684488:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099536200/0x4076af6727515dc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.684491:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7000/0x4076af6727515dbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144907.684497:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7000/0x4076af6727515dbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144907.684506:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b6000/0x4076af6727515dcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144907.684511:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b6000/0x4076af6727515dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144907.684516:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b6000/0x4076af6727515dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144907.684586:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099500200/0x4076af6727515dd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144907.684592:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099500200/0x4076af6727515dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144907.684597:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099500200/0x4076af6727515dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:2.0:1746144907.684602:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 26214400 00010000:00010000:1.0:1746144907.684720:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099536200/0x4076af6727515dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.684727:0:7111:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7000/0x4076af6727515dbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.684727:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099536200/0x4076af6727515dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.684732:0:7111:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7000/0x4076af6727515dbd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.684734:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099537600/0x4076af6727515de0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.684738:0:7111:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7000/0x4076af6727515dbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.684739:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099537600/0x4076af6727515de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.684742:0:7111:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3b7000 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144907.684744:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099537600/0x4076af6727515de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.684745:0:7111:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7000/0x4076af6727515dbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144907.684750:0:7111:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7000/0x4076af6727515dbd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144907.684757:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009a8b7300) 00010000:00010000:2.0:1746144907.684760:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144907.684878:0:7111:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7000/0x4076af6727515dbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144907.684887:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7000/0x4076af6727515dbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144907.684895:0:7111:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b6000/0x4076af6727515dcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144907.684900:0:7111:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b6000/0x4076af6727515dcb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144907.684904:0:7111:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b6000/0x4076af6727515dcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144907.684908:0:7111:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d3b6000 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144907.684910:0:7111:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b6000/0x4076af6727515dcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144907.684914:0:7111:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b6000/0x4076af6727515dcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.684918:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc200/0x4076af6727515de7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.684921:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6ecf (ffff880099b35200) 00010000:00010000:2.0:1746144907.684923:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144907.684924:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc200/0x4076af6727515de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.684925:0:7111:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b6000/0x4076af6727515dcb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144907.684929:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b6000/0x4076af6727515dcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.684929:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc200/0x4076af6727515de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000004:00200000:1.0:1746144907.684934:0:21076:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 26214400 00010000:00010000:2.0:1746144907.684952:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7200/0x4076af6727515daf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95557 expref: 37 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.684961:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099500200/0x4076af6727515dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95557 expref: 36 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.684965:0:21076:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099536200/0x4076af6727515dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.684971:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca000) 00010000:00010000:2.0:1746144907.684973:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144907.684973:0:21076:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099536200/0x4076af6727515dc4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.684975:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099500200, rc 0) 00010000:00010000:1.0:1746144907.684977:0:21076:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099536200/0x4076af6727515dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144907.684980:0:21076:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099536200 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144907.684982:0:21076:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099536200/0x4076af6727515dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144907.684987:0:21076:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099536200/0x4076af6727515dc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144907.684992:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009a8b7300) 00010000:00010000:1.0:1746144907.684993:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144907.684995:0:21076:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099536200/0x4076af6727515dc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144907.684999:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099536200/0x4076af6727515dc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144907.685006:0:21076:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099537600/0x4076af6727515de0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00000100:00100000:2.0:1746144907.685010:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1115:x1830965175379328:12345-192.168.202.16@tcp:101:dd.0 Request processed in 601us (765us total) trans 4294987517 rc 0/0 00010000:00010000:1.0:1746144907.685014:0:21076:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099537600/0x4076af6727515de0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21076 initiator: MDT0 00000100:00100000:2.0:1746144907.685015:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48258 00010000:00010000:1.0:1746144907.685018:0:21076:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099537600/0x4076af6727515de0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144907.685022:0:21076:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099537600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144907.685024:0:21076:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099537600/0x4076af6727515de0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144907.685031:0:21076:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099537600/0x4076af6727515de0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144907.685036:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6ecf (ffff880099b35200) 00010000:00010000:1.0:1746144907.685037:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144907.685039:0:21076:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099537600/0x4076af6727515de0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144907.685043:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099537600/0x4076af6727515de0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144907.685062:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099537200/0x4076af6727515db6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9555e expref: 20 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.685070:0:21076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbc200/0x4076af6727515de7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9555e expref: 19 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.685074:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca000) 00010000:00010000:1.0:1746144907.685076:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144907.685077:0:21076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012dbbc200, rc 0) 00000100:00100000:1.0:1746144907.685096:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+19:1116:x1830965175379456:12345-192.168.202.16@tcp:101:dd.0 Request processed in 676us (814us total) trans 4294987518 rc 0/0 00000100:00100000:1.0:1746144907.685101:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48259 00000100:00100000:0.0:1746144907.687194:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.687243:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175379712 00000100:00100000:1.0:1746144907.687249:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175379712 00000100:00100000:1.0:1746144907.687421:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48260 00000100:00100000:1.0:1746144907.687428:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1115:x1830965175379712:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1746144907.687445:0:21076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144907.687449:0:21076:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746144907.687466:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012d3b7400/0x4076af6727515da8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95550 expref: 36 pid: 10400 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.687478:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009a8b7300) 00010000:00010000:1.0:1746144907.687481:0:21076:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144907.687488:0:21076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd400/0x4076af6727515df5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95565 expref: -99 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.687564:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515dfc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144907.687573:0:21076:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d9a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95549 expref: 18 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.687579:0:21076:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515dfc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:1.0:1746144907.687602:0:21076:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95549 expref: 18 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.687612:0:21076:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95549 expref: 18 pid: 21076 timeout: 601 lvb_type: 0 00000100:00100000:1.0:1746144907.687623:0:21076:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21076:1830965172542336:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144907.687686:0:21076:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4f10cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144907.690875:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.690936:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.690968:0:21076:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008e831880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21076:1830965172542336:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144907.690988:0:21076:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515dfc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000100:00100000:0.0:1746144907.693191:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175379840 00000100:00100000:0.0:1746144907.693202:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175379840 00000100:00100000:1.0:1746144907.693213:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175380096 00000100:00100000:1.0:1746144907.693217:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175380096 00010000:00010000:0.0:1746144907.693234:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95549 expref: 20 pid: 21076 timeout: 601 lvb_type: 0 00000100:00100000:0.0:1746144907.693252:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11284 00000100:00100000:1.0:1746144907.693253:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48261 00000100:00100000:1.0:1746144907.693259:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1116:x1830965175380096:12345-192.168.202.16@tcp:101:dd.0 00000100:00100000:0.0:1746144907.693259:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1985:x1830965175379840:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144907.693269:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144907.693274:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d9a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95549 expref: 20 pid: 21076 timeout: 601 lvb_type: 0 00010000:00010000:1.0:1746144907.693277:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144907.693283:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d9a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95549 expref: 20 pid: 21076 timeout: 601 lvb_type: 0 00010000:00010000:1.0:1746144907.693288:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515e03 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9556c expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144907.693298:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727515d9a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95549 expref: 21 pid: 21076 timeout: 601 lvb_type: 0 00010000:00010000:0.0:1746144907.693309:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009a8b7300) 00010000:00010000:0.0:1746144907.693313:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515dfc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.693320:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515dfc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.693328:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515dfc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144907.693344:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144907.693377:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1985:x1830965175379840:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 119us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144907.693382:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11284 00010000:00010000:1.0:1746144907.693435:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093666000/0x4076af6727515e0a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693442:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093666000/0x4076af6727515e0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693449:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093666000/0x4076af6727515e0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693461:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af6727515e11 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693466:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af6727515e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693470:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af6727515e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693521:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07800/0x4076af6727515e18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693527:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07800/0x4076af6727515e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693535:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07800/0x4076af6727515e18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:1.0:1746144907.693542:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 0 00010000:00010000:1.0:1746144907.693608:0:7111:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093666000/0x4076af6727515e0a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693614:0:7111:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093666000/0x4076af6727515e0a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693619:0:7111:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093666000/0x4076af6727515e0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693623:0:7111:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093666000 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144907.693626:0:7111:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093666000/0x4076af6727515e0a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693632:0:7111:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093666000/0x4076af6727515e0a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693638:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009a8b7300) 00010000:00010000:1.0:1746144907.693640:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144907.693643:0:7111:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093666000/0x4076af6727515e0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693646:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093666000/0x4076af6727515e0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693653:0:7111:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af6727515e11 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693657:0:7111:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af6727515e11 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693663:0:7111:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af6727515e11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693666:0:7111:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cf07400 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144907.693668:0:7111:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af6727515e11 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693671:0:7111:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af6727515e11 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693676:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff88009bbca500) 00010000:00010000:1.0:1746144907.693678:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144907.693679:0:7111:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af6727515e11 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693683:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af6727515e11 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144907.693709:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af6727515e03 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9556c expref: 21 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.693718:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07800/0x4076af6727515e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9556c expref: 20 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.693724:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff88009a8b7c00) 00010000:00010000:1.0:1746144907.693725:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144907.693727:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012cf07800, rc 0) 00000100:00100000:1.0:1746144907.693748:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1116:x1830965175380096:12345-192.168.202.16@tcp:101:dd.0 Request processed in 489us (2812us total) trans 4294987519 rc 0/0 00000100:00100000:1.0:1746144907.693753:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48261 00010000:00010000:2.0:1746144907.695044:0:21076:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515dfc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.695052:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515dfc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.695066:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009930b600/0x4076af6727515e26 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.695074:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009930b600/0x4076af6727515e26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.695080:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009930b600/0x4076af6727515e26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000004:00080000:2.0:1746144907.695307:0:21076:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c:0x0], index 1: 0 00010000:00010000:2.0:1746144907.695395:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091750400/0x4076af6727515e2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.695401:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091750400/0x4076af6727515e2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.695407:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091750400/0x4076af6727515e2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.695425:0:21076:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515dfc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.695430:0:21076:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515dfc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.695436:0:21076:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515dfc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.695440:0:21076:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbbd800 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144907.695442:0:21076:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515dfc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.695447:0:21076:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515dfc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.695454:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009a8b7300) 00010000:00010000:2.0:1746144907.695456:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144907.695458:0:21076:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515dfc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.695463:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd800/0x4076af6727515dfc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00000004:00010000:2.0:1746144907.695471:0:21076:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800924db800 reply state ffff88009279c000 transno 4294987520 ns: mdt-lustre-MDT0000_UUID lock: ffff88009930b600/0x4076af6727515e26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000100:00100000:2.0:1746144907.695476:0:21076:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1746144907.695493:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012dbbd400/0x4076af6727515df5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95565 expref: 38 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.695504:0:21076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091750400/0x4076af6727515e2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95565 expref: 37 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.695510:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff880099b35800) 00010000:00010000:2.0:1746144907.695512:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144907.695514:0:21076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091750400, rc 0) 00000100:00100000:2.0:1746144907.695544:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1115:x1830965175379712:12345-192.168.202.16@tcp:101:dd.0 Request processed in 8117us (8354us total) trans 4294987520 rc 0/0 00000100:00100000:2.0:1746144907.695550:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48260 00010000:00010000:2.0:1746144907.696931:0:3293:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009930b600/0x4076af6727515e26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.696941:0:3293:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009930b600/0x4076af6727515e26 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.696947:0:3293:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009930b600/0x4076af6727515e26 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.696951:0:3293:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009930b600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144907.696954:0:3293:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009930b600/0x4076af6727515e26 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.696959:0:3293:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009930b600/0x4076af6727515e26 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.696969:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6c9b94d9 (ffff880099b35500) 00010000:00010000:2.0:1746144907.696971:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144907.696973:0:3293:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009930b600/0x4076af6727515e26 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144907.696978:0:3293:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009930b600/0x4076af6727515e26 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6c9b94d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00000100:00100000:0.0:1746144907.697271:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.697450:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175380224 00000100:00100000:2.0:1746144907.697455:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175380224 00000100:00100000:2.0:1746144907.697495:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5875 00000100:00100000:2.0:1746144907.697501:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1116:x1830965175380224:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1746144907.697513:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144907.697522:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727515e3b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95573 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.697542:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b82a200/0x4076af6727515d38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9551f expref: 35 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.697548:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144907.697550:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144907.697553:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727515e3b lrc: 4/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95573 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746144907.697657:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746144907.698778:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009b82a200/0x4076af6727515d38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9551f expref: 35 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.698791:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009b82a200/0x4076af6727515d38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9551f expref: 35 pid: 8432 timeout: 601 lvb_type: 0 00000100:00100000:2.0:1746144907.698802:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093368e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172542464:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144907.698880:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1746144907.701179:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.701202:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175380480 00000100:00100000:3.0:1746144907.701208:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175380480 00000100:00100000:3.0:1746144907.701246:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4251 00000100:00100000:3.0:1746144907.701253:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1984:x1830965175380480:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:3.0:1746144907.701275:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727515e42 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.701288:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144907.701292:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727515e42 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.701299:0:31840:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727515e42 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144907.701905:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093368e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172542464:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144907.701927:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727515e3b lrc: 3/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95573 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.701938:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091751c00, rc 0) 00000100:00100000:2.0:1746144907.701979:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1116:x1830965175380224:12345-192.168.202.16@tcp:101:dd.0 Request processed in 4478us (4710us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144907.702056:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5875 00000100:00100000:1.0:1746144907.706844:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.706925:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175380736 00000100:00100000:3.0:1746144907.706933:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175380736 00000100:00100000:3.0:1746144907.706973:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4252 00000100:00100000:3.0:1746144907.706980:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1982:x1830965175380736:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:3.0:1746144907.707006:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515e49 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.707021:0:31844:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880094199a00/0x4076af6727515d3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95526 expref: 31 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.707029:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144907.707030:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746144907.707033:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515e49 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.707062:0:31844:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880094199a00/0x4076af6727515d3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95526 expref: 31 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.707072:0:31844:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880094199a00/0x4076af6727515d3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95526 expref: 31 pid: 8432 timeout: 601 lvb_type: 0 00000100:00100000:3.0:1746144907.707083:0:31844:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:31844:1830965172542592:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144907.707140:0:31844:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008bae7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746144907.708741:0:31844:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f38c380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:31844:1830965172542592:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144907.708756:0:31844:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515e49 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144907.711271:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.711297:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175380864 00000100:00100000:2.0:1746144907.711303:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175380864 00010000:00010000:2.0:1746144907.711329:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009b82a200/0x4076af6727515d38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9551f expref: 37 pid: 8432 timeout: 601 lvb_type: 0 00000100:00100000:2.0:1746144907.711349:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11285 00000100:00100000:2.0:1746144907.711355:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+37:1985:x1830965175380864:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144907.711363:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746144907.711380:0:7098:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1a:0x0] updating lvb size from disk: 0 -> 13631488 00010000:00010000:2.0:1746144907.711385:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009b82a200/0x4076af6727515d38 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9551f expref: 37 pid: 8432 timeout: 601 lvb_type: 0 00010000:00010000:2.0:1746144907.711394:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009b82a200/0x4076af6727515d38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9551f expref: 37 pid: 8432 timeout: 601 lvb_type: 0 00010000:00010000:2.0:1746144907.711413:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b82a200/0x4076af6727515d38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9551f expref: 37 pid: 8432 timeout: 601 lvb_type: 0 00010000:00010000:2.0:1746144907.711425:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144907.711427:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144907.711432:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727515e3b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95573 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.711440:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727515e3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95573 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.711446:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144907.711447:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144907.711450:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727515e42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.711455:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727515e42 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.711484:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091751c00/0x4076af6727515e3b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95573 expref: 6 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144907.711494:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093368e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172542720:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144907.711547:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b30c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746144907.711560:0:31840:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727515e42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.711566:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727515e42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144907.714228:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093368e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172542720:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144907.714249:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144907.714293:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+37:1985:x1830965175380864:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2936us (3024us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144907.714305:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11285 00000100:00100000:2.0:1746144907.716624:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.716895:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175381120 00000100:00100000:3.0:1746144907.716903:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175381120 00002000:00100000:3.0:1746144907.716938:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (0->1048575) req@ffff880093368e00 x1830965175381120/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.716947:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368e00 with x1830965175381120 ext(0->1048575) 00002000:00010000:3.0:1746144907.716952:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093368e00 00000100:00100000:3.0:1746144907.716978:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4253 00000100:00100000:3.0:1746144907.716984:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1985:x1830965175381120:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144907.721349:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.721474:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175381248 00000100:00100000:2.0:1746144907.721482:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175381248 00010000:00010000:2.0:1746144907.721510:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880094199a00/0x4076af6727515d3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95526 expref: 32 pid: 8432 timeout: 601 lvb_type: 0 00000100:00100000:2.0:1746144907.721540:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11286 00000100:00100000:2.0:1746144907.721547:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1985:x1830965175381248:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144907.721557:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746144907.721572:0:7098:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1a:0x0] updating lvb size from disk: 0 -> 12582912 00010000:00010000:2.0:1746144907.721577:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880094199a00/0x4076af6727515d3f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95526 expref: 32 pid: 8432 timeout: 601 lvb_type: 0 00010000:00010000:2.0:1746144907.721587:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880094199a00/0x4076af6727515d3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95526 expref: 32 pid: 8432 timeout: 601 lvb_type: 0 00010000:00010000:2.0:1746144907.721605:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094199a00/0x4076af6727515d3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95526 expref: 32 pid: 8432 timeout: 601 lvb_type: 0 00010000:00010000:2.0:1746144907.721616:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144907.721617:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144907.721621:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515e49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.721627:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515e49 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.721659:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144907.721683:0:31844:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515e49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.721692:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515e49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144907.721692:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1985:x1830965175381248:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 146us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144907.721698:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11286 00010000:00010000:3.0:1746144907.725471:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727515e42 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.725486:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727515e42 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.725494:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727515e42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.725500:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5f400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144907.725503:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727515e42 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.725511:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727515e42 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.725526:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727515e42 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.725532:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5f400/0x4076af6727515e42 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144907.725595:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1984:x1830965175380480:12345-192.168.202.16@tcp:3:dd.0 Request processed in 24338us (24416us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144907.725604:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4251 00000100:00100000:3.0:1746144907.730877:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093368e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1985:x1830965175381120:12345-192.168.202.16@tcp:3:dd.0 Request processed in 13884us (14247us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144907.730890:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4253 00002000:00100000:3.0:1746144907.730901:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (0->1048575) req@ffff880093368e00 x1830965175381120/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/440 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.730908:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093368e00 with x1830965175381120 ext(0->1048575) 00002000:00010000:3.0:1746144907.730914:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093368e00 00010000:00010000:3.0:1746144907.732174:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515e49 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.732186:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515e49 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.732194:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515e49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.732199:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5c200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144907.732203:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515e49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.732210:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515e49 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.732224:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515e49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.732230:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515e49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->1040383] (req 0->1040383) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144907.732292:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1982:x1830965175380736:12345-192.168.202.16@tcp:3:dd.0 Request processed in 25311us (25455us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746144907.732299:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4252 00000100:00100000:0.0:1746144907.738217:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.738260:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.738964:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175381504 00000100:00100000:2.0:1746144907.738972:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175381504 00000100:00100000:3.0:1746144907.738980:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175381632 00000100:00100000:3.0:1746144907.738985:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175381632 00000100:00100000:3.0:1746144907.739036:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4254 00000100:00100000:3.0:1746144907.739044:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1983:x1830965175381504:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144907.739063:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4255 00000100:00100000:2.0:1746144907.739069:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1982:x1830965175381632:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:3.0:1746144907.739081:0:31844:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1746144907.739092:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094112c00/0x4076af6727515e50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.739093:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091750200/0x4076af6727515e57 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.739102:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144907.739104:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144907.739108:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094112c00/0x4076af6727515e50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.739119:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094112c00/0x4076af6727515e50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.739186:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144907.739188:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144907.739191:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091750200/0x4076af6727515e57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [1048576->2088959] (req 1048576->2088959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.739200:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091750200/0x4076af6727515e57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [1048576->2088959] (req 1048576->2088959) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144907.740847:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.740915:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175381888 00000100:00100000:2.0:1746144907.740920:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175381888 00000100:00080000:0.0:1746144907.740955:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746144907.741029:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5876 00000100:00100000:2.0:1746144907.741037:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+6:1116:x1830965175381888:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1746144907.741049:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144907.741062:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800935cd800/0x4076af6727515e5e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9557a expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144907.741084:0:10401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 12582912, mtime: 0x68140e8b, atime: 0x0, ctime: 0x68140e8b, blocks: 0x1 00010000:00010000:2.0:1746144907.741097:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144907.741099:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144907.741105:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800935cd800/0x4076af6727515e5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9557a expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.741117:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800935cd800/0x4076af6727515e5e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9557a expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.741125:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800935cd800, rc 0) 00000100:00100000:2.0:1746144907.741166:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1116:x1830965175381888:12345-192.168.202.16@tcp:101:dd.0 Request processed in 129us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144907.741172:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5876 00000100:00100000:0.0:1746144907.745960:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.746094:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175382144 00000100:00100000:2.0:1746144907.746102:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175382144 00002000:00100000:2.0:1746144907.746135:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (0->1040383) req@ffff8800924dbb80 x1830965175382144/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.746144:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924dbb80 with x1830965175382144 ext(0->1040383) 00002000:00010000:2.0:1746144907.746149:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924dbb80 00000100:00100000:2.0:1746144907.746182:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4256 00000100:00100000:2.0:1746144907.746189:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1984:x1830965175382144:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:3.0:1746144907.764821:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1984:x1830965175382144:12345-192.168.202.16@tcp:3:dd.0 Request processed in 18614us (18850us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746144907.764833:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4256 00002000:00100000:3.0:1746144907.764842:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (0->1040383) req@ffff8800924dbb80 x1830965175382144/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/440 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 1040384/1040384 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.764852:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924dbb80 with x1830965175382144 ext(0->1040383) 00002000:00010000:3.0:1746144907.764857:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924dbb80 00000100:00100000:3.0:1746144907.774595:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.774622:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175382272 00000100:00100000:3.0:1746144907.774629:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175382272 00000100:00100000:3.0:1746144907.774662:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5877 00000100:00100000:3.0:1746144907.774669:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1116:x1830965175382272:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:3.0:1746144907.774683:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144907.774699:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727515e65 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95581 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746144907.774719:0:10401:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1746144907.774735:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144907.774737:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144907.774743:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727515e65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95581 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.774756:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727515e65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95581 expref: 8 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.774781:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5f400, rc 0) 00000100:00100000:3.0:1746144907.774829:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1116:x1830965175382272:12345-192.168.202.16@tcp:101:dd.0 Request processed in 161us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144907.774835:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5877 00000100:00100000:0.0:1746144907.784800:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.784873:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.784905:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175382528 00000100:00100000:0.0:1746144907.784912:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175382528 00000100:00100000:0.0:1746144907.784941:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5878 00000100:00100000:0.0:1746144907.784949:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1116:x1830965175382528:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:0.0:1746144907.784963:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144907.784978:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e33d600/0x4076af6727515e6c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95588 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144907.784996:0:8432:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1746144907.785012:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144907.785014:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144907.785021:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e33d600/0x4076af6727515e6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95588 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144907.785035:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012e33d600/0x4076af6727515e6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95588 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144907.785045:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e33d600, rc 0) 00000100:00100000:0.0:1746144907.785080:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1116:x1830965175382528:12345-192.168.202.16@tcp:101:dd.0 Request processed in 132us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144907.785085:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5878 00000100:00100000:0.0:1746144907.785103:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175382656 00000100:00100000:0.0:1746144907.785106:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175382656 00002000:00100000:0.0:1746144907.785125:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1b:0x0] (0->1048575) req@ffff8800924d9180 x1830965175382656/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144907.785133:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d9180 with x1830965175382656 ext(0->1048575) 00002000:00010000:0.0:1746144907.785136:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d9180 00000100:00100000:0.0:1746144907.785147:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4257 00000100:00100000:0.0:1746144907.785152:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1984:x1830965175382656:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:3.0:1746144907.801663:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 0 -> 2088960 00002000:00010000:3.0:1746144907.801667:0:8438:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb mtime from disk: 0 -> 1746144908 00002000:00010000:3.0:1746144907.801669:0:8438:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb ctime from disk: 0 -> 1746144908 00002000:00010000:3.0:1746144907.801671:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:3.0:1746144907.801681:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091750200/0x4076af6727515e57 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [1048576->2088959] (req 1048576->2088959) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746144907.801690:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968547 is committed 00010000:00010000:3.0:1746144907.801692:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091750200/0x4076af6727515e57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [1048576->2088959] (req 1048576->2088959) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.801700:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091750200/0x4076af6727515e57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [1048576->2088959] (req 1048576->2088959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.801706:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091750200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144907.801709:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091750200/0x4076af6727515e57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [1048576->2088959] (req 1048576->2088959) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.801715:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091750200/0x4076af6727515e57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [1048576->2088959] (req 1048576->2088959) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746144907.801719:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968549 is committed 00010000:00010000:3.0:1746144907.801729:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091750200/0x4076af6727515e57 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [1048576->2088959] (req 1048576->2088959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.801734:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091750200/0x4076af6727515e57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [1048576->2088959] (req 1048576->2088959) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144907.801821:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175381632:12345-192.168.202.16@tcp:4:dd.0 Request processed in 62738us (63546us total) trans 4294968549 rc 0/0 00000100:00100000:3.0:1746144907.801830:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4255 00000100:00100000:2.0:1746144907.801899:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1984:x1830965175382656:12345-192.168.202.16@tcp:4:dd.0 Request processed in 16745us (17023us total) trans 4294968551 rc 0/0 00000100:00100000:2.0:1746144907.801906:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4257 00002000:00100000:2.0:1746144907.801914:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1b:0x0] (0->1048575) req@ffff8800924d9180 x1830965175382656/t4294968551(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.801922:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d9180 with x1830965175382656 ext(0->1048575) 00002000:00010000:2.0:1746144907.801925:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d9180 00000100:00100000:0.0:1746144907.803236:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.803265:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.803292:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175382912 00000100:00100000:0.0:1746144907.803298:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175382912 00000100:00100000:3.0:1746144907.803302:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175383168 00000100:00100000:3.0:1746144907.803307:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175383168 00002000:00100000:3.0:1746144907.803325:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (1048576->2097151) req@ffff880093441180 x1830965175383168/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144907.803325:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (1040384->2080767) req@ffff8800924d9c00 x1830965175382912/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144907.803333:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d9c00 with x1830965175382912 ext(1040384->2080767) 00002000:00010000:0.0:1746144907.803336:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d9c00 00002000:00100000:3.0:1746144907.803338:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093441180 with x1830965175383168 ext(1048576->2097151) 00002000:00010000:3.0:1746144907.803341:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093441180 00000100:00100000:0.0:1746144907.803351:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4258 00000100:00100000:3.0:1746144907.803355:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4259 00000100:00100000:0.0:1746144907.803356:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800924d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1985:x1830965175382912:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:3.0:1746144907.803360:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1985:x1830965175383168:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:1.0:1746144907.816493:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093441180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1985:x1830965175383168:12345-192.168.202.16@tcp:3:dd.0 Request processed in 13125us (13219us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144907.816504:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4259 00002000:00100000:1.0:1746144907.816514:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (1048576->2097151) req@ffff880093441180 x1830965175383168/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/440 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.816522:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093441180 with x1830965175383168 ext(1048576->2097151) 00002000:00010000:1.0:1746144907.816527:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093441180 00000100:00100000:2.0:1746144907.819714:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1985:x1830965175382912:12345-192.168.202.16@tcp:3:dd.0 Request processed in 16349us (16473us total) trans 0 rc 1040384/1040384 00000100:00100000:2.0:1746144907.819723:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4258 00002000:00100000:2.0:1746144907.819732:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (1040384->2080767) req@ffff8800924d9c00 x1830965175382912/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/440 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 1040384/1040384 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.819741:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800924d9c00 with x1830965175382912 ext(1040384->2080767) 00002000:00010000:2.0:1746144907.819745:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800924d9c00 00000100:00100000:2.0:1746144907.824002:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.824067:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175383424 00000100:00100000:3.0:1746144907.824075:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175383424 00002000:00100000:3.0:1746144907.824106:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (2080768->2097151) req@ffff88009336aa00 x1830965175383424/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.824116:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336aa00 with x1830965175383424 ext(2080768->2097151) 00002000:00010000:3.0:1746144907.824120:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009336aa00 00000100:00100000:3.0:1746144907.824133:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4260 00000100:00100000:3.0:1746144907.824139:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1983:x1830965175383424:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:3.0:1746144907.824291:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1983:x1830965175383424:12345-192.168.202.16@tcp:3:dd.0 Request processed in 152us (296us total) trans 0 rc 16384/16384 00000100:00100000:3.0:1746144907.824298:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4260 00002000:00100000:3.0:1746144907.824302:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (2080768->2097151) req@ffff88009336aa00 x1830965175383424/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/16824 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 16384/16384 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.824309:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009336aa00 with x1830965175383424 ext(2080768->2097151) 00002000:00010000:3.0:1746144907.824312:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009336aa00 00000100:00100000:1.0:1746144907.827100:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.827124:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175383680 00000100:00100000:1.0:1746144907.827130:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175383680 00002000:00100000:1.0:1746144907.827162:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (0->1048575) req@ffff88008e832680 x1830965175383680/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.827171:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e832680 with x1830965175383680 ext(0->1048575) 00002000:00010000:1.0:1746144907.827175:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e832680 00000100:00100000:1.0:1746144907.827190:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4261 00000100:00100000:1.0:1746144907.827203:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1983:x1830965175383680:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144907.832562:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.832606:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175383936 00000100:00100000:1.0:1746144907.832614:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175383936 00002000:00100000:1.0:1746144907.832648:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1b:0x0] (1048576->2097151) req@ffff88008f38ca80 x1830965175383936/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.832658:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38ca80 with x1830965175383936 ext(1048576->2097151) 00002000:00010000:1.0:1746144907.832663:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f38ca80 00000100:00100000:1.0:1746144907.832686:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4262 00000100:00100000:1.0:1746144907.832692:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1983:x1830965175383936:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144907.841407:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1983:x1830965175383680:12345-192.168.202.16@tcp:4:dd.0 Request processed in 14195us (14303us total) trans 4294968071 rc 0/0 00000100:00100000:1.0:1746144907.841418:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4261 00002000:00100000:1.0:1746144907.841427:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (0->1048575) req@ffff88008e832680 x1830965175383680/t4294968071(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.841436:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008e832680 with x1830965175383680 ext(0->1048575) 00002000:00010000:1.0:1746144907.841441:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008e832680 00000100:00100000:3.0:1746144907.844057:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.844108:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.844135:0:31843:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175384192 00000100:00100000:3.0:1746144907.844147:0:31843:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175384192 00000100:00100000:1.0:1746144907.844278:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175384448 00000100:00100000:1.0:1746144907.844282:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175384448 00002000:00100000:1.0:1746144907.844323:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (2097152->3145727) req@ffff88008f38fb80 x1830965175384448/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.844334:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38fb80 with x1830965175384448 ext(2097152->3145727) 00002000:00010000:1.0:1746144907.844339:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f38fb80 00000100:00100000:1.0:1746144907.844360:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4263 00000100:00100000:1.0:1746144907.844368:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1982:x1830965175384448:12345-192.168.202.16@tcp:3:dd.0 00002000:00010000:2.0:1746144907.844997:0:31844:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 2055 -> 4103 00010000:00010000:2.0:1746144907.845014:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094112c00/0x4076af6727515e50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.845025:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094112c00/0x4076af6727515e50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746144907.845029:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968551 is committed 00010000:00010000:2.0:1746144907.845034:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094112c00/0x4076af6727515e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.845040:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094112c00 already unused, calling callback (ffffffffa087bd70) 00000001:00080000:1.0:1746144907.845043:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968550 is committed 00010000:00010000:2.0:1746144907.845045:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094112c00/0x4076af6727515e50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.845054:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094112c00/0x4076af6727515e50 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.845075:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094112c00/0x4076af6727515e50 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.845082:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094112c00/0x4076af6727515e50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144907.845145:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800924d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1983:x1830965175381504:12345-192.168.202.16@tcp:4:dd.0 Request processed in 106101us (106935us total) trans 4294968550 rc 0/0 00000100:00100000:2.0:1746144907.845152:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4254 00002000:00100000:3.0:1746144907.845231:0:31843:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x1a:0x0] (2097152->3145727) req@ffff88008f38f800 x1830965175384192/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.845240:0:31843:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38f800 with x1830965175384192 ext(2097152->3145727) 00002000:00010000:3.0:1746144907.845243:0:31843:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f38f800 00000100:00100000:3.0:1746144907.845258:0:31843:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4264 00000100:00100000:3.0:1746144907.845264:0:31843:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1983:x1830965175384192:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:2.0:1746144907.849981:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.850021:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.850059:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175384704 00000100:00100000:3.0:1746144907.850069:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175384704 00000100:00100000:3.0:1746144907.850105:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175384576 00000100:00100000:3.0:1746144907.850107:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175384576 00000100:00100000:3.0:1746144907.850123:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5879 00000100:00100000:3.0:1746144907.850131:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+5:1983:x1830965175384704:12345-192.168.202.16@tcp:101:dd.0 00000100:00100000:2.0:1746144907.850135:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5880 00000100:00100000:2.0:1746144907.850142:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009336a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1983:x1830965175384576:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:3.0:1746144907.850148:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144907.850151:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144907.850166:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091751a00/0x4076af6727515e7a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95596 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.850166:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092705c00/0x4076af6727515e73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9558f expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.850187:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144907.850187:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144907.850189:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144907.850189:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144907.850195:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091751a00/0x4076af6727515e7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95596 expref: 6 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144907.850195:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092705c00/0x4076af6727515e73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9558f expref: 36 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144907.850209:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091751a00/0x4076af6727515e7a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95596 expref: 6 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144907.850209:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092705c00/0x4076af6727515e73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9558f expref: 36 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144907.850218:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091751a00, rc 0) 00010000:00010000:2.0:1746144907.850218:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092705c00, rc 0) 00000100:00100000:2.0:1746144907.850256:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1983:x1830965175384576:12345-192.168.202.16@tcp:101:dd.0 Request processed in 115us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144907.850262:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5880 00000100:00100000:3.0:1746144907.850470:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009336a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1983:x1830965175384704:12345-192.168.202.16@tcp:101:dd.0 Request processed in 329us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144907.850485:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5879 00000100:00100000:1.0:1746144907.851264:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+11:1982:x1830965175384448:12345-192.168.202.16@tcp:3:dd.0 Request processed in 6893us (7152us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144907.851273:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4263 00002000:00100000:1.0:1746144907.851282:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (2097152->3145727) req@ffff88008f38fb80 x1830965175384448/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/440 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.851292:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38fb80 with x1830965175384448 ext(2097152->3145727) 00002000:00010000:1.0:1746144907.851297:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f38fb80 00000100:00100000:0.0:1746144907.851375:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1983:x1830965175383936:12345-192.168.202.16@tcp:4:dd.0 Request processed in 18682us (18819us total) trans 4294968552 rc 0/0 00000100:00100000:0.0:1746144907.851383:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4262 00002000:00100000:0.0:1746144907.851388:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1b:0x0] (1048576->2097151) req@ffff88008f38ca80 x1830965175383936/t4294968552(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144907.851395:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38ca80 with x1830965175383936 ext(1048576->2097151) 00002000:00010000:0.0:1746144907.851400:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f38ca80 00000100:00100000:3.0:1746144907.853692:0:31843:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1983:x1830965175384192:12345-192.168.202.16@tcp:3:dd.0 Request processed in 8419us (9639us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144907.853703:0:31843:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4264 00002000:00100000:3.0:1746144907.853713:0:31843:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x1a:0x0] (2097152->3145727) req@ffff88008f38f800 x1830965175384192/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/440 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.853722:0:31843:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38f800 with x1830965175384192 ext(2097152->3145727) 00002000:00010000:3.0:1746144907.853727:0:31843:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f38f800 00000100:00100000:1.0:1746144907.855068:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.855150:0:31843:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175384960 00000100:00100000:3.0:1746144907.855159:0:31843:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175384960 00000100:00100000:3.0:1746144907.855226:0:31843:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4265 00000100:00100000:3.0:1746144907.855233:0:31843:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175384960:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:3.0:1746144907.855282:0:31843:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727515e81 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31843 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.855297:0:31843:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144907.855299:0:31843:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144907.855304:0:31843:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727515e81 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31843 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.855319:0:31843:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727515e81 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31843 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144907.855378:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.855451:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:3.0:1746144907.855467:0:31843:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727515e81 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31843 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.855480:0:31843:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727515e81 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31843 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144907.855484:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175385216 00010000:00010000:3.0:1746144907.855487:0:31843:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727515e81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31843 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144907.855491:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175385216 00010000:00010000:3.0:1746144907.855494:0:31843:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091751200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144907.855497:0:31843:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727515e81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31843 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.855506:0:31843:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727515e81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31843 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144907.855508:0:25282:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175385472 00000100:00100000:2.0:1746144907.855511:0:25282:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175385472 00010000:00010000:3.0:1746144907.855520:0:31843:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727515e81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31843 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.855527:0:31843:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091751200/0x4076af6727515e81 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1040384->1048575] (req 1040384->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31843 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144907.855534:0:25282:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4266 00000100:00100000:2.0:1746144907.855540:0:25282:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175385472:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:2.0:1746144907.855569:0:25282:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092704a00/0x4076af6727515e88 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.855580:0:25282:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144907.855582:0:25282:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144907.855586:0:25282:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092704a00/0x4076af6727515e88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 6 type: EXT [1048576->2080767] (req 1048576->2080767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.855598:0:25282:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092704a00/0x4076af6727515e88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 6 type: EXT [1048576->2080767] (req 1048576->2080767) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144907.855626:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4267 00000100:00100000:1.0:1746144907.855632:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1984:x1830965175385216:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:1.0:1746144907.855649:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091cea000/0x4076af6727515e8f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.855725:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144907.855726:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144907.855729:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091cea000/0x4076af6727515e8f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.855739:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091cea000/0x4076af6727515e8f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144907.856111:0:31843:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175384960:12345-192.168.202.16@tcp:3:dd.0 Request processed in 877us (1050us total) trans 0 rc 8192/8192 00000100:00100000:3.0:1746144907.856118:0:31843:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4265 00000100:00100000:2.0:1746144907.861343:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.861397:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.861620:0:31843:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175385728 00000100:00100000:3.0:1746144907.861633:0:31843:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175385728 00002000:00100000:3.0:1746144907.861685:0:31843:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x1a:0x0] (3145728->4194303) req@ffff880093369880 x1830965175385728/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.861701:0:31843:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369880 with x1830965175385728 ext(3145728->4194303) 00002000:00010000:3.0:1746144907.861707:0:31843:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093369880 00000100:00100000:3.0:1746144907.861736:0:31843:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175385984 00000100:00100000:3.0:1746144907.861739:0:31843:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175385984 00002000:00100000:3.0:1746144907.861750:0:31843:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x1b:0x0] (1048576->2097151) req@ffff88009bae0000 x1830965175385984/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.861757:0:31843:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae0000 with x1830965175385984 ext(1048576->2097151) 00002000:00010000:3.0:1746144907.861759:0:31843:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae0000 00000100:00100000:3.0:1746144907.861786:0:31843:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4268 00000100:00100000:3.0:1746144907.861792:0:31843:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7454cbaf-97e3-4716-92c6-77cd48a94a90+11:1985:x1830965175385728:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:1.0:1746144907.862081:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4269 00000100:00100000:1.0:1746144907.862090:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1984:x1830965175385984:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:3.0:1746144907.864526:0:25282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092704a00/0x4076af6727515e88 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2080767] (req 1048576->2080767) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.864542:0:25282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092704a00/0x4076af6727515e88 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2080767] (req 1048576->2080767) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.864550:0:25282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092704a00/0x4076af6727515e88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2080767] (req 1048576->2080767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.864556:0:25282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092704a00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144907.864559:0:25282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092704a00/0x4076af6727515e88 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2080767] (req 1048576->2080767) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.864566:0:25282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092704a00/0x4076af6727515e88 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2080767] (req 1048576->2080767) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.864589:0:25282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092704a00/0x4076af6727515e88 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2080767] (req 1048576->2080767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144907.864595:0:25282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092704a00/0x4076af6727515e88 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2080767] (req 1048576->2080767) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144907.864657:0:25282:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1985:x1830965175385472:12345-192.168.202.16@tcp:3:dd.0 Request processed in 9113us (9202us total) trans 0 rc 1032192/1032192 00000100:00100000:3.0:1746144907.864667:0:25282:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4266 00000100:00100000:0.0:1746144907.869522:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:1.0:1746144907.869729:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091cea000/0x4076af6727515e8f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.869744:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091cea000/0x4076af6727515e8f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.869753:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091cea000/0x4076af6727515e8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.869760:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091cea000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144907.869798:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091cea000/0x4076af6727515e8f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.869806:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091cea000/0x4076af6727515e8f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.869834:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091cea000/0x4076af6727515e8f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.869841:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cea000/0x4076af6727515e8f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144907.869915:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1984:x1830965175385216:12345-192.168.202.16@tcp:3:dd.0 Request processed in 14279us (14802us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144907.869925:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4267 00000100:00100000:1.0:1746144907.869951:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175386240 00000100:00100000:1.0:1746144907.869959:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175386240 00002000:00100000:1.0:1746144907.869992:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1b:0x0] (2097152->3145727) req@ffff880093442a00 x1830965175386240/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.870001:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093442a00 with x1830965175386240 ext(2097152->3145727) 00002000:00010000:1.0:1746144907.870005:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093442a00 00000100:00100000:1.0:1746144907.870031:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4270 00000100:00100000:1.0:1746144907.870038:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1985:x1830965175386240:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144907.873648:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.873672:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.873691:0:25282:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175386496 00000100:00100000:0.0:1746144907.873699:0:25282:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175386496 00000100:00100000:0.0:1746144907.873740:0:25282:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175386624 00000100:00100000:0.0:1746144907.873742:0:25282:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175386624 00000100:00100000:0.0:1746144907.873756:0:25282:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4271 00000100:00100000:0.0:1746144907.873781:0:25282:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175386496:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144907.873835:0:25282:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 2088960, mtime: 0x68140e8c, atime: 0x0, ctime: 0x68140e8c, blocks: 0x1007 00010000:00010000:0.0:1746144907.873844:0:25282:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f3c6c00/0x4076af6727515e96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144907.873857:0:25282:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144907.873859:0:25282:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144907.873863:0:25282:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3c6c00/0x4076af6727515e96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [2088960->3137535] (req 2088960->3137535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144907.873879:0:25282:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3c6c00/0x4076af6727515e96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [2088960->3137535] (req 2088960->3137535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144907.874008:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1984:x1830965175385984:12345-192.168.202.16@tcp:4:dd.0 Request processed in 11918us (12609us total) trans 4294968072 rc 0/0 00000100:00100000:1.0:1746144907.874015:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4269 00002000:00100000:1.0:1746144907.874023:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1b:0x0] (1048576->2097151) req@ffff88009bae0000 x1830965175385984/t4294968072(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.874032:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae0000 with x1830965175385984 ext(1048576->2097151) 00002000:00010000:1.0:1746144907.874036:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae0000 00000100:00100000:1.0:1746144907.874051:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4272 00000100:00100000:1.0:1746144907.874055:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175386624:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:1.0:1746144907.874066:0:25064:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515e9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.874073:0:25064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144907.874074:0:25064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144907.874076:0:25064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515e9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [3137536->4177919] (req 3137536->4177919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144907.874084:0:25064:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515e9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [3137536->4177919] (req 3137536->4177919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144907.874450:0:31843:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1985:x1830965175385728:12345-192.168.202.16@tcp:3:dd.0 Request processed in 12657us (13114us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144907.874455:0:31843:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4268 00002000:00100000:0.0:1746144907.874460:0:31843:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x1a:0x0] (3145728->4194303) req@ffff880093369880 x1830965175385728/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/440 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144907.874467:0:31843:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093369880 with x1830965175385728 ext(3145728->4194303) 00002000:00010000:0.0:1746144907.874469:0:31843:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093369880 00000100:00100000:2.0:1746144907.880124:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.880406:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175387008 00000100:00100000:0.0:1746144907.880416:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175387008 00002000:00100000:0.0:1746144907.881222:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (3145728->4194303) req@ffff880092f72d80 x1830965175387008/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144907.881233:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f72d80 with x1830965175387008 ext(3145728->4194303) 00002000:00010000:0.0:1746144907.881238:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092f72d80 00000100:00100000:0.0:1746144907.881260:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4273 00000100:00100000:0.0:1746144907.881269:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1985:x1830965175387008:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:2.0:1746144907.886931:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.886965:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.886974:0:7108:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175387136 00000100:00100000:2.0:1746144907.886981:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175387264 00000100:00100000:3.0:1746144907.886983:0:7108:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175387136 00000100:00100000:2.0:1746144907.886984:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175387264 00000100:00100000:3.0:1746144907.887021:0:7108:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 377 00000100:00100000:2.0:1746144907.887021:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 330 00000100:00100000:3.0:1746144907.887029:0:7108:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4574b85-29c1-4863-b96a-3fe350afea52+12:1984:x1830965175387136:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:2.0:1746144907.887029:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+37:1985:x1830965175387264:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1746144907.887088:0:7108:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a4574b85-29c1-4863-b96a-3fe350afea52+12:1984:x1830965175387136:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 60us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144907.887095:0:7108:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 377 00000100:00100000:3.0:1746144907.887144:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144907.887161:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175387392 00000100:00100000:3.0:1746144907.887163:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175387392 00000100:00100000:3.0:1746144907.887179:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 331 00000100:00100000:3.0:1746144907.887184:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1984:x1830965175387392:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1746144907.887208:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1984:x1830965175387392:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 24us (63us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144907.887213:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 331 00000100:00100000:2.0:1746144907.887552:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+37:1985:x1830965175387264:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 524us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144907.887559:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 330 00000100:00100000:1.0:1746144907.893332:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1985:x1830965175387008:12345-192.168.202.16@tcp:3:dd.0 Request processed in 12051us (13205us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144907.893344:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4273 00002000:00100000:1.0:1746144907.893359:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (3145728->4194303) req@ffff880092f72d80 x1830965175387008/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/440 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.893374:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f72d80 with x1830965175387008 ext(3145728->4194303) 00002000:00010000:1.0:1746144907.893381:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092f72d80 00000100:00100000:1.0:1746144907.894742:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093442a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1985:x1830965175386240:12345-192.168.202.16@tcp:4:dd.0 Request processed in 24703us (25225us total) trans 4294968555 rc 0/0 00000100:00100000:1.0:1746144907.894750:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4270 00002000:00100000:1.0:1746144907.894756:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1b:0x0] (2097152->3145727) req@ffff880093442a00 x1830965175386240/t4294968555(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.894781:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093442a00 with x1830965175386240 ext(2097152->3145727) 00002000:00010000:1.0:1746144907.894784:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093442a00 00000100:00100000:1.0:1746144907.897451:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.897504:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175387648 00000100:00100000:2.0:1746144907.897515:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175387648 00002000:00100000:2.0:1746144907.897552:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (4194304->5242879) req@ffff880093fa3480 x1830965175387648/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.897561:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa3480 with x1830965175387648 ext(4194304->5242879) 00002000:00010000:2.0:1746144907.897566:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa3480 00000100:00100000:2.0:1746144907.897589:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4274 00000100:00100000:2.0:1746144907.897596:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1984:x1830965175387648:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144907.903259:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.903405:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175387904 00000100:00100000:1.0:1746144907.903413:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175387904 00002000:00100000:1.0:1746144907.903627:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (4194304->5242879) req@ffff880093441500 x1830965175387904/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.903636:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093441500 with x1830965175387904 ext(4194304->5242879) 00002000:00010000:1.0:1746144907.903641:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093441500 00000100:00100000:1.0:1746144907.903669:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4275 00000100:00100000:1.0:1746144907.903676:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1984:x1830965175387904:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144907.904190:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.904225:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175388160 00000100:00100000:0.0:1746144907.904229:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175388160 00002000:00100000:0.0:1746144907.904248:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1b:0x0] (2097152->3145727) req@ffff880093441880 x1830965175388160/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144907.904260:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093441880 with x1830965175388160 ext(2097152->3145727) 00002000:00010000:0.0:1746144907.904263:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093441880 00000100:00100000:0.0:1746144907.904275:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4276 00000100:00100000:0.0:1746144907.904280:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1985:x1830965175388160:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144907.904568:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1984:x1830965175387648:12345-192.168.202.16@tcp:3:dd.0 Request processed in 6971us (7121us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144907.904575:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4274 00002000:00100000:3.0:1746144907.904581:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (4194304->5242879) req@ffff880093fa3480 x1830965175387648/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/440 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.904587:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa3480 with x1830965175387648 ext(4194304->5242879) 00002000:00010000:3.0:1746144907.904590:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093fa3480 00000100:00100000:1.0:1746144907.911954:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093441500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1984:x1830965175387904:12345-192.168.202.16@tcp:3:dd.0 Request processed in 8273us (8697us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144907.911964:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4275 00002000:00100000:1.0:1746144907.911974:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (4194304->5242879) req@ffff880093441500 x1830965175387904/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/440 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.911988:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093441500 with x1830965175387904 ext(4194304->5242879) 00002000:00010000:1.0:1746144907.911993:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093441500 00000100:00100000:2.0:1746144907.912289:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093441880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1985:x1830965175388160:12345-192.168.202.16@tcp:4:dd.0 Request processed in 8008us (8099us total) trans 4294968073 rc 0/0 00000100:00100000:2.0:1746144907.912297:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4276 00002000:00100000:2.0:1746144907.912302:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1b:0x0] (2097152->3145727) req@ffff880093441880 x1830965175388160/t4294968073(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.912310:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093441880 with x1830965175388160 ext(2097152->3145727) 00002000:00010000:2.0:1746144907.912313:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093441880 00000100:00100000:0.0:1746144907.915870:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.915896:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175388416 00000100:00100000:0.0:1746144907.915902:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175388416 00002000:00100000:0.0:1746144907.915932:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1b:0x0] (3145728->4194303) req@ffff880093442d80 x1830965175388416/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144907.915939:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093442d80 with x1830965175388416 ext(3145728->4194303) 00002000:00010000:0.0:1746144907.915943:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093442d80 00000100:00100000:0.0:1746144907.915963:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4277 00000100:00100000:0.0:1746144907.915968:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1984:x1830965175388416:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144907.927802:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093442d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1984:x1830965175388416:12345-192.168.202.16@tcp:4:dd.0 Request processed in 11826us (11929us total) trans 4294968556 rc 0/0 00000100:00100000:1.0:1746144907.927821:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4277 00002000:00100000:1.0:1746144907.927831:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1b:0x0] (3145728->4194303) req@ffff880093442d80 x1830965175388416/t4294968556(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.927839:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093442d80 with x1830965175388416 ext(3145728->4194303) 00002000:00010000:1.0:1746144907.927844:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093442d80 00000100:00100000:2.0:1746144907.930211:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144907.930302:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175388672 00000100:00100000:1.0:1746144907.930310:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175388672 00002000:00100000:1.0:1746144907.930342:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1b:0x0] (3145728->4194303) req@ffff880092f71180 x1830965175388672/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.930350:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f71180 with x1830965175388672 ext(3145728->4194303) 00002000:00010000:1.0:1746144907.930354:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f71180 00000100:00100000:1.0:1746144907.930370:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4278 00000100:00100000:1.0:1746144907.930376:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1984:x1830965175388672:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144907.940221:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.940251:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175388928 00000100:00100000:2.0:1746144907.940258:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175388928 00002000:00100000:2.0:1746144907.940292:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1b:0x0] (4194304->5242879) req@ffff880093fa1500 x1830965175388928/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.940301:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1500 with x1830965175388928 ext(4194304->5242879) 00002000:00010000:2.0:1746144907.940306:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093fa1500 00000100:00100000:2.0:1746144907.940337:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4279 00000100:00100000:2.0:1746144907.940345:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1985:x1830965175388928:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144907.940729:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1984:x1830965175388672:12345-192.168.202.16@tcp:4:dd.0 Request processed in 10352us (10521us total) trans 4294968074 rc 0/0 00000100:00100000:1.0:1746144907.940736:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4278 00002000:00100000:1.0:1746144907.940742:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1b:0x0] (3145728->4194303) req@ffff880092f71180 x1830965175388672/t4294968074(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.940754:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f71180 with x1830965175388672 ext(3145728->4194303) 00002000:00010000:1.0:1746144907.940758:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f71180 00000001:00080000:3.0:1746144907.942554:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968552 is committed 00000001:00080000:3.0:1746144907.942566:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968553 is committed 00002000:00010000:2.0:1746144907.944270:0:25282:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 2088960 -> 4177920 00002000:00010000:2.0:1746144907.944277:0:25282:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:2.0:1746144907.944293:0:25282:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f3c6c00/0x4076af6727515e96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [2088960->3137535] (req 2088960->3137535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.944303:0:25282:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3c6c00/0x4076af6727515e96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [2088960->3137535] (req 2088960->3137535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.944310:0:25282:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f3c6c00/0x4076af6727515e96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [2088960->3137535] (req 2088960->3137535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.944315:0:25282:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3c6c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144907.944319:0:25282:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f3c6c00/0x4076af6727515e96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [2088960->3137535] (req 2088960->3137535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.944325:0:25282:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f3c6c00/0x4076af6727515e96 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [2088960->3137535] (req 2088960->3137535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.944342:0:25282:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f3c6c00/0x4076af6727515e96 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [2088960->3137535] (req 2088960->3137535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144907.944347:0:25282:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3c6c00/0x4076af6727515e96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [2088960->3137535] (req 2088960->3137535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25282 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144907.944405:0:25282:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093443480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175386496:12345-192.168.202.16@tcp:4:dd.0 Request processed in 70637us (70763us total) trans 4294968553 rc 0/0 00000100:00100000:2.0:1746144907.944414:0:25282:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4271 00000100:00100000:2.0:1746144907.952190:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1985:x1830965175388928:12345-192.168.202.16@tcp:4:dd.0 Request processed in 11839us (11970us total) trans 4294968557 rc 0/0 00000100:00100000:2.0:1746144907.952199:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4279 00002000:00100000:2.0:1746144907.952209:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1b:0x0] (4194304->5242879) req@ffff880093fa1500 x1830965175388928/t4294968557(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.952217:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093fa1500 with x1830965175388928 ext(4194304->5242879) 00000100:00100000:1.0:1746144907.952342:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00002000:00010000:2.0:1746144907.952404:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093fa1500 00000100:00100000:2.0:1746144907.952424:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175389184 00000100:00100000:2.0:1746144907.952429:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175389184 00002000:00100000:2.0:1746144907.952451:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (5242880->6291455) req@ffff880087c5e300 x1830965175389184/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.952457:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5e300 with x1830965175389184 ext(5242880->6291455) 00002000:00010000:2.0:1746144907.952461:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5e300 00000100:00100000:2.0:1746144907.952482:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4280 00000100:00100000:2.0:1746144907.952488:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1985:x1830965175389184:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:1.0:1746144907.954611:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.954632:0:25282:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175389440 00000100:00100000:0.0:1746144907.954640:0:25282:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175389440 00002000:00100000:0.0:1746144907.954699:0:25282:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x1a:0x0] (5242880->6291455) req@ffff880087c5ea00 x1830965175389440/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144907.954708:0:25282:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ea00 with x1830965175389440 ext(5242880->6291455) 00002000:00010000:0.0:1746144907.954712:0:25282:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087c5ea00 00000100:00100000:0.0:1746144907.954726:0:25282:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4281 00000100:00100000:0.0:1746144907.954732:0:25282:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1984:x1830965175389440:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:3.0:1746144907.959726:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1985:x1830965175389184:12345-192.168.202.16@tcp:3:dd.0 Request processed in 7231us (7378us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144907.959736:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4280 00002000:00100000:3.0:1746144907.959748:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (5242880->6291455) req@ffff880087c5e300 x1830965175389184/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/440 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.959757:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5e300 with x1830965175389184 ext(5242880->6291455) 00002000:00010000:3.0:1746144907.959781:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880087c5e300 00000100:00100000:2.0:1746144907.966268:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.968801:0:25282:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1984:x1830965175389440:12345-192.168.202.16@tcp:3:dd.0 Request processed in 14060us (14186us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144907.968821:0:25282:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4281 00002000:00100000:2.0:1746144907.968833:0:25282:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x1a:0x0] (5242880->6291455) req@ffff880087c5ea00 x1830965175389440/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/440 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.968841:0:25282:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ea00 with x1830965175389440 ext(5242880->6291455) 00002000:00010000:2.0:1746144907.968846:0:25282:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087c5ea00 00000100:00100000:2.0:1746144907.968865:0:25282:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175389696 00000100:00100000:2.0:1746144907.968872:0:25282:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175389696 00002000:00100000:2.0:1746144907.968897:0:25282:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x240000400:0x1a:0x0] (6291456->7340031) req@ffff880092f70a80 x1830965175389696/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.968903:0:25282:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70a80 with x1830965175389696 ext(6291456->7340031) 00002000:00010000:2.0:1746144907.968907:0:25282:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f70a80 00000100:00100000:0.0:1746144907.969532:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.969645:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.969658:0:25282:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175389952 00000100:00100000:2.0:1746144907.969662:0:25282:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175389952 00000100:00100000:3.0:1746144907.969665:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4282 00000100:00100000:3.0:1746144907.969672:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1985:x1830965175389696:12345-192.168.202.16@tcp:3:dd.0 00002000:00100000:2.0:1746144907.969677:0:25282:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x1a:0x0] (6291456->7340031) req@ffff880093440e00 x1830965175389952/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.969684:0:25282:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093440e00 with x1830965175389952 ext(6291456->7340031) 00002000:00010000:2.0:1746144907.969687:0:25282:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093440e00 00000100:00100000:2.0:1746144907.969698:0:25282:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4283 00000100:00100000:2.0:1746144907.969702:0:25282:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1985:x1830965175389952:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144907.970609:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175390208 00000100:00100000:0.0:1746144907.970614:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175390208 00002000:00100000:0.0:1746144907.970635:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1a:0x0] (7340032->8388607) req@ffff880093443100 x1830965175390208/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144907.970644:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093443100 with x1830965175390208 ext(7340032->8388607) 00002000:00010000:0.0:1746144907.970648:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093443100 00000100:00100000:0.0:1746144907.970659:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4284 00000100:00100000:0.0:1746144907.970663:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1984:x1830965175390208:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:1.0:1746144907.976603:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144907.979021:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175390464 00000100:00100000:2.0:1746144907.979031:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175390464 00002000:00100000:2.0:1746144907.979068:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (7340032->8388607) req@ffff880087c5ca80 x1830965175390464/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.979077:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ca80 with x1830965175390464 ext(7340032->8388607) 00002000:00010000:2.0:1746144907.979082:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087c5ca80 00000100:00100000:2.0:1746144907.979100:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4285 00000100:00100000:2.0:1746144907.979107:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1984:x1830965175390464:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144907.979530:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.979547:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175390720 00000100:00100000:0.0:1746144907.979550:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175390720 00002000:00100000:0.0:1746144907.979567:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (4194304->5242879) req@ffff880093442680 x1830965175390720/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144907.979575:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093442680 with x1830965175390720 ext(4194304->5242879) 00002000:00010000:0.0:1746144907.979578:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093442680 00000100:00100000:0.0:1746144907.979589:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4286 00000100:00100000:0.0:1746144907.979594:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1984:x1830965175390720:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144907.979893:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092f70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1985:x1830965175389696:12345-192.168.202.16@tcp:3:dd.0 Request processed in 10220us (13631us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144907.979899:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4282 00002000:00100000:3.0:1746144907.979905:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (6291456->7340031) req@ffff880092f70a80 x1830965175389696/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/440 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144907.979912:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092f70a80 with x1830965175389696 ext(6291456->7340031) 00002000:00010000:3.0:1746144907.979915:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092f70a80 00000100:00100000:2.0:1746144907.985097:0:25282:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1985:x1830965175389952:12345-192.168.202.16@tcp:3:dd.0 Request processed in 15385us (15558us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144907.985107:0:25282:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4283 00002000:00100000:2.0:1746144907.985125:0:25282:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x1a:0x0] (6291456->7340031) req@ffff880093440e00 x1830965175389952/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/440 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.985136:0:25282:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093440e00 with x1830965175389952 ext(6291456->7340031) 00002000:00010000:2.0:1746144907.985142:0:25282:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093440e00 00000100:00100000:1.0:1746144907.985329:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093443100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1984:x1830965175390208:12345-192.168.202.16@tcp:3:dd.0 Request processed in 14664us (15685us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144907.985335:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4284 00002000:00100000:1.0:1746144907.985340:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1a:0x0] (7340032->8388607) req@ffff880093443100 x1830965175390208/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/440 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144907.985347:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093443100 with x1830965175390208 ext(7340032->8388607) 00002000:00010000:1.0:1746144907.985350:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093443100 00000100:00100000:0.0:1746144907.986818:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144907.986838:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175390976 00000100:00100000:0.0:1746144907.986845:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175390976 00002000:00100000:0.0:1746144907.986871:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1b:0x0] (5242880->6291455) req@ffff880093440380 x1830965175390976/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/0 e 0 to 0 dl 1746144918 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144907.986879:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093440380 with x1830965175390976 ext(5242880->6291455) 00002000:00010000:0.0:1746144907.986882:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093440380 00000100:00100000:0.0:1746144907.986896:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4287 00000100:00100000:0.0:1746144907.986902:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1985:x1830965175390976:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144907.992246:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093442680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1984:x1830965175390720:12345-192.168.202.16@tcp:4:dd.0 Request processed in 12644us (12710us total) trans 4294968075 rc 0/0 00000100:00100000:2.0:1746144907.992256:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4286 00002000:00100000:2.0:1746144907.992265:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (4194304->5242879) req@ffff880093442680 x1830965175390720/t4294968075(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.992273:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093442680 with x1830965175390720 ext(4194304->5242879) 00002000:00010000:2.0:1746144907.992277:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093442680 00000100:00100000:2.0:1746144907.994743:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1984:x1830965175390464:12345-192.168.202.16@tcp:3:dd.0 Request processed in 15204us (17754us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144907.994753:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4285 00002000:00100000:2.0:1746144907.994778:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (7340032->8388607) req@ffff880087c5ca80 x1830965175390464/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/440 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144907.994787:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880087c5ca80 with x1830965175390464 ext(7340032->8388607) 00002000:00010000:2.0:1746144907.994792:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880087c5ca80 00000001:00080000:3.0:1746144908.000679:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968556 is committed 00000001:00080000:3.0:1746144908.000698:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968554 is committed 00000100:00100000:1.0:1746144908.001244:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1985:x1830965175390976:12345-192.168.202.16@tcp:4:dd.0 Request processed in 14334us (14429us total) trans 4294968558 rc 0/0 00010000:00010000:2.0:1746144908.001251:0:25064:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515e9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [3137536->4177919] (req 3137536->4177919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144908.001253:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4287 00010000:00010000:2.0:1746144908.001261:0:25064:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515e9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [3137536->4177919] (req 3137536->4177919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746144908.001263:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1b:0x0] (5242880->6291455) req@ffff880093440380 x1830965175390976/t4294968558(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:548/0 lens 488/448 e 0 to 0 dl 1746144918 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00010000:00010000:2.0:1746144908.001268:0:25064:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515e9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [3137536->4177919] (req 3137536->4177919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746144908.001271:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093440380 with x1830965175390976 ext(5242880->6291455) 00002000:00010000:1.0:1746144908.001275:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093440380 00010000:00010000:2.0:1746144908.001278:0:25064:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092553000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144908.001281:0:25064:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515e9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [3137536->4177919] (req 3137536->4177919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.001286:0:25064:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515e9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [3137536->4177919] (req 3137536->4177919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.001299:0:25064:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515e9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [3137536->4177919] (req 3137536->4177919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.001303:0:25064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515e9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [3137536->4177919] (req 3137536->4177919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144908.001335:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093441c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1985:x1830965175386624:12345-192.168.202.16@tcp:4:dd.0 Request processed in 127279us (127662us total) trans 4294968554 rc 0/0 00000100:00100000:2.0:1746144908.001341:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4272 00000100:00100000:3.0:1746144908.003707:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144908.004072:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175391232 00000100:00100000:2.0:1746144908.004079:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175391232 00002000:00100000:2.0:1746144908.004113:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1b:0x0] (5242880->6291455) req@ffff88008f38ce00 x1830965175391232/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144908.004121:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38ce00 with x1830965175391232 ext(5242880->6291455) 00002000:00010000:2.0:1746144908.004125:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f38ce00 00000100:00100000:2.0:1746144908.004140:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4288 00000100:00100000:2.0:1746144908.004145:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1984:x1830965175391232:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144908.006216:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144908.006259:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144908.006548:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175391616 00000100:00100000:2.0:1746144908.006555:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175391616 00000100:00100000:3.0:1746144908.006583:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175391872 00000100:00100000:3.0:1746144908.006587:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175391872 00000100:00100000:2.0:1746144908.006612:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4289 00000100:00100000:2.0:1746144908.006618:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175391616:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:3.0:1746144908.006638:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4290 00010000:00010000:2.0:1746144908.006643:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093f04600/0x4076af6727515ea4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.006644:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1982:x1830965175391872:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:2.0:1746144908.006655:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.006656:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.006660:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800925b7800/0x4076af6727515eab lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.006660:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093f04600/0x4076af6727515ea4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2080768->3121151] (req 2080768->3121151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.006668:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.006670:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.006670:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093f04600/0x4076af6727515ea4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2080768->3121151] (req 2080768->3121151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.006672:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800925b7800/0x4076af6727515eab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.006681:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800925b7800/0x4076af6727515eab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00080000:0.0:1746144908.008791:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746144908.008797:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746144908.011954:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144908.012201:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175392128 00000100:00100000:2.0:1746144908.012209:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175392128 00002000:00100000:2.0:1746144908.012240:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1b:0x0] (6291456->7340031) req@ffff880099e86a00 x1830965175392128/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144908.012249:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e86a00 with x1830965175392128 ext(6291456->7340031) 00002000:00010000:2.0:1746144908.012254:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e86a00 00000100:00100000:2.0:1746144908.012296:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4291 00000100:00100000:2.0:1746144908.012302:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1985:x1830965175392128:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144908.017695:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1984:x1830965175391232:12345-192.168.202.16@tcp:4:dd.0 Request processed in 13538us (13980us total) trans 4294968076 rc 0/0 00000100:00100000:0.0:1746144908.017708:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4288 00002000:00100000:0.0:1746144908.017720:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1b:0x0] (5242880->6291455) req@ffff88008f38ce00 x1830965175391232/t4294968076(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/448 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144908.017731:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f38ce00 with x1830965175391232 ext(5242880->6291455) 00002000:00010000:0.0:1746144908.017737:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f38ce00 00010000:00010000:3.0:1746144908.020346:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800925b7800/0x4076af6727515eab lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.020364:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800925b7800/0x4076af6727515eab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.020373:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800925b7800/0x4076af6727515eab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.020379:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800925b7800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144908.020383:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800925b7800/0x4076af6727515eab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.020392:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800925b7800/0x4076af6727515eab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.020411:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800925b7800/0x4076af6727515eab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.020418:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800925b7800/0x4076af6727515eab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.020502:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1982:x1830965175391872:12345-192.168.202.16@tcp:3:dd.0 Request processed in 13851us (14234us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144908.020512:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4290 00010000:00010000:0.0:1746144908.025126:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880093f04600/0x4076af6727515ea4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2080768->3121151] (req 2080768->3121151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.025141:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093f04600/0x4076af6727515ea4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2080768->3121151] (req 2080768->3121151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.025148:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093f04600/0x4076af6727515ea4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2080768->3121151] (req 2080768->3121151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.025153:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093f04600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144908.025157:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093f04600/0x4076af6727515ea4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2080768->3121151] (req 2080768->3121151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.025163:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093f04600/0x4076af6727515ea4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2080768->3121151] (req 2080768->3121151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.025178:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093f04600/0x4076af6727515ea4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2080768->3121151] (req 2080768->3121151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.025183:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093f04600/0x4076af6727515ea4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2080768->3121151] (req 2080768->3121151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144908.025262:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880087c5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175391616:12345-192.168.202.16@tcp:3:dd.0 Request processed in 18638us (19047us total) trans 0 rc 1040384/1040384 00000100:00100000:0.0:1746144908.025271:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4289 00000100:00100000:2.0:1746144908.025844:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1985:x1830965175392128:12345-192.168.202.16@tcp:4:dd.0 Request processed in 13541us (13895us total) trans 4294968559 rc 0/0 00000100:00100000:2.0:1746144908.025851:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4291 00002000:00100000:2.0:1746144908.025859:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1b:0x0] (6291456->7340031) req@ffff880099e86a00 x1830965175392128/t4294968559(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/448 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144908.025872:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e86a00 with x1830965175392128 ext(6291456->7340031) 00002000:00010000:2.0:1746144908.025876:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e86a00 00000001:00080000:2.0:1746144908.025894:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294968063 is committed 00000001:00080000:2.0:1746144908.025904:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294968072 is committed 00000001:00080000:2.0:1746144908.025912:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294968065 is committed 00000001:00080000:2.0:1746144908.025940:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294968073 is committed 00000001:00080000:2.0:1746144908.025946:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294968067 is committed 00000001:00080000:2.0:1746144908.025966:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294968070 is committed 00000100:00100000:3.0:1746144908.031058:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144908.031633:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144908.031697:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175392512 00000100:00100000:2.0:1746144908.031705:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175392512 00000100:00100000:2.0:1746144908.031747:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175392384 00000100:00100000:2.0:1746144908.031749:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175392384 00000100:00100000:2.0:1746144908.031799:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4292 00000100:00100000:2.0:1746144908.031817:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f38ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175392512:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:2.0:1746144908.031858:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 4177920, mtime: 0x68140e8c, atime: 0x0, ctime: 0x68140e8c, blocks: 0x2007 00010000:00010000:2.0:1746144908.031865:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800925b6400/0x4076af6727515eb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.031876:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.031878:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.031882:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800925b6400/0x4076af6727515eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [5226496->6266879] (req 5226496->6266879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.031894:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800925b6400/0x4076af6727515eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [5226496->6266879] (req 5226496->6266879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144908.032448:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4293 00000100:00100000:0.0:1746144908.032456:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175392384:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:0.0:1746144908.032471:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af6727515eb9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.032478:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.032479:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.032482:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af6727515eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [4177920->5226495] (req 4177920->5226495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.032489:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af6727515eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [4177920->5226495] (req 4177920->5226495) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144908.035710:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144908.035781:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175392896 00000100:00100000:3.0:1746144908.035788:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175392896 00002000:00100000:3.0:1746144908.035829:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (6291456->7340031) req@ffff880091c28000 x1830965175392896/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.035837:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28000 with x1830965175392896 ext(6291456->7340031) 00002000:00010000:3.0:1746144908.035841:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c28000 00000100:00100000:3.0:1746144908.035869:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4294 00000100:00100000:3.0:1746144908.035876:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1984:x1830965175392896:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144908.042701:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144908.042789:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175393152 00000100:00100000:1.0:1746144908.042798:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175393152 00002000:00100000:1.0:1746144908.042842:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1b:0x0] (7340032->8388607) req@ffff880091c28e00 x1830965175393152/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144908.042852:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28e00 with x1830965175393152 ext(7340032->8388607) 00002000:00010000:1.0:1746144908.042856:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c28e00 00000100:00100000:1.0:1746144908.042883:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4295 00000100:00100000:1.0:1746144908.042889:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1984:x1830965175393152:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144908.053369:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.053395:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144908.054033:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175393408 00000100:00100000:3.0:1746144908.054041:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175393408 00002000:00100000:3.0:1746144908.054074:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (8388608->9437183) req@ffff880093440700 x1830965175393408/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.054083:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093440700 with x1830965175393408 ext(8388608->9437183) 00002000:00010000:3.0:1746144908.054088:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093440700 00000100:00100000:3.0:1746144908.054114:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175393664 00000100:00100000:3.0:1746144908.054116:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175393664 00002000:00100000:3.0:1746144908.054127:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (8388608->9437183) req@ffff880093442300 x1830965175393664/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.054133:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093442300 with x1830965175393664 ext(8388608->9437183) 00002000:00010000:3.0:1746144908.054135:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093442300 00000100:00100000:2.0:1746144908.054135:0:31843:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4296 00000100:00100000:2.0:1746144908.054143:0:31843:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1984:x1830965175393408:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:3.0:1746144908.054151:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4297 00000100:00100000:3.0:1746144908.054156:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1985:x1830965175393664:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:3.0:1746144908.062264:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1984:x1830965175392896:12345-192.168.202.16@tcp:4:dd.0 Request processed in 26375us (26546us total) trans 4294968077 rc 0/0 00000100:00100000:3.0:1746144908.062274:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4294 00002000:00100000:3.0:1746144908.062285:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (6291456->7340031) req@ffff880091c28000 x1830965175392896/t4294968077(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/448 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.062293:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28000 with x1830965175392896 ext(6291456->7340031) 00002000:00010000:3.0:1746144908.062298:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c28000 00000100:00100000:3.0:1746144908.063122:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093442300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1985:x1830965175393664:12345-192.168.202.16@tcp:3:dd.0 Request processed in 8962us (9722us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144908.063129:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4297 00002000:00100000:3.0:1746144908.063134:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (8388608->9437183) req@ffff880093442300 x1830965175393664/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/440 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.063140:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093442300 with x1830965175393664 ext(8388608->9437183) 00002000:00010000:3.0:1746144908.063144:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093442300 00000100:00100000:1.0:1746144908.069275:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1984:x1830965175393152:12345-192.168.202.16@tcp:4:dd.0 Request processed in 26379us (26573us total) trans 4294968562 rc 0/0 00000100:00100000:1.0:1746144908.069285:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4295 00002000:00100000:1.0:1746144908.069295:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1b:0x0] (7340032->8388607) req@ffff880091c28e00 x1830965175393152/t4294968562(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/448 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144908.069303:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28e00 with x1830965175393152 ext(7340032->8388607) 00002000:00010000:1.0:1746144908.069308:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c28e00 00000100:00100000:1.0:1746144908.069406:0:31843:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093440700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1984:x1830965175393408:12345-192.168.202.16@tcp:3:dd.0 Request processed in 15263us (16044us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144908.069411:0:31843:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4296 00002000:00100000:1.0:1746144908.069417:0:31843:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x1a:0x0] (8388608->9437183) req@ffff880093440700 x1830965175393408/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/440 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144908.069423:0:31843:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093440700 with x1830965175393408 ext(8388608->9437183) 00002000:00010000:1.0:1746144908.069427:0:31843:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093440700 00000100:00100000:1.0:1746144908.076915:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144908.077011:0:31843:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175393920 00000100:00100000:2.0:1746144908.077019:0:31843:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175393920 00002000:00100000:2.0:1746144908.077053:0:31843:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x1a:0x0] (9437184->10485759) req@ffff880099e86300 x1830965175393920/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144908.077062:0:31843:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e86300 with x1830965175393920 ext(9437184->10485759) 00002000:00010000:2.0:1746144908.077067:0:31843:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e86300 00000100:00100000:2.0:1746144908.077084:0:31843:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4298 00000100:00100000:2.0:1746144908.077090:0:31843:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1982:x1830965175393920:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:2.0:1746144908.078992:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144908.079915:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175394176 00000100:00100000:1.0:1746144908.079928:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175394176 00002000:00100000:1.0:1746144908.079960:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1a:0x0] (9437184->10485759) req@ffff880091c28380 x1830965175394176/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144908.079969:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28380 with x1830965175394176 ext(9437184->10485759) 00002000:00010000:1.0:1746144908.079974:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c28380 00000100:00100000:1.0:1746144908.079990:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4299 00000100:00100000:1.0:1746144908.079996:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1982:x1830965175394176:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:1.0:1746144908.087571:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144908.087592:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144908.087605:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144908.087623:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144908.087851:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175394432 00000100:00100000:2.0:1746144908.087860:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175394432 00002000:00100000:2.0:1746144908.087895:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (10485760->11534335) req@ffff880099e87b80 x1830965175394432/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144908.087905:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e87b80 with x1830965175394432 ext(10485760->11534335) 00002000:00010000:2.0:1746144908.087909:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e87b80 00000100:00100000:2.0:1746144908.087927:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175394688 00000100:00100000:2.0:1746144908.087929:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175394688 00000100:00100000:1.0:1746144908.087935:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175394944 00002000:00100000:2.0:1746144908.087938:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (10485760->11534335) req@ffff880099e84700 x1830965175394688/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00000100:00100000:1.0:1746144908.087939:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175394944 00002000:00100000:2.0:1746144908.087943:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e84700 with x1830965175394688 ext(10485760->11534335) 00002000:00010000:2.0:1746144908.087946:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e84700 00000100:00100000:2.0:1746144908.087952:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175395200 00000100:00100000:2.0:1746144908.087954:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175395200 00002000:00100000:1.0:1746144908.087955:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1a:0x0] (11534336->12582911) req@ffff880099e86680 x1830965175394944/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144908.087961:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (11534336->12582911) req@ffff880099e85c00 x1830965175395200/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144908.087962:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e86680 with x1830965175394944 ext(11534336->12582911) 00002000:00100000:2.0:1746144908.087966:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e85c00 with x1830965175395200 ext(11534336->12582911) 00002000:00010000:1.0:1746144908.087966:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e86680 00002000:00010000:2.0:1746144908.087968:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e85c00 00000100:00100000:1.0:1746144908.087979:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4300 00000100:00100000:2.0:1746144908.087984:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4301 00000100:00100000:1.0:1746144908.087986:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+19:1982:x1830965175394432:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:2.0:1746144908.087988:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+19:1982:x1830965175394688:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:1.0:1746144908.088053:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4302 00000100:00100000:1.0:1746144908.088058:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+19:1982:x1830965175394944:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:2.0:1746144908.088606:0:1853:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4303 00000100:00100000:2.0:1746144908.088612:0:1853:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1982:x1830965175395200:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:2.0:1746144908.089248:0:31843:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1982:x1830965175393920:12345-192.168.202.16@tcp:3:dd.0 Request processed in 12157us (12337us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144908.089255:0:31843:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4298 00002000:00100000:2.0:1746144908.089262:0:31843:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x240000400:0x1a:0x0] (9437184->10485759) req@ffff880099e86300 x1830965175393920/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/440 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144908.089271:0:31843:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e86300 with x1830965175393920 ext(9437184->10485759) 00002000:00010000:2.0:1746144908.089275:0:31843:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e86300 00000100:00100000:0.0:1746144908.093789:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.093826:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.093931:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1982:x1830965175394176:12345-192.168.202.16@tcp:3:dd.0 Request processed in 13933us (14942us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144908.093939:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4299 00002000:00100000:0.0:1746144908.093949:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1a:0x0] (9437184->10485759) req@ffff880091c28380 x1830965175394176/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/440 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144908.093956:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c28380 with x1830965175394176 ext(9437184->10485759) 00002000:00010000:0.0:1746144908.093960:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c28380 00000100:00100000:0.0:1746144908.093979:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175395456 00000100:00100000:0.0:1746144908.093984:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175395456 00002000:00100000:0.0:1746144908.094006:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1a:0x0] (12582912->13631487) req@ffff88009ad5ca80 x1830965175395456/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144908.094011:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ca80 with x1830965175395456 ext(12582912->13631487) 00002000:00010000:0.0:1746144908.094014:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ca80 00000100:00100000:0.0:1746144908.094024:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175395712 00000100:00100000:0.0:1746144908.094026:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175395712 00002000:00100000:0.0:1746144908.094035:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1b:0x0] (7340032->8388607) req@ffff88009ad5c380 x1830965175395712/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144908.094040:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5c380 with x1830965175395712 ext(7340032->8388607) 00002000:00010000:0.0:1746144908.094042:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5c380 00000100:00100000:0.0:1746144908.094051:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4304 00000100:00100000:0.0:1746144908.094056:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+21:1982:x1830965175395456:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144908.094652:0:25029:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4305 00000100:00100000:0.0:1746144908.094659:0:25029:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+22:1983:x1830965175395712:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144908.104730:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144908.104961:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175395968 00000100:00100000:3.0:1746144908.104970:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175395968 00002000:00100000:3.0:1746144908.105005:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1b:0x0] (8388608->9437183) req@ffff880091c2a680 x1830965175395968/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.105014:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c2a680 with x1830965175395968 ext(8388608->9437183) 00002000:00010000:3.0:1746144908.105018:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c2a680 00000100:00100000:3.0:1746144908.105035:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4306 00000100:00100000:3.0:1746144908.105041:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1982:x1830965175395968:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144908.106826:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1982:x1830965175394688:12345-192.168.202.16@tcp:3:dd.0 Request processed in 18831us (19226us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144908.106835:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4301 00002000:00100000:3.0:1746144908.106845:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (10485760->11534335) req@ffff880099e84700 x1830965175394688/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/440 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.106853:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e84700 with x1830965175394688 ext(10485760->11534335) 00002000:00010000:3.0:1746144908.106857:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e84700 00000100:00100000:0.0:1746144908.114291:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+22:1982:x1830965175394944:12345-192.168.202.16@tcp:3:dd.0 Request processed in 26221us (26673us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144908.114302:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4302 00002000:00100000:0.0:1746144908.114314:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1a:0x0] (11534336->12582911) req@ffff880099e86680 x1830965175394944/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/440 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144908.114324:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e86680 with x1830965175394944 ext(11534336->12582911) 00002000:00010000:0.0:1746144908.114328:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e86680 00000100:00100000:3.0:1746144908.114414:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.114480:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175396224 00000100:00100000:0.0:1746144908.114487:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175396224 00000100:00100000:3.0:1746144908.114507:0:1853:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_012:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1982:x1830965175395200:12345-192.168.202.16@tcp:3:dd.0 Request processed in 25894us (26882us total) trans 0 rc 1048576/1048576 00002000:00100000:0.0:1746144908.114511:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1b:0x0] (8388608->9437183) req@ffff880093e82a00 x1830965175396224/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00000100:00100000:3.0:1746144908.114513:0:1853:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4303 00002000:00100000:3.0:1746144908.114518:0:1853:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_012: refresh rw locks for [0x280000400:0x1a:0x0] (11534336->12582911) req@ffff880099e85c00 x1830965175395200/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/440 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144908.114518:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82a00 with x1830965175396224 ext(8388608->9437183) 00002000:00100000:3.0:1746144908.114525:0:1853:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e85c00 with x1830965175395200 ext(11534336->12582911) 00002000:00010000:0.0:1746144908.114525:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e82a00 00002000:00010000:3.0:1746144908.114533:0:1853:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e85c00 00000100:00100000:0.0:1746144908.114539:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4307 00000100:00100000:0.0:1746144908.114545:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+22:1982:x1830965175396224:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144908.116989:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+22:1982:x1830965175394432:12345-192.168.202.16@tcp:3:dd.0 Request processed in 28995us (29415us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144908.116999:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4300 00002000:00100000:1.0:1746144908.117008:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1a:0x0] (10485760->11534335) req@ffff880099e87b80 x1830965175394432/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/440 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144908.117021:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e87b80 with x1830965175394432 ext(10485760->11534335) 00002000:00010000:1.0:1746144908.117026:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e87b80 00000100:00100000:1.0:1746144908.118314:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144908.118545:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1982:x1830965175395456:12345-192.168.202.16@tcp:3:dd.0 Request processed in 24486us (24760us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144908.118553:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4304 00002000:00100000:1.0:1746144908.118561:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1a:0x0] (12582912->13631487) req@ffff88009ad5ca80 x1830965175395456/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/440 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144908.118569:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ca80 with x1830965175395456 ext(12582912->13631487) 00002000:00010000:1.0:1746144908.118573:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5ca80 00000100:00100000:1.0:1746144908.118599:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175396480 00000100:00100000:1.0:1746144908.118605:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175396480 00002000:00100000:1.0:1746144908.118631:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1b:0x0] (9437184->10485759) req@ffff88009181f480 x1830965175396480/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144908.118639:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181f480 with x1830965175396480 ext(9437184->10485759) 00002000:00010000:1.0:1746144908.118641:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009181f480 00000100:00100000:1.0:1746144908.118655:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4308 00000100:00100000:1.0:1746144908.118660:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1984:x1830965175396480:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144908.120503:0:25029:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1983:x1830965175395712:12345-192.168.202.16@tcp:4:dd.0 Request processed in 25838us (26671us total) trans 4294968078 rc 0/0 00000100:00100000:0.0:1746144908.120512:0:25029:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4305 00002000:00100000:0.0:1746144908.120521:0:25029:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1b:0x0] (7340032->8388607) req@ffff88009ad5c380 x1830965175395712/t4294968078(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/448 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144908.120529:0:25029:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5c380 with x1830965175395712 ext(7340032->8388607) 00002000:00010000:0.0:1746144908.120533:0:25029:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5c380 00000100:00100000:3.0:1746144908.122457:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1982:x1830965175395968:12345-192.168.202.16@tcp:4:dd.0 Request processed in 17409us (17731us total) trans 4294968563 rc 0/0 00000100:00100000:3.0:1746144908.122467:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4306 00002000:00100000:3.0:1746144908.122475:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1b:0x0] (8388608->9437183) req@ffff880091c2a680 x1830965175395968/t4294968563(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/448 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.122483:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c2a680 with x1830965175395968 ext(8388608->9437183) 00002000:00010000:3.0:1746144908.122488:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c2a680 00000001:00080000:3.0:1746144908.123376:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968558 is committed 00000001:00080000:3.0:1746144908.123391:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968560 is committed 00000001:00080000:3.0:1746144908.123397:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968559 is committed 00002000:00010000:2.0:1746144908.123954:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 4177920 -> 6266880 00002000:00010000:2.0:1746144908.123957:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:2.0:1746144908.123965:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800925b6400/0x4076af6727515eb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [5226496->6266879] (req 5226496->6266879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.123972:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800925b6400/0x4076af6727515eb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [5226496->6266879] (req 5226496->6266879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.123980:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800925b6400/0x4076af6727515eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [5226496->6266879] (req 5226496->6266879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.123984:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800925b6400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144908.123986:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800925b6400/0x4076af6727515eb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [5226496->6266879] (req 5226496->6266879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.123990:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800925b6400/0x4076af6727515eb2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [5226496->6266879] (req 5226496->6266879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.124002:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800925b6400/0x4076af6727515eb2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [5226496->6266879] (req 5226496->6266879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.124005:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800925b6400/0x4076af6727515eb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [5226496->6266879] (req 5226496->6266879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144908.124050:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f38ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1983:x1830965175392512:12345-192.168.202.16@tcp:4:dd.0 Request processed in 92242us (92996us total) trans 4294968560 rc 0/0 00000100:00100000:2.0:1746144908.124056:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4292 00000100:00100000:2.0:1746144908.130395:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144908.130636:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175396736 00000100:00100000:3.0:1746144908.130644:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175396736 00002000:00100000:3.0:1746144908.130677:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (9437184->10485759) req@ffff880091c29180 x1830965175396736/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.130687:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c29180 with x1830965175396736 ext(9437184->10485759) 00002000:00010000:3.0:1746144908.130691:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c29180 00000100:00100000:3.0:1746144908.130713:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4309 00000100:00100000:3.0:1746144908.130719:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1984:x1830965175396736:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144908.132702:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+22:1982:x1830965175396224:12345-192.168.202.16@tcp:4:dd.0 Request processed in 18151us (18283us total) trans 4294968079 rc 0/0 00000100:00100000:0.0:1746144908.132712:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4307 00002000:00100000:0.0:1746144908.132722:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1b:0x0] (8388608->9437183) req@ffff880093e82a00 x1830965175396224/t4294968079(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/448 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144908.132730:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82a00 with x1830965175396224 ext(8388608->9437183) 00002000:00010000:0.0:1746144908.132735:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e82a00 00000100:00100000:3.0:1746144908.133923:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1984:x1830965175396480:12345-192.168.202.16@tcp:4:dd.0 Request processed in 15258us (15607us total) trans 4294968564 rc 0/0 00000100:00100000:3.0:1746144908.133932:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4308 00002000:00100000:3.0:1746144908.133939:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1b:0x0] (9437184->10485759) req@ffff88009181f480 x1830965175396480/t4294968564(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/448 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.133946:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009181f480 with x1830965175396480 ext(9437184->10485759) 00002000:00010000:3.0:1746144908.133950:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009181f480 00000100:00100000:0.0:1746144908.138240:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144908.138489:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175396992 00000100:00100000:3.0:1746144908.138497:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175396992 00002000:00100000:3.0:1746144908.138527:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1b:0x0] (10485760->11534335) req@ffff88009ad5df80 x1830965175396992/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.138536:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5df80 with x1830965175396992 ext(10485760->11534335) 00002000:00010000:3.0:1746144908.138540:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ad5df80 00000100:00100000:3.0:1746144908.138563:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4310 00000100:00100000:3.0:1746144908.138598:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1984:x1830965175396992:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144908.140153:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+22:1984:x1830965175396736:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9428us (9757us total) trans 4294968080 rc 0/0 00000100:00100000:3.0:1746144908.140162:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4309 00002000:00100000:3.0:1746144908.140170:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (9437184->10485759) req@ffff880091c29180 x1830965175396736/t4294968080(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/448 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.140178:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c29180 with x1830965175396736 ext(9437184->10485759) 00002000:00010000:3.0:1746144908.140182:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c29180 00000100:00100000:3.0:1746144908.147822:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1984:x1830965175396992:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9208us (9571us total) trans 4294968565 rc 0/0 00000100:00100000:3.0:1746144908.147833:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4310 00002000:00100000:3.0:1746144908.147841:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1b:0x0] (10485760->11534335) req@ffff88009ad5df80 x1830965175396992/t4294968565(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/448 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.147849:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5df80 with x1830965175396992 ext(10485760->11534335) 00002000:00010000:3.0:1746144908.147854:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ad5df80 00000100:00100000:3.0:1746144908.152306:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144908.152328:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175397248 00000100:00100000:2.0:1746144908.152335:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175397248 00002000:00100000:2.0:1746144908.152368:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1b:0x0] (10485760->11534335) req@ffff880093e82d80 x1830965175397248/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144908.152376:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82d80 with x1830965175397248 ext(10485760->11534335) 00002000:00010000:2.0:1746144908.152380:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e82d80 00000100:00100000:2.0:1746144908.152397:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4311 00000100:00100000:2.0:1746144908.152403:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+22:1984:x1830965175397248:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144908.160541:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144908.160594:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175397504 00000100:00100000:3.0:1746144908.160602:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175397504 00002000:00100000:3.0:1746144908.160634:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1b:0x0] (11534336->12582911) req@ffff88009ad5ce00 x1830965175397504/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.161248:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ce00 with x1830965175397504 ext(11534336->12582911) 00002000:00010000:3.0:1746144908.161254:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ad5ce00 00000100:00100000:3.0:1746144908.161284:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4312 00000100:00100000:3.0:1746144908.161291:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1985:x1830965175397504:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144908.162441:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+24:1984:x1830965175397248:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9948us (10052us total) trans 4294968081 rc 0/0 00000100:00100000:0.0:1746144908.162450:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4311 00002000:00100000:0.0:1746144908.162459:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1b:0x0] (10485760->11534335) req@ffff880093e82d80 x1830965175397248/t4294968081(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/448 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144908.162468:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093e82d80 with x1830965175397248 ext(10485760->11534335) 00002000:00010000:0.0:1746144908.162472:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093e82d80 00000100:00100000:0.0:1746144908.168293:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144908.168383:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175397760 00000100:00100000:1.0:1746144908.168391:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175397760 00002000:00100000:1.0:1746144908.168426:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1b:0x0] (11534336->12582911) req@ffff88009ad5f100 x1830965175397760/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144908.168440:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5f100 with x1830965175397760 ext(11534336->12582911) 00002000:00010000:1.0:1746144908.168445:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5f100 00000100:00100000:1.0:1746144908.168463:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4313 00000100:00100000:1.0:1746144908.168492:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+24:1984:x1830965175397760:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144908.169412:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1985:x1830965175397504:12345-192.168.202.16@tcp:4:dd.0 Request processed in 8119us (8875us total) trans 4294968566 rc 0/0 00000100:00100000:3.0:1746144908.169419:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4312 00002000:00100000:3.0:1746144908.169426:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1b:0x0] (11534336->12582911) req@ffff88009ad5ce00 x1830965175397504/t4294968566(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/448 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.169433:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5ce00 with x1830965175397504 ext(11534336->12582911) 00002000:00010000:3.0:1746144908.169437:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ad5ce00 00000001:00080000:3.0:1746144908.178691:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968561 is committed 00000100:00100000:2.0:1746144908.178699:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000001:00080000:3.0:1746144908.178703:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968562 is committed 00000001:00080000:3.0:1746144908.178712:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968563 is committed 00000100:00100000:2.0:1746144908.178737:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144908.178785:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175398016 00000100:00100000:3.0:1746144908.178793:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175398016 00002000:00100000:3.0:1746144908.178835:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1b:0x0] (12582912->13631487) req@ffff880091c2b480 x1830965175398016/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/0 e 0 to 0 dl 1746144919 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.178843:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c2b480 with x1830965175398016 ext(12582912->13631487) 00002000:00010000:3.0:1746144908.178848:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c2b480 00000100:00100000:3.0:1746144908.178863:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4314 00000100:00100000:3.0:1746144908.178868:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1985:x1830965175398016:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144908.179188:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175398272 00000100:00100000:0.0:1746144908.179192:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175398272 00000100:00100000:0.0:1746144908.179217:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 163 00000100:00100000:0.0:1746144908.179222:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1116:x1830965175398272:12345-192.168.202.16@tcp:35:dd.0 00010000:00010000:1.0:1746144908.179232:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af6727515eb9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [4177920->5226495] (req 4177920->5226495) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.179241:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af6727515eb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [4177920->5226495] (req 4177920->5226495) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.179248:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af6727515eb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [4177920->5226495] (req 4177920->5226495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.179253:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009966c000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144908.179256:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af6727515eb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [4177920->5226495] (req 4177920->5226495) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746144908.179261:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746144908.179262:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af6727515eb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [4177920->5226495] (req 4177920->5226495) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.179276:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af6727515eb9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [4177920->5226495] (req 4177920->5226495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.179282:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af6727515eb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [4177920->5226495] (req 4177920->5226495) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144908.179321:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1983:x1830965175392384:12345-192.168.202.16@tcp:4:dd.0 Request processed in 146866us (147688us total) trans 4294968561 rc 0/0 00000100:00100000:1.0:1746144908.179327:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4293 00000100:00100000:0.0:1746144908.179336:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+21:1116:x1830965175398272:12345-192.168.202.16@tcp:35:dd.0 Request processed in 115us (644us total) trans 4294987521 rc 0/0 00000100:00100000:0.0:1746144908.179341:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 163 00000100:00100000:1.0:1746144908.179794:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1984:x1830965175397760:12345-192.168.202.16@tcp:4:dd.0 Request processed in 11324us (11506us total) trans 4294968082 rc 0/0 00000100:00100000:1.0:1746144908.179800:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4313 00002000:00100000:1.0:1746144908.179813:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1b:0x0] (11534336->12582911) req@ffff88009ad5f100 x1830965175397760/t4294968082(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/448 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144908.179821:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5f100 with x1830965175397760 ext(11534336->12582911) 00002000:00010000:1.0:1746144908.179824:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5f100 00000100:00100000:0.0:1746144908.185385:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.185408:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.185429:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.185460:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175398784 00000100:00100000:0.0:1746144908.185467:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175398784 00000100:00100000:0.0:1746144908.185505:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175399040 00000100:00100000:0.0:1746144908.185507:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175399040 00000100:00100000:0.0:1746144908.185524:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4315 00000100:00100000:0.0:1746144908.185530:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175398784:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:0.0:1746144908.185559:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2a00/0x4076af6727515ec0 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.185571:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.185573:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.185577:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2a00/0x4076af6727515ec0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.185588:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2a00/0x4076af6727515ec0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144908.185976:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4316 00000100:00100000:2.0:1746144908.185984:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175399040:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:2.0:1746144908.186002:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727515ec7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.186010:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.186011:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.186014:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727515ec7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.186021:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727515ec7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.187558:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1985:x1830965175398016:12345-192.168.202.16@tcp:4:dd.0 Request processed in 8684us (8816us total) trans 4294968567 rc 0/0 00000100:00100000:3.0:1746144908.187566:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4314 00002000:00100000:3.0:1746144908.187576:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1b:0x0] (12582912->13631487) req@ffff880091c2b480 x1830965175398016/t4294968567(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:549/0 lens 488/448 e 0 to 0 dl 1746144919 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144908.187583:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c2b480 with x1830965175398016 ext(12582912->13631487) 00002000:00010000:3.0:1746144908.187588:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091c2b480 00000100:00100000:3.0:1746144908.187618:0:7114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175398912 00000100:00100000:3.0:1746144908.187623:0:7114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175398912 00000100:00100000:3.0:1746144908.187646:0:7114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 164 00000100:00100000:3.0:1746144908.187652:0:7114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+21:1116:x1830965175398912:12345-192.168.202.16@tcp:35:dd.0 00000100:00100000:3.0:1746144908.187854:0:7114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+22:1116:x1830965175398912:12345-192.168.202.16@tcp:35:dd.0 Request processed in 201us (2477us total) trans 4294987522 rc 0/0 00000100:00100000:3.0:1746144908.187859:0:7114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 164 00010000:00010000:2.0:1746144908.192357:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2a00/0x4076af6727515ec0 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.192367:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2a00/0x4076af6727515ec0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.192372:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2a00/0x4076af6727515ec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.192375:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0f2a00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144908.192379:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2a00/0x4076af6727515ec0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.192383:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2a00/0x4076af6727515ec0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.192395:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2a00/0x4076af6727515ec0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.192399:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0f2a00/0x4076af6727515ec0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144908.192500:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175398784:12345-192.168.202.16@tcp:3:dd.0 Request processed in 6966us (7087us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144908.192509:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4315 00010000:00010000:0.0:1746144908.196681:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727515ec7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.196694:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727515ec7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.196701:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727515ec7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.196707:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbbd800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144908.196710:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727515ec7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.196717:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727515ec7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.196732:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727515ec7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.196743:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd800/0x4076af6727515ec7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3121152->4161535] (req 3121152->4161535) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144908.196877:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175399040:12345-192.168.202.16@tcp:3:dd.0 Request processed in 10888us (11441us total) trans 0 rc 1040384/1040384 00000100:00100000:0.0:1746144908.196888:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4316 00000100:00100000:0.0:1746144908.205431:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.205489:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144908.205550:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175399424 00000100:00100000:3.0:1746144908.205558:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175399424 00000100:00100000:3.0:1746144908.205606:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175399552 00000100:00100000:3.0:1746144908.205608:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175399552 00000100:00100000:3.0:1746144908.205621:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4317 00000100:00100000:3.0:1746144908.205627:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175399424:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144908.205634:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4318 00000100:00100000:1.0:1746144908.205643:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175399552:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:3.0:1746144908.205665:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 6266880, mtime: 0x68140e8c, atime: 0x0, ctime: 0x68140e8c, blocks: 0x3007 00010000:00010000:1.0:1746144908.205684:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af6727515ed5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.205696:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144908.205698:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144908.205701:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af6727515ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [7315456->8355839] (req 7315456->8355839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.205713:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af6727515ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [7315456->8355839] (req 7315456->8355839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.205729:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af6727515ece lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.205738:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.205740:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.205742:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af6727515ece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [6266880->7315455] (req 6266880->7315455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.205751:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af6727515ece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [6266880->7315455] (req 6266880->7315455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1746144908.256705:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968568 is committed 00000001:00080000:3.0:1746144908.256718:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968567 is committed 00002000:00010000:0.0:1746144908.257309:0:31844:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 6266880 -> 8355840 00002000:00010000:0.0:1746144908.257313:0:31844:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:0.0:1746144908.257323:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af6727515ed5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [7315456->8355839] (req 7315456->8355839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.257331:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af6727515ed5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [7315456->8355839] (req 7315456->8355839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.257338:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af6727515ed5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [7315456->8355839] (req 7315456->8355839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.257344:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bb9e800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144908.257347:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af6727515ed5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [7315456->8355839] (req 7315456->8355839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.257352:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af6727515ed5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [7315456->8355839] (req 7315456->8355839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.257366:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af6727515ed5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [7315456->8355839] (req 7315456->8355839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.257372:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af6727515ed5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [7315456->8355839] (req 7315456->8355839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144908.257442:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175399552:12345-192.168.202.16@tcp:4:dd.0 Request processed in 51797us (51953us total) trans 4294968568 rc 0/0 00000100:00100000:0.0:1746144908.257451:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4318 00010000:00010000:3.0:1746144908.282330:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af6727515ece lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [6266880->7315455] (req 6266880->7315455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.282342:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af6727515ece lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [6266880->7315455] (req 6266880->7315455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.282350:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af6727515ece lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [6266880->7315455] (req 6266880->7315455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.282356:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099501200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144908.282360:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af6727515ece lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [6266880->7315455] (req 6266880->7315455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.282367:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af6727515ece lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [6266880->7315455] (req 6266880->7315455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.282381:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af6727515ece lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [6266880->7315455] (req 6266880->7315455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.282387:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099501200/0x4076af6727515ece lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [6266880->7315455] (req 6266880->7315455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.282475:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175399424:12345-192.168.202.16@tcp:4:dd.0 Request processed in 76843us (77046us total) trans 4294968569 rc 0/0 00000100:00100000:3.0:1746144908.282484:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4317 00000001:00080000:3.0:1746144908.282510:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968569 is committed 00000100:00100000:0.0:1746144908.285397:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144908.285519:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175400064 00000100:00100000:3.0:1746144908.285527:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175400064 00000100:00100000:3.0:1746144908.285603:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4319 00000100:00100000:3.0:1746144908.285614:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175400064:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:3.0:1746144908.285641:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727515edc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.285651:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.285653:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.285656:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727515edc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4161536->4194303] (req 4161536->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.285666:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727515edc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4161536->4194303] (req 4161536->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144908.285937:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.285955:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175400448 00000100:00100000:0.0:1746144908.285959:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175400448 00000100:00100000:2.0:1746144908.285964:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.285989:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175400320 00000100:00100000:0.0:1746144908.285991:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175400320 00000100:00100000:2.0:1746144908.285996:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4320 00000100:00100000:2.0:1746144908.286002:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175400448:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144908.286011:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4321 00010000:00010000:2.0:1746144908.286016:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a5d200/0x4076af6727515ee3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144908.286016:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175400320:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:2.0:1746144908.286025:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.286026:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.286028:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5d200/0x4076af6727515ee3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [4194304->5201919] (req 4194304->5201919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.286036:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a5d200/0x4076af6727515ee3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [4194304->5201919] (req 4194304->5201919) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.286039:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515eea lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.286046:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.286048:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.286051:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515eea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.286060:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515eea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.288830:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727515edc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [4161536->4194303] (req 4161536->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.288843:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727515edc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [4161536->4194303] (req 4161536->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.288849:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727515edc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [4161536->4194303] (req 4161536->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.288859:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800931b2c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144908.288862:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727515edc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [4161536->4194303] (req 4161536->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.288868:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727515edc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [4161536->4194303] (req 4161536->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.288882:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727515edc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [4161536->4194303] (req 4161536->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.288887:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800931b2c00/0x4076af6727515edc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [4161536->4194303] (req 4161536->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.288938:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175400064:12345-192.168.202.16@tcp:3:dd.0 Request processed in 3324us (3543us total) trans 0 rc 32768/32768 00000100:00100000:3.0:1746144908.288946:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4319 00010000:00010000:2.0:1746144908.295712:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515eea lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.296034:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515eea lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.296041:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515eea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.296229:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4a6ba00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144908.296234:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515eea lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.296240:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515eea lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.296255:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515eea lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.296260:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4a6ba00/0x4076af6727515eea lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144908.296333:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175400320:12345-192.168.202.16@tcp:3:dd.0 Request processed in 10312us (10364us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144908.296342:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4321 00010000:00010000:2.0:1746144908.297714:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a5d200/0x4076af6727515ee3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5201919] (req 4194304->5201919) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.297722:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5d200/0x4076af6727515ee3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5201919] (req 4194304->5201919) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.297726:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a5d200/0x4076af6727515ee3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5201919] (req 4194304->5201919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.297729:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5d200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144908.297731:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5d200/0x4076af6727515ee3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5201919] (req 4194304->5201919) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.297735:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5d200/0x4076af6727515ee3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5201919] (req 4194304->5201919) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.297744:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a5d200/0x4076af6727515ee3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5201919] (req 4194304->5201919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.297747:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a5d200/0x4076af6727515ee3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5201919] (req 4194304->5201919) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144908.297796:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1985:x1830965175400448:12345-192.168.202.16@tcp:3:dd.0 Request processed in 11794us (11860us total) trans 0 rc 1007616/1007616 00000100:00100000:2.0:1746144908.297801:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4320 00000100:00100000:0.0:1746144908.302470:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144908.302555:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175400704 00000100:00100000:2.0:1746144908.302563:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175400704 00000100:00100000:2.0:1746144908.302735:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4322 00000100:00100000:2.0:1746144908.302744:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175400704:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:2.0:1746144908.302815:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 8355840, mtime: 0x68140e8c, atime: 0x0, ctime: 0x68140e8c, blocks: 0x4007 00010000:00010000:2.0:1746144908.302822:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515ef1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.302833:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.302834:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.302838:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [8355840->9404415] (req 8355840->9404415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.302848:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [8355840->9404415] (req 8355840->9404415) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144908.304198:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.304214:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175400832 00000100:00100000:0.0:1746144908.304218:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175400832 00000100:00100000:0.0:1746144908.304254:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4323 00000100:00100000:0.0:1746144908.304260:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175400832:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:0.0:1746144908.304275:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a939800/0x4076af6727515ef8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.304283:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.304285:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.304288:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a939800/0x4076af6727515ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [9404416->10444799] (req 9404416->10444799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.304295:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a939800/0x4076af6727515ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [9404416->10444799] (req 9404416->10444799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1746144908.336542:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968570 is committed 00002000:00010000:2.0:1746144908.337027:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 8355840 -> 10444800 00002000:00010000:2.0:1746144908.337031:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 16391 -> 18439 00010000:00010000:2.0:1746144908.337042:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515ef1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [8355840->9404415] (req 8355840->9404415) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.337052:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515ef1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [8355840->9404415] (req 8355840->9404415) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.337059:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515ef1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [8355840->9404415] (req 8355840->9404415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.337064:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5c200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144908.337068:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515ef1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [8355840->9404415] (req 8355840->9404415) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.337079:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515ef1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [8355840->9404415] (req 8355840->9404415) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.337096:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515ef1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [8355840->9404415] (req 8355840->9404415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.337101:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af6727515ef1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [8355840->9404415] (req 8355840->9404415) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144908.337169:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1982:x1830965175400704:12345-192.168.202.16@tcp:4:dd.0 Request processed in 34422us (34701us total) trans 4294968570 rc 0/0 00000100:00100000:2.0:1746144908.337177:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4322 00002000:00010000:1.0:1746144908.366419:0:31844:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 18439 -> 20489 00010000:00010000:1.0:1746144908.366432:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a939800/0x4076af6727515ef8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [9404416->10444799] (req 9404416->10444799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.366442:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a939800/0x4076af6727515ef8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [9404416->10444799] (req 9404416->10444799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.366453:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a939800/0x4076af6727515ef8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [9404416->10444799] (req 9404416->10444799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.366458:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a939800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144908.366461:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a939800/0x4076af6727515ef8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [9404416->10444799] (req 9404416->10444799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.366468:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a939800/0x4076af6727515ef8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [9404416->10444799] (req 9404416->10444799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.366483:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a939800/0x4076af6727515ef8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [9404416->10444799] (req 9404416->10444799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.366488:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a939800/0x4076af6727515ef8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [9404416->10444799] (req 9404416->10444799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144908.366560:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175400832:12345-192.168.202.16@tcp:4:dd.0 Request processed in 62295us (62360us total) trans 4294968571 rc 0/0 00000100:00100000:1.0:1746144908.366569:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4323 00000001:00080000:2.0:1746144908.366684:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968571 is committed 00000100:00100000:1.0:1746144908.369671:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144908.369708:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144908.369734:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175401344 00000100:00100000:3.0:1746144908.369741:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175401472 00000100:00100000:2.0:1746144908.369742:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175401344 00000100:00100000:3.0:1746144908.369744:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175401472 00000100:00100000:2.0:1746144908.369816:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4324 00000100:00100000:2.0:1746144908.369823:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175401344:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:2.0:1746144908.369850:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092704600/0x4076af6727515eff lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.369861:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.369862:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.369866:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092704600/0x4076af6727515eff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.369876:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092704600/0x4076af6727515eff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.369885:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4325 00000100:00100000:3.0:1746144908.369891:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175401472:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:3.0:1746144908.369905:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f06 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.369912:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.369913:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.369915:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f06 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.369925:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f06 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.380075:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092704600/0x4076af6727515eff lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.380088:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092704600/0x4076af6727515eff lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.380095:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092704600/0x4076af6727515eff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.380100:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092704600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144908.380104:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092704600/0x4076af6727515eff lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.380110:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092704600/0x4076af6727515eff lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.380125:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092704600/0x4076af6727515eff lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.380130:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092704600/0x4076af6727515eff lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144908.380194:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175401344:12345-192.168.202.16@tcp:3:dd.0 Request processed in 10368us (10527us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144908.380202:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4324 00010000:00010000:3.0:1746144908.381718:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f06 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.381729:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f06 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.381737:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.381742:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927d1a00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144908.381745:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.381751:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.381788:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f06 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.381794:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f06 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5201920->6242303] (req 5201920->6242303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.381846:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175401472:12345-192.168.202.16@tcp:3:dd.0 Request processed in 11952us (12134us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746144908.381856:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4325 00000100:00100000:1.0:1746144908.391494:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144908.391533:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144908.391974:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175401856 00000100:00100000:3.0:1746144908.391982:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175401984 00000100:00100000:2.0:1746144908.391983:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175401856 00000100:00100000:3.0:1746144908.391986:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175401984 00000100:00100000:3.0:1746144908.392033:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4326 00000100:00100000:3.0:1746144908.392039:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175401984:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144908.392054:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4327 00000100:00100000:2.0:1746144908.392059:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175401856:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:3.0:1746144908.392081:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 10444800, mtime: 0x68140e8c, atime: 0x0, ctime: 0x68140e8c, blocks: 0x5009 00010000:00010000:3.0:1746144908.392090:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.392101:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.392103:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.392107:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [11493376->12533759] (req 11493376->12533759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.392122:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [11493376->12533759] (req 11493376->12533759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.392196:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092705200/0x4076af6727515f14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.392204:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.392205:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.392208:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092705200/0x4076af6727515f14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [10444800->11493375] (req 10444800->11493375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.392215:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092705200/0x4076af6727515f14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [10444800->11493375] (req 10444800->11493375) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1746144908.437015:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968572 is committed 00002000:00010000:3.0:1746144908.437517:0:8438:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 10444800 -> 12533760 00002000:00010000:3.0:1746144908.437521:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 20489 -> 24585 00010000:00010000:3.0:1746144908.437530:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [11493376->12533759] (req 11493376->12533759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.437540:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [11493376->12533759] (req 11493376->12533759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.437546:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [11493376->12533759] (req 11493376->12533759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.437556:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927d1a00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144908.437559:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [11493376->12533759] (req 11493376->12533759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.437565:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [11493376->12533759] (req 11493376->12533759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.437579:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [11493376->12533759] (req 11493376->12533759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.437584:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927d1a00/0x4076af6727515f0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [11493376->12533759] (req 11493376->12533759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.438297:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1983:x1830965175401984:12345-192.168.202.16@tcp:4:dd.0 Request processed in 46252us (46757us total) trans 4294968572 rc 0/0 00000100:00100000:3.0:1746144908.438306:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4326 00000001:00080000:3.0:1746144908.469376:0:7157:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294987521 is committed 00000001:00080000:3.0:1746144908.469386:0:7157:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294987513 is committed 00000001:00080000:3.0:1746144908.469415:0:7157:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294987520 is committed 00000001:00080000:3.0:1746144908.469430:0:7157:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294987522 is committed 00000001:00080000:3.0:1746144908.471715:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968573 is committed 00010000:00010000:1.0:1746144908.472314:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092705200/0x4076af6727515f14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [10444800->11493375] (req 10444800->11493375) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.472325:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092705200/0x4076af6727515f14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [10444800->11493375] (req 10444800->11493375) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.472333:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092705200/0x4076af6727515f14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [10444800->11493375] (req 10444800->11493375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.472337:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092705200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144908.472340:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092705200/0x4076af6727515f14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [10444800->11493375] (req 10444800->11493375) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.472346:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092705200/0x4076af6727515f14 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [10444800->11493375] (req 10444800->11493375) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.472360:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092705200/0x4076af6727515f14 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [10444800->11493375] (req 10444800->11493375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.472365:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092705200/0x4076af6727515f14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [10444800->11493375] (req 10444800->11493375) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144908.472446:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1983:x1830965175401856:12345-192.168.202.16@tcp:4:dd.0 Request processed in 80382us (80954us total) trans 4294968573 rc 0/0 00000100:00100000:1.0:1746144908.472454:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4327 00000100:00100000:1.0:1746144908.476867:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144908.476955:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144908.477008:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175402496 00000100:00100000:3.0:1746144908.477016:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175402496 00000100:00100000:2.0:1746144908.477021:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175402752 00000100:00100000:2.0:1746144908.477024:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175402752 00000100:00100000:2.0:1746144908.477068:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4328 00000100:00100000:2.0:1746144908.477075:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175402752:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:2.0:1746144908.477104:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091708c00/0x4076af6727515f1b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.477122:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4329 00000100:00100000:3.0:1746144908.477128:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175402496:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:3.0:1746144908.477148:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af6727515f22 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.477154:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.477156:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.477156:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.477157:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.477161:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af6727515f22 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.477161:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091708c00/0x4076af6727515f1b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.477171:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af6727515f22 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.477171:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091708c00/0x4076af6727515f1b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.493204:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091708c00/0x4076af6727515f1b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.493218:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091708c00/0x4076af6727515f1b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.493225:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091708c00/0x4076af6727515f1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.493232:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091708c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144908.493235:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091708c00/0x4076af6727515f1b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.493242:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091708c00/0x4076af6727515f1b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.493257:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091708c00/0x4076af6727515f1b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.493263:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091708c00/0x4076af6727515f1b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.493388:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175402752:12345-192.168.202.16@tcp:3:dd.0 Request processed in 16310us (16428us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144908.493397:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4328 00010000:00010000:3.0:1746144908.495300:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af6727515f22 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.495312:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af6727515f22 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.495319:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af6727515f22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.495324:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092fea600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144908.495327:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af6727515f22 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.495334:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af6727515f22 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.495347:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af6727515f22 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.495353:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af6727515f22 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6242304->7282687] (req 6242304->7282687) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.495411:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175402496:12345-192.168.202.16@tcp:3:dd.0 Request processed in 18279us (18548us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746144908.495421:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4329 00000100:00100000:0.0:1746144908.500277:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.500326:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144908.500358:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175403136 00000100:00100000:3.0:1746144908.500367:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175403136 00000100:00100000:2.0:1746144908.500373:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175403008 00000100:00100000:2.0:1746144908.500377:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175403008 00000100:00100000:2.0:1746144908.500422:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4330 00000100:00100000:2.0:1746144908.500428:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175403008:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:2.0:1746144908.500464:0:31844:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 12533760, mtime: 0x68140e8c, atime: 0x0, ctime: 0x68140e8c, blocks: 0x6009 00010000:00010000:2.0:1746144908.500471:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727515f29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.500477:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4331 00010000:00010000:2.0:1746144908.500481:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746144908.500483:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175403136:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:2.0:1746144908.500483:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.500487:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727515f29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [12533760->13582335] (req 12533760->13582335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.500498:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092feac00/0x4076af6727515f30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.500498:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727515f29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [12533760->13582335] (req 12533760->13582335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.500506:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.500508:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.500511:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092feac00/0x4076af6727515f30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [13582336->14622719] (req 13582336->14622719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.500519:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092feac00/0x4076af6727515f30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [13582336->14622719] (req 13582336->14622719) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746144908.545025:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968574 is committed 00002000:00010000:2.0:1746144908.546890:0:31844:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 12533760 -> 14622720 00002000:00010000:2.0:1746144908.546895:0:31844:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 24585 -> 28681 00010000:00010000:2.0:1746144908.546907:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727515f29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [12533760->13582335] (req 12533760->13582335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.546916:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727515f29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [12533760->13582335] (req 12533760->13582335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.546924:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727515f29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [12533760->13582335] (req 12533760->13582335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.546933:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091708a00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144908.546936:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727515f29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [12533760->13582335] (req 12533760->13582335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.546943:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727515f29 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [12533760->13582335] (req 12533760->13582335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.546957:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727515f29 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [12533760->13582335] (req 12533760->13582335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.546962:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091708a00/0x4076af6727515f29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [12533760->13582335] (req 12533760->13582335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144908.547028:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1983:x1830965175403008:12345-192.168.202.16@tcp:4:dd.0 Request processed in 46595us (46696us total) trans 4294968574 rc 0/0 00000100:00100000:2.0:1746144908.547036:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4330 00000001:00080000:1.0:1746144908.571662:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968575 is committed 00010000:00010000:0.0:1746144908.572469:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092feac00/0x4076af6727515f30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [13582336->14622719] (req 13582336->14622719) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.572481:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092feac00/0x4076af6727515f30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [13582336->14622719] (req 13582336->14622719) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.572488:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092feac00/0x4076af6727515f30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [13582336->14622719] (req 13582336->14622719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.572494:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092feac00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144908.572498:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092feac00/0x4076af6727515f30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [13582336->14622719] (req 13582336->14622719) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.572511:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092feac00/0x4076af6727515f30 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [13582336->14622719] (req 13582336->14622719) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.572526:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092feac00/0x4076af6727515f30 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [13582336->14622719] (req 13582336->14622719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.572532:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092feac00/0x4076af6727515f30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [13582336->14622719] (req 13582336->14622719) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144908.573021:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1983:x1830965175403136:12345-192.168.202.16@tcp:4:dd.0 Request processed in 72533us (72747us total) trans 4294968575 rc 0/0 00000100:00100000:0.0:1746144908.573029:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4331 00000100:00100000:1.0:1746144908.576182:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144908.576225:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.576242:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175403648 00000100:00100000:0.0:1746144908.576251:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175403648 00000100:00100000:2.0:1746144908.576274:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175403776 00000100:00100000:2.0:1746144908.576281:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175403776 00000100:00100000:0.0:1746144908.576309:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4332 00000100:00100000:2.0:1746144908.576316:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4333 00000100:00100000:0.0:1746144908.576317:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175403648:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:2.0:1746144908.576323:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175403776:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:2.0:1746144908.576342:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880099537600/0x4076af6727515f37 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.576342:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af6727515f3e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.576353:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.576353:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.576354:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.576355:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.576358:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099537600/0x4076af6727515f37 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.576358:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af6727515f3e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.576369:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099537600/0x4076af6727515f37 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.576369:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af6727515f3e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.587364:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af6727515f3e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.587378:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af6727515f3e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.587385:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af6727515f3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.587390:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad30200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144908.587393:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af6727515f3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.587399:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af6727515f3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.587412:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af6727515f3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.587417:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af6727515f3e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144908.587490:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175403648:12345-192.168.202.16@tcp:3:dd.0 Request processed in 11170us (11309us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144908.587498:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4332 00010000:00010000:2.0:1746144908.591292:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880099537600/0x4076af6727515f37 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.591306:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099537600/0x4076af6727515f37 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.591314:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099537600/0x4076af6727515f37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.591320:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099537600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144908.591323:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099537600/0x4076af6727515f37 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.591329:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099537600/0x4076af6727515f37 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.591348:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099537600/0x4076af6727515f37 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.591353:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099537600/0x4076af6727515f37 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7282688->8323071] (req 7282688->8323071) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144908.591902:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175403776:12345-192.168.202.16@tcp:3:dd.0 Request processed in 15575us (15671us total) trans 0 rc 1040384/1040384 00000100:00100000:2.0:1746144908.591915:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4333 00000100:00100000:1.0:1746144908.595684:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144908.595885:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175404160 00000100:00100000:2.0:1746144908.595892:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175404160 00000100:00100000:2.0:1746144908.595933:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4334 00000100:00100000:2.0:1746144908.595940:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175404160:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:2.0:1746144908.595977:0:31844:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 14622720, mtime: 0x68140e8c, atime: 0x0, ctime: 0x68140e8c, blocks: 0x7009 00010000:00010000:2.0:1746144908.595983:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099536c00/0x4076af6727515f45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.595994:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.595995:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.595999:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099536c00/0x4076af6727515f45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [14622720->15671295] (req 14622720->15671295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.596009:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099536c00/0x4076af6727515f45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [14622720->15671295] (req 14622720->15671295) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.596263:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.596306:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175404288 00000100:00100000:0.0:1746144908.596310:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175404288 00000100:00100000:0.0:1746144908.596340:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4335 00000100:00100000:0.0:1746144908.596345:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175404288:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:0.0:1746144908.596356:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515f4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.596363:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.596364:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.596367:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515f4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [15671296->16711679] (req 15671296->16711679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.596373:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515f4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [15671296->16711679] (req 15671296->16711679) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746144908.636125:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968576 is committed 00010000:00010000:2.0:1746144908.636389:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1746144908.636841:0:31844:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 14622720 -> 16711680 00002000:00010000:3.0:1746144908.636844:0:31844:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb mtime from disk: 1746144908 -> 1746144909 00002000:00010000:3.0:1746144908.636846:0:31844:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb ctime from disk: 1746144908 -> 1746144909 00002000:00010000:3.0:1746144908.636848:0:31844:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 28681 -> 32777 00010000:00010000:3.0:1746144908.636858:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099536c00/0x4076af6727515f45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [14622720->15671295] (req 14622720->15671295) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.636867:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099536c00/0x4076af6727515f45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [14622720->15671295] (req 14622720->15671295) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.636878:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099536c00/0x4076af6727515f45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [14622720->15671295] (req 14622720->15671295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.636883:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099536c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144908.636886:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099536c00/0x4076af6727515f45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [14622720->15671295] (req 14622720->15671295) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.636893:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099536c00/0x4076af6727515f45 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [14622720->15671295] (req 14622720->15671295) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.636905:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099536c00/0x4076af6727515f45 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [14622720->15671295] (req 14622720->15671295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.636910:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099536c00/0x4076af6727515f45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [14622720->15671295] (req 14622720->15671295) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.636984:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009181fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1982:x1830965175404160:12345-192.168.202.16@tcp:4:dd.0 Request processed in 41041us (41303us total) trans 4294968576 rc 0/0 00000100:00100000:3.0:1746144908.636991:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4334 00010000:00010000:1.0:1746144908.660466:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515f4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [15671296->16711679] (req 15671296->16711679) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.660478:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515f4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [15671296->16711679] (req 15671296->16711679) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.660490:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515f4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [15671296->16711679] (req 15671296->16711679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.660497:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad30800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144908.660500:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515f4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [15671296->16711679] (req 15671296->16711679) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.660506:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515f4c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [15671296->16711679] (req 15671296->16711679) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.660521:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515f4c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [15671296->16711679] (req 15671296->16711679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.660526:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515f4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [15671296->16711679] (req 15671296->16711679) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144908.660915:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175404288:12345-192.168.202.16@tcp:4:dd.0 Request processed in 64565us (64647us total) trans 4294968577 rc 0/0 00000100:00100000:1.0:1746144908.660924:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4335 00000001:00080000:1.0:1746144908.660953:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968577 is committed 00000100:00100000:3.0:1746144908.667481:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144908.667754:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144908.667819:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175404928 00000100:00100000:2.0:1746144908.667827:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175404928 00000100:00100000:1.0:1746144908.667849:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175404800 00000100:00100000:1.0:1746144908.667853:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175404800 00000100:00100000:2.0:1746144908.667879:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4336 00000100:00100000:1.0:1746144908.667885:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4337 00000100:00100000:2.0:1746144908.667887:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175404928:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:1.0:1746144908.667891:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1985:x1830965175404800:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:2.0:1746144908.667914:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f5a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.667914:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727515f53 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.667925:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144908.667925:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.667927:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144908.667927:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.667930:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f5a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8323072->9363455] (req 8323072->9363455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.667930:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727515f53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.667941:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f5a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8323072->9363455] (req 8323072->9363455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.667941:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727515f53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.677994:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f5a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8323072->9363455] (req 8323072->9363455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.678011:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f5a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8323072->9363455] (req 8323072->9363455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.678026:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8323072->9363455] (req 8323072->9363455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.678031:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbbd000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144908.678035:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f5a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8323072->9363455] (req 8323072->9363455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.678042:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f5a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8323072->9363455] (req 8323072->9363455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.678056:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f5a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8323072->9363455] (req 8323072->9363455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.678061:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f5a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8323072->9363455] (req 8323072->9363455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.678152:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175404928:12345-192.168.202.16@tcp:3:dd.0 Request processed in 10262us (10673us total) trans 0 rc 1040384/1040384 00000100:00100000:3.0:1746144908.678161:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4336 00010000:00010000:1.0:1746144908.680700:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727515f53 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.680712:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727515f53 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.680719:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727515f53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.680724:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094376e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144908.680727:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727515f53 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.680732:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727515f53 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.680750:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727515f53 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.680755:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880094376e00/0x4076af6727515f53 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144908.681055:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1985:x1830965175404800:12345-192.168.202.16@tcp:3:dd.0 Request processed in 13160us (13297us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144908.681063:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4337 00000100:00100000:0.0:1746144908.683932:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.683974:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144908.684063:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175405312 00000100:00100000:1.0:1746144908.684070:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175405312 00000100:00100000:1.0:1746144908.684113:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175405440 00000100:00100000:1.0:1746144908.684115:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175405440 00000100:00100000:1.0:1746144908.684130:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4338 00000100:00100000:1.0:1746144908.684136:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175405312:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144908.684160:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4339 00000100:00100000:3.0:1746144908.684168:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009230ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175405440:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:1.0:1746144908.684173:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 16711680, mtime: 0x68140e8d, atime: 0x0, ctime: 0x68140e8d, blocks: 0x8009 00010000:00010000:1.0:1746144908.684180:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727515f61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.684182:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bb68000/0x4076af6727515f68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.684192:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.684193:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.684198:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb68000/0x4076af6727515f68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [17760256->18800639] (req 17760256->18800639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.684208:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb68000/0x4076af6727515f68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [17760256->18800639] (req 17760256->18800639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.684208:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144908.684210:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144908.684213:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727515f61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [16711680->17760255] (req 16711680->17760255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.684221:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727515f61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [16711680->17760255] (req 16711680->17760255) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746144908.750027:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968578 is committed 00002000:00010000:3.0:1746144908.750426:0:31844:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 16711680 -> 18800640 00002000:00010000:3.0:1746144908.750430:0:31844:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 32777 -> 36873 00010000:00010000:3.0:1746144908.750440:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009bb68000/0x4076af6727515f68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [17760256->18800639] (req 17760256->18800639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.750449:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb68000/0x4076af6727515f68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [17760256->18800639] (req 17760256->18800639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.750456:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bb68000/0x4076af6727515f68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [17760256->18800639] (req 17760256->18800639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.750462:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bb68000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144908.750465:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bb68000/0x4076af6727515f68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [17760256->18800639] (req 17760256->18800639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.750472:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bb68000/0x4076af6727515f68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [17760256->18800639] (req 17760256->18800639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.750486:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bb68000/0x4076af6727515f68 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [17760256->18800639] (req 17760256->18800639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.750492:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb68000/0x4076af6727515f68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [17760256->18800639] (req 17760256->18800639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.750566:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1983:x1830965175405440:12345-192.168.202.16@tcp:4:dd.0 Request processed in 66395us (66586us total) trans 4294968578 rc 0/0 00000100:00100000:3.0:1746144908.750575:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4339 00000001:00080000:0.0:1746144908.780500:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968579 is committed 00010000:00010000:1.0:1746144908.781499:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727515f61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [16711680->17760255] (req 16711680->17760255) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.781511:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727515f61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [16711680->17760255] (req 16711680->17760255) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.781518:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727515f61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [16711680->17760255] (req 16711680->17760255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.781524:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094377800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144908.781527:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727515f61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [16711680->17760255] (req 16711680->17760255) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.781534:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727515f61 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [16711680->17760255] (req 16711680->17760255) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.781549:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727515f61 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [16711680->17760255] (req 16711680->17760255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.781555:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af6727515f61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [16711680->17760255] (req 16711680->17760255) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144908.782839:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009230e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1983:x1830965175405312:12345-192.168.202.16@tcp:4:dd.0 Request processed in 98696us (98908us total) trans 4294968579 rc 0/0 00000100:00100000:1.0:1746144908.782850:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4338 00000100:00100000:3.0:1746144908.786323:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144908.786363:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144908.786398:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144908.786437:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175405824 00000100:00100000:2.0:1746144908.786445:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175405824 00000100:00100000:0.0:1746144908.786445:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175406208 00000100:00100000:0.0:1746144908.786448:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175406208 00000100:00100000:0.0:1746144908.786533:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175406336 00000100:00100000:0.0:1746144908.786536:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175406336 00000100:00100000:1.0:1746144908.786556:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4340 00000100:00100000:1.0:1746144908.786564:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175406208:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:1.0:1746144908.786591:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f6f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.786602:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144908.786604:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144908.786608:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144908.786745:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4341 00000100:00100000:2.0:1746144908.786749:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4342 00000100:00100000:0.0:1746144908.786751:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175406336:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:2.0:1746144908.786753:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175405824:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:2.0:1746144908.786784:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800918d7e00/0x4076af6727515f76 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.786791:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.786793:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144908.786795:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800918d7e00/0x4076af6727515f76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.786814:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800918d7e00/0x4076af6727515f76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.786850:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093cff000/0x4076af6727515f7d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.786857:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.786858:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.786860:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093cff000/0x4076af6727515f7d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.786868:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093cff000/0x4076af6727515f7d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.787016:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.791547:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800918d7e00/0x4076af6727515f76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.791561:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800918d7e00/0x4076af6727515f76 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.791568:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800918d7e00/0x4076af6727515f76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.791577:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800918d7e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144908.791580:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800918d7e00/0x4076af6727515f76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.791587:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800918d7e00/0x4076af6727515f76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.791601:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800918d7e00/0x4076af6727515f76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.791606:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800918d7e00/0x4076af6727515f76 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 5 type: EXT [9363456->9437183] (req 9363456->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144908.791658:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175405824:12345-192.168.202.16@tcp:3:dd.0 Request processed in 4900us (5338us total) trans 0 rc 73728/73728 00000100:00100000:2.0:1746144908.791666:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4342 00010000:00010000:1.0:1746144908.799700:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f6f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.799716:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f6f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.799724:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.799729:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099a72800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144908.799733:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f6f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.799739:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f6f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.799758:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f6f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.799788:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f6f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10403839] (req 9437184->10403839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144908.800219:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175406208:12345-192.168.202.16@tcp:3:dd.0 Request processed in 13650us (13849us total) trans 0 rc 966656/966656 00000100:00100000:1.0:1746144908.800404:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4340 00010000:00010000:0.0:1746144908.802416:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093cff000/0x4076af6727515f7d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.802429:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093cff000/0x4076af6727515f7d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.802435:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093cff000/0x4076af6727515f7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.802440:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093cff000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144908.802443:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093cff000/0x4076af6727515f7d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.802449:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093cff000/0x4076af6727515f7d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.802461:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093cff000/0x4076af6727515f7d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.802466:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093cff000/0x4076af6727515f7d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144908.802519:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175406336:12345-192.168.202.16@tcp:3:dd.0 Request processed in 15765us (16117us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144908.802530:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4341 00000100:00100000:2.0:1746144908.807067:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144908.807105:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.807159:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175406592 00000100:00100000:1.0:1746144908.807166:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175406720 00000100:00100000:0.0:1746144908.807167:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175406592 00000100:00100000:1.0:1746144908.807169:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175406720 00000100:00100000:1.0:1746144908.807209:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4343 00000100:00100000:0.0:1746144908.807214:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4344 00000100:00100000:1.0:1746144908.807216:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175406720:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144908.807218:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175406592:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:1.0:1746144908.807256:0:8438:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 18800640, mtime: 0x68140e8d, atime: 0x0, ctime: 0x68140e8d, blocks: 0x9009 00010000:00010000:1.0:1746144908.807265:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.807267:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093cfe600/0x4076af6727515f8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.807276:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144908.807277:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144908.807281:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [19849216->20889599] (req 19849216->20889599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.807292:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [19849216->20889599] (req 19849216->20889599) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.807337:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.807338:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.807341:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880093cfe600/0x4076af6727515f8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [18800640->19849215] (req 18800640->19849215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.807348:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880093cfe600/0x4076af6727515f8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [18800640->19849215] (req 18800640->19849215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1746144908.841273:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968580 is committed 00002000:00010000:1.0:1746144908.841697:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 18800640 -> 20889600 00002000:00010000:1.0:1746144908.841702:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 36873 -> 38921 00010000:00010000:1.0:1746144908.841712:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880093cfe600/0x4076af6727515f8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [18800640->19849215] (req 18800640->19849215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.841722:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880093cfe600/0x4076af6727515f8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [18800640->19849215] (req 18800640->19849215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.841729:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880093cfe600/0x4076af6727515f8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [18800640->19849215] (req 18800640->19849215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.841734:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093cfe600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144908.841737:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880093cfe600/0x4076af6727515f8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [18800640->19849215] (req 18800640->19849215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.841744:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880093cfe600/0x4076af6727515f8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [18800640->19849215] (req 18800640->19849215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.841758:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880093cfe600/0x4076af6727515f8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [18800640->19849215] (req 18800640->19849215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.841781:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880093cfe600/0x4076af6727515f8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [18800640->19849215] (req 18800640->19849215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144908.841864:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1983:x1830965175406592:12345-192.168.202.16@tcp:4:dd.0 Request processed in 34639us (34797us total) trans 4294968580 rc 0/0 00000100:00100000:1.0:1746144908.841873:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4344 00002000:00010000:0.0:1746144908.866315:0:8438:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 38921 -> 40969 00010000:00010000:0.0:1746144908.866328:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [19849216->20889599] (req 19849216->20889599) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.866337:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [19849216->20889599] (req 19849216->20889599) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.866344:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [19849216->20889599] (req 19849216->20889599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.866350:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099a72800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144908.866354:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [19849216->20889599] (req 19849216->20889599) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.866360:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f84 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [19849216->20889599] (req 19849216->20889599) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.866378:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f84 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [19849216->20889599] (req 19849216->20889599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.866383:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a72800/0x4076af6727515f84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [19849216->20889599] (req 19849216->20889599) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144908.866462:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175406720:12345-192.168.202.16@tcp:4:dd.0 Request processed in 59242us (59351us total) trans 4294968581 rc 0/0 00000100:00100000:0.0:1746144908.866471:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4343 00000001:00080000:0.0:1746144908.866505:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968581 is committed 00000100:00100000:2.0:1746144908.869255:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144908.869285:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144908.869415:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175407232 00000100:00100000:1.0:1746144908.869424:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175407232 00000100:00100000:1.0:1746144908.869465:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175407488 00000100:00100000:1.0:1746144908.869467:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175407488 00000100:00100000:1.0:1746144908.869484:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4345 00000100:00100000:0.0:1746144908.869489:0:25029:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4346 00000100:00100000:1.0:1746144908.869490:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175407232:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144908.869495:0:25029:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175407488:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:1.0:1746144908.869514:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f99 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.869514:0:25029:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727515f92 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.869526:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.869526:0:25029:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144908.869527:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.869527:0:25029:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144908.869531:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10403840->11444223] (req 10403840->11444223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.869531:0:25029:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727515f92 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.869541:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10403840->11444223] (req 10403840->11444223) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.869541:0:25029:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727515f92 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.878852:0:25029:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727515f92 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.878866:0:25029:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727515f92 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.878873:0:25029:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727515f92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.878879:0:25029:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4ab5200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144908.878886:0:25029:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727515f92 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.878892:0:25029:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727515f92 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.878906:0:25029:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727515f92 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.878911:0:25029:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4ab5200/0x4076af6727515f92 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144908.878974:0:25029:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175407488:12345-192.168.202.16@tcp:3:dd.0 Request processed in 9475us (9684us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144908.878982:0:25029:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4346 00010000:00010000:1.0:1746144908.882259:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f99 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10403840->11444223] (req 10403840->11444223) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.882274:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f99 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10403840->11444223] (req 10403840->11444223) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.882281:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10403840->11444223] (req 10403840->11444223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.882287:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012dbbd000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144908.882291:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f99 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10403840->11444223] (req 10403840->11444223) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.882298:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f99 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10403840->11444223] (req 10403840->11444223) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.882314:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f99 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10403840->11444223] (req 10403840->11444223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.882319:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012dbbd000/0x4076af6727515f99 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10403840->11444223] (req 10403840->11444223) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144908.882563:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175407232:12345-192.168.202.16@tcp:3:dd.0 Request processed in 13068us (13311us total) trans 0 rc 1040384/1040384 00000100:00100000:1.0:1746144908.882572:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4345 00000100:00100000:2.0:1746144908.889268:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144908.889364:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175407744 00000100:00100000:1.0:1746144908.889373:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175407744 00000100:00100000:1.0:1746144908.889437:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4347 00000100:00100000:1.0:1746144908.889444:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175407744:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:1.0:1746144908.889482:0:8436:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 20889600, mtime: 0x68140e8d, atime: 0x0, ctime: 0x68140e8d, blocks: 0xa009 00010000:00010000:1.0:1746144908.889489:0:8436:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a939c00/0x4076af6727515fa0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.889500:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144908.889502:0:8436:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144908.889505:0:8436:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a939c00/0x4076af6727515fa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [20889600->21938175] (req 20889600->21938175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144908.889517:0:8436:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a939c00/0x4076af6727515fa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [20889600->21938175] (req 20889600->21938175) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144908.890327:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.890441:0:25029:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175407872 00000100:00100000:0.0:1746144908.890446:0:25029:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175407872 00000100:00100000:0.0:1746144908.890471:0:25029:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4348 00000100:00100000:0.0:1746144908.890476:0:25029:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012a2b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175407872:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:0.0:1746144908.890491:0:25029:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130df4200/0x4076af6727515fa7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.890499:0:25029:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.890500:0:25029:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.890503:0:25029:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130df4200/0x4076af6727515fa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [21938176->22978559] (req 21938176->22978559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.890511:0:25029:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130df4200/0x4076af6727515fa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [21938176->22978559] (req 21938176->22978559) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746144908.950919:0:8436:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 20889600 -> 22978560 00002000:00010000:0.0:1746144908.950926:0:8436:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 40969 -> 43019 00010000:00010000:0.0:1746144908.950937:0:8436:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009a939c00/0x4076af6727515fa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [20889600->21938175] (req 20889600->21938175) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.950947:0:8436:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009a939c00/0x4076af6727515fa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [20889600->21938175] (req 20889600->21938175) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.950955:0:8436:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009a939c00/0x4076af6727515fa0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [20889600->21938175] (req 20889600->21938175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.950962:0:8436:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a939c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144908.950965:0:8436:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a939c00/0x4076af6727515fa0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [20889600->21938175] (req 20889600->21938175) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.950977:0:8436:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009a939c00/0x4076af6727515fa0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [20889600->21938175] (req 20889600->21938175) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.950993:0:8436:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009a939c00/0x4076af6727515fa0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [20889600->21938175] (req 20889600->21938175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.950998:0:8436:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a939c00/0x4076af6727515fa0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [20889600->21938175] (req 20889600->21938175) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8436 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144908.951075:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1982:x1830965175407744:12345-192.168.202.16@tcp:4:dd.0 Request processed in 61627us (61812us total) trans 4294968582 rc 0/0 00000100:00100000:0.0:1746144908.951084:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4347 00000001:00080000:0.0:1746144908.951113:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968582 is committed 00000001:00080000:0.0:1746144908.982573:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968583 is committed 00002000:00010000:2.0:1746144908.983292:0:25029:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 43019 -> 45067 00010000:00010000:2.0:1746144908.983305:0:25029:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880130df4200/0x4076af6727515fa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [21938176->22978559] (req 21938176->22978559) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.983319:0:25029:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130df4200/0x4076af6727515fa7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [21938176->22978559] (req 21938176->22978559) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.983326:0:25029:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130df4200/0x4076af6727515fa7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [21938176->22978559] (req 21938176->22978559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.983332:0:25029:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130df4200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144908.983336:0:25029:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130df4200/0x4076af6727515fa7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [21938176->22978559] (req 21938176->22978559) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.983342:0:25029:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130df4200/0x4076af6727515fa7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [21938176->22978559] (req 21938176->22978559) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.983358:0:25029:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130df4200/0x4076af6727515fa7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [21938176->22978559] (req 21938176->22978559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144908.983363:0:25029:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130df4200/0x4076af6727515fa7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [21938176->22978559] (req 21938176->22978559) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144908.983450:0:25029:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012a2b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1983:x1830965175407872:12345-192.168.202.16@tcp:4:dd.0 Request processed in 92969us (93120us total) trans 4294968583 rc 0/0 00000100:00100000:2.0:1746144908.983459:0:25029:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4348 00000100:00100000:2.0:1746144908.987742:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144908.987926:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144908.988115:0:25029:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175408384 00000100:00100000:0.0:1746144908.988125:0:25029:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175408384 00000100:00100000:0.0:1746144908.988170:0:25029:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175408512 00000100:00100000:0.0:1746144908.988172:0:25029:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175408512 00000100:00100000:0.0:1746144908.988201:0:25029:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4349 00000100:00100000:0.0:1746144908.988208:0:25029:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175408384:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:0.0:1746144908.988237:0:25029:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f89a00/0x4076af6727515fae lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.988250:0:25029:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.988252:0:25029:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144908.988256:0:25029:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f89a00/0x4076af6727515fae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144908.988271:0:25029:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a4f89a00/0x4076af6727515fae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144908.988455:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4350 00000100:00100000:3.0:1746144908.988462:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175408512:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:3.0:1746144908.988478:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a5f200/0x4076af6727515fb5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.988486:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.988487:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144908.988490:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5f200/0x4076af6727515fb5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11444224->12484607] (req 11444224->12484607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144908.988497:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a5f200/0x4076af6727515fb5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11444224->12484607] (req 11444224->12484607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144909.002403:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a5f200/0x4076af6727515fb5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11444224->12484607] (req 11444224->12484607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144909.002423:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5f200/0x4076af6727515fb5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11444224->12484607] (req 11444224->12484607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144909.002430:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a5f200/0x4076af6727515fb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11444224->12484607] (req 11444224->12484607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144909.002436:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5f200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144909.002439:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5f200/0x4076af6727515fb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11444224->12484607] (req 11444224->12484607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144909.002446:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5f200/0x4076af6727515fb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11444224->12484607] (req 11444224->12484607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144909.002461:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a5f200/0x4076af6727515fb5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11444224->12484607] (req 11444224->12484607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144909.002467:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a5f200/0x4076af6727515fb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11444224->12484607] (req 11444224->12484607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144909.002537:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175408512:12345-192.168.202.16@tcp:3:dd.0 Request processed in 14071us (14606us total) trans 0 rc 1040384/1040384 00000100:00100000:2.0:1746144909.002546:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4350 00010000:00010000:0.0:1746144909.009107:0:25029:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a4f89a00/0x4076af6727515fae lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.009123:0:25029:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a4f89a00/0x4076af6727515fae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.009131:0:25029:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a4f89a00/0x4076af6727515fae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.009137:0:25029:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4f89a00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144909.009383:0:25029:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4f89a00/0x4076af6727515fae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.009392:0:25029:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a4f89a00/0x4076af6727515fae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.009408:0:25029:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a4f89a00/0x4076af6727515fae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.009414:0:25029:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a4f89a00/0x4076af6727515fae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144909.009504:0:25029:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175408384:12345-192.168.202.16@tcp:3:dd.0 Request processed in 21291us (21765us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.009516:0:25029:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4349 00000100:00100000:0.0:1746144909.015374:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.015422:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.016140:0:25029:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175408896 00000100:00100000:3.0:1746144909.016146:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175409024 00000100:00100000:2.0:1746144909.016148:0:25029:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175408896 00000100:00100000:3.0:1746144909.016150:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175409024 00000100:00100000:2.0:1746144909.016205:0:25029:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4351 00000100:00100000:2.0:1746144909.016213:0:25029:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175408896:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:2.0:1746144909.016252:0:25029:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 22978560, mtime: 0x68140e8d, atime: 0x0, ctime: 0x68140e8d, blocks: 0xb00b 00000100:00100000:3.0:1746144909.016255:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4352 00010000:00010000:2.0:1746144909.016259:0:25029:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092704c00/0x4076af6727515fbc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144909.016262:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175409024:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:2.0:1746144909.016270:0:25029:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144909.016271:0:25029:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144909.016274:0:25029:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092704c00/0x4076af6727515fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [22978560->24027135] (req 22978560->24027135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144909.016277:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515fc3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144909.016286:0:25029:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092704c00/0x4076af6727515fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [22978560->24027135] (req 22978560->24027135) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144909.016289:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144909.016290:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144909.016293:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [24027136->25067519] (req 24027136->25067519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144909.016301:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [24027136->25067519] (req 24027136->25067519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1746144909.063463:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968584 is committed 00002000:00010000:0.0:1746144909.064257:0:25029:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 22978560 -> 25067520 00002000:00010000:0.0:1746144909.064261:0:25029:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 45067 -> 47115 00010000:00010000:0.0:1746144909.064272:0:25029:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092704c00/0x4076af6727515fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [22978560->24027135] (req 22978560->24027135) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.064281:0:25029:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092704c00/0x4076af6727515fbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [22978560->24027135] (req 22978560->24027135) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.064287:0:25029:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092704c00/0x4076af6727515fbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [22978560->24027135] (req 22978560->24027135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.064292:0:25029:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092704c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144909.064296:0:25029:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092704c00/0x4076af6727515fbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [22978560->24027135] (req 22978560->24027135) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.064302:0:25029:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092704c00/0x4076af6727515fbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [22978560->24027135] (req 22978560->24027135) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.064315:0:25029:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092704c00/0x4076af6727515fbc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [22978560->24027135] (req 22978560->24027135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.064321:0:25029:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092704c00/0x4076af6727515fbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [22978560->24027135] (req 22978560->24027135) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144909.064391:0:25029:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1983:x1830965175408896:12345-192.168.202.16@tcp:4:dd.0 Request processed in 48175us (49021us total) trans 4294968584 rc 0/0 00000100:00100000:0.0:1746144909.064400:0:25029:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4351 00000001:00080000:2.0:1746144909.095836:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968585 is committed 00002000:00010000:1.0:1746144909.095915:0:31844:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 47115 -> 49163 00010000:00010000:1.0:1746144909.095926:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [24027136->25067519] (req 24027136->25067519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.095935:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [24027136->25067519] (req 24027136->25067519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.095942:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [24027136->25067519] (req 24027136->25067519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.095947:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092553000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144909.095950:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [24027136->25067519] (req 24027136->25067519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.095956:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515fc3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [24027136->25067519] (req 24027136->25067519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.095968:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515fc3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [24027136->25067519] (req 24027136->25067519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.095972:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092553000/0x4076af6727515fc3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [24027136->25067519] (req 24027136->25067519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144909.096200:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1982:x1830965175409024:12345-192.168.202.16@tcp:4:dd.0 Request processed in 79933us (80772us total) trans 4294968585 rc 0/0 00000100:00100000:1.0:1746144909.096208:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4352 00000100:00100000:2.0:1746144909.101165:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.101210:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.101233:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175409536 00000100:00100000:1.0:1746144909.101242:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175409536 00000100:00100000:0.0:1746144909.101275:0:25029:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175409664 00000100:00100000:0.0:1746144909.101280:0:25029:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175409664 00000100:00100000:1.0:1746144909.101290:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4353 00000100:00100000:1.0:1746144909.101298:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175409536:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144909.101317:0:25029:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4354 00000100:00100000:0.0:1746144909.101323:0:25029:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1985:x1830965175409664:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:1.0:1746144909.101327:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093d00200/0x4076af6727515fca lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.101339:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144909.101340:0:25029:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515fd1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.101341:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144909.101345:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880093d00200/0x4076af6727515fca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.101348:0:25029:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144909.101349:0:25029:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144909.101352:0:25029:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515fd1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.101356:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880093d00200/0x4076af6727515fca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.101360:0:25029:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515fd1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.108511:0:25029:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515fd1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.108516:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880093d00200/0x4076af6727515fca lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.108526:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880093d00200/0x4076af6727515fca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.108526:0:25029:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515fd1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.108533:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880093d00200/0x4076af6727515fca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.108533:0:25029:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515fd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.108538:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093d00200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144909.108541:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880093d00200/0x4076af6727515fca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.108542:0:25029:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad30800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144909.108544:0:25029:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515fd1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.108548:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880093d00200/0x4076af6727515fca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.108549:0:25029:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515fd1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.108564:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880093d00200/0x4076af6727515fca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.108564:0:25029:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515fd1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.108569:0:25029:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad30800/0x4076af6727515fd1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12484608->12582911] (req 12484608->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.108570:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880093d00200/0x4076af6727515fca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144909.108642:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175409536:12345-192.168.202.16@tcp:3:dd.0 Request processed in 7340us (7480us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.108642:0:25029:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1985:x1830965175409664:12345-192.168.202.16@tcp:3:dd.0 Request processed in 7314us (7427us total) trans 0 rc 98304/98304 00000100:00100000:0.0:1746144909.108650:0:25029:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4354 00000100:00100000:1.0:1746144909.108654:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4353 00000100:00100000:0.0:1746144909.110650:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.110728:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175409792 00000100:00100000:2.0:1746144909.110735:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175409792 00000100:00100000:2.0:1746144909.110793:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5881 00000100:00100000:2.0:1746144909.110810:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1115:x1830965175409792:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1746144909.110824:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144909.110838:0:8433:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727515fd8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9559d expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746144909.110857:0:8433:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 25067520, mtime: 0x68140e8d, atime: 0x0, ctime: 0x68140e8d, blocks: 0xc00b 00010000:00010000:2.0:1746144909.110873:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144909.110874:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144909.110879:0:8433:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727515fd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9559d expref: 7 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144909.110895:0:8433:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727515fd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9559d expref: 7 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144909.110903:0:8433:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b467c00, rc 0) 00000100:00100000:2.0:1746144909.110929:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1115:x1830965175409792:12345-192.168.202.16@tcp:101:dd.0 Request processed in 130us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144909.110933:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5881 00000100:00100000:2.0:1746144909.123418:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.123472:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.123564:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175410048 00000100:00100000:1.0:1746144909.123572:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175410048 00000100:00100000:0.0:1746144909.123576:0:25029:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175410176 00000100:00100000:0.0:1746144909.123579:0:25029:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175410176 00002000:00100000:1.0:1746144909.123606:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1c:0x0] (25067520->25165823) req@ffff8800a417f800 x1830965175410048/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.123606:0:25029:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1c:0x0] (25165824->26214399) req@ffff8800a417fb80 x1830965175410176/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.123615:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417f800 with x1830965175410048 ext(25067520->25165823) 00002000:00100000:0.0:1746144909.123615:0:25029:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417fb80 with x1830965175410176 ext(25165824->26214399) 00002000:00010000:1.0:1746144909.123619:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a417f800 00002000:00010000:0.0:1746144909.123619:0:25029:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a417fb80 00000100:00100000:1.0:1746144909.123647:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4355 00000100:00100000:1.0:1746144909.123653:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175410048:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144909.123653:0:25029:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4356 00000100:00100000:0.0:1746144909.123657:0:25029:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175410176:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144909.128707:0:25029:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1985:x1830965175410176:12345-192.168.202.16@tcp:4:dd.0 Request processed in 5042us (5228us total) trans 4294968586 rc 0/0 00000100:00100000:0.0:1746144909.128716:0:25029:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4356 00002000:00100000:0.0:1746144909.128726:0:25029:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1c:0x0] (25165824->26214399) req@ffff8800a417fb80 x1830965175410176/t4294968586(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/448 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.128734:0:25029:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417fb80 with x1830965175410176 ext(25165824->26214399) 00002000:00010000:0.0:1746144909.128739:0:25029:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a417fb80 00000100:00100000:1.0:1746144909.129677:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1985:x1830965175410048:12345-192.168.202.16@tcp:4:dd.0 Request processed in 6020us (6263us total) trans 4294968587 rc 0/0 00000100:00100000:1.0:1746144909.129684:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4355 00002000:00100000:1.0:1746144909.129690:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1c:0x0] (25067520->25165823) req@ffff8800a417f800 x1830965175410048/t4294968587(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/448 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.129696:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a417f800 with x1830965175410048 ext(25067520->25165823) 00002000:00010000:1.0:1746144909.129699:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a417f800 00000100:00100000:2.0:1746144909.130866:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.130938:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175410304 00000100:00100000:1.0:1746144909.130944:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175410304 00000100:00080000:2.0:1746144909.131042:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746144909.131079:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48262 00000100:00100000:1.0:1746144909.131086:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+15:1115:x1830965175410304:12345-192.168.202.16@tcp:44:dd.0 00000100:00100000:1.0:1746144909.131276:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+15:1115:x1830965175410304:12345-192.168.202.16@tcp:44:dd.0 Request processed in 190us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144909.131282:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48262 00000100:00100000:2.0:1746144909.132970:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.133166:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175410432 00000100:00100000:3.0:1746144909.133172:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175410432 00000100:00100000:3.0:1746144909.133208:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5882 00000100:00100000:3.0:1746144909.133214:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1984:x1830965175410432:12345-192.168.202.16@tcp:16:dd.0 00000100:00100000:3.0:1746144909.157836:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a417ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1984:x1830965175410432:12345-192.168.202.16@tcp:16:dd.0 Request processed in 24614us (24861us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144909.157847:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5882 00000001:00080000:3.0:1746144909.157874:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968586 is committed 00000001:00080000:3.0:1746144909.157885:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968587 is committed 00000100:00100000:2.0:1746144909.160225:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.160244:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175410688 00000100:00100000:3.0:1746144909.160251:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175410688 00000100:00100000:3.0:1746144909.160291:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 165 00000100:00100000:3.0:1746144909.160297:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+15:1115:x1830965175410688:12345-192.168.202.16@tcp:35:dd.0 00000100:00100000:3.0:1746144909.160476:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1115:x1830965175410688:12345-192.168.202.16@tcp:35:dd.0 Request processed in 178us (259us total) trans 4294987523 rc 0/0 00000100:00100000:3.0:1746144909.160482:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 165 00000100:00100000:2.0:1746144909.163070:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.163148:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175410944 00000100:00100000:3.0:1746144909.163155:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175410944 00000100:00100000:3.0:1746144909.163185:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 166 00000100:00100000:3.0:1746144909.163191:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a621c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+16:1115:x1830965175410944:12345-192.168.202.16@tcp:35:dd.0 00000001:00080000:3.0:1746144909.163413:0:19321:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294987524 00000100:00100000:3.0:1746144909.163551:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a621c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1115:x1830965175410944:12345-192.168.202.16@tcp:35:dd.0 Request processed in 359us (485us total) trans 4294987525 rc 0/0 00000100:00100000:3.0:1746144909.163557:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 166 00000020:00080000:3.0:1746144909.163561:0:19321:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1746144909.179137:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.179456:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175411072 00000100:00100000:1.0:1746144909.179468:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175411072 00000100:00100000:1.0:1746144909.179531:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48263 00000100:00100000:1.0:1746144909.179538:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+18:1118:x1830965175411072:12345-192.168.202.16@tcp:101:checkstat.0 00010000:00010000:1.0:1746144909.179560:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144909.179577:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af6727515fdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af955a4 expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.179622:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094199a00/0x4076af6727515fe6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.179632:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094199a00/0x4076af6727515fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.179642:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094199a00/0x4076af6727515fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:1.0:1746144909.179866:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:1.0:1746144909.179869:0:7111:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144909.179884:0:7111:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094199a00/0x4076af6727515fe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.179902:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af6727515fdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955a4 expref: 20 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.179925:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094199a00/0x4076af6727515fe6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955a4 expref: 19 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.179941:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbcac00) 00010000:00010000:1.0:1746144909.179943:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746144909.179945:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094199a00, rc 0) 00000100:00100000:1.0:1746144909.180036:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1118:x1830965175411072:12345-192.168.202.16@tcp:101:checkstat.0 Request processed in 497us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144909.180049:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48263 00000100:00100000:2.0:1746144909.182107:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.182275:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175411200 00000100:00100000:1.0:1746144909.182284:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175411200 00000100:00100000:1.0:1746144909.182375:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48264 00000100:00100000:1.0:1746144909.182382:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+19:1118:x1830965175411200:12345-192.168.202.16@tcp:101:checkstat.0 00010000:00010000:1.0:1746144909.182396:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144909.182408:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093d00200/0x4076af6727515fed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af955ab expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.182451:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50e00/0x4076af6727515ff4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.182460:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50e00/0x4076af6727515ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.182468:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50e00/0x4076af6727515ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.182478:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50a00/0x4076af6727515ffb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.182487:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50a00/0x4076af6727515ffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.182491:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50a00/0x4076af6727515ffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183534:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf22800/0x4076af6727516002 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183543:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf22800/0x4076af6727516002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183549:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf22800/0x4076af6727516002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:1.0:1746144909.183573:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 26214400 00000004:00200000:1.0:1746144909.183577:0:7111:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144909.183587:0:7111:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf22800/0x4076af6727516002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183594:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf22800/0x4076af6727516002 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183600:0:7111:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50e00/0x4076af6727515ff4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183604:0:7111:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50e00/0x4076af6727515ff4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183610:0:7111:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50e00/0x4076af6727515ff4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183614:0:7111:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea50e00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144909.183616:0:7111:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50e00/0x4076af6727515ff4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183621:0:7111:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50e00/0x4076af6727515ff4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183629:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbcac00) 00010000:00010000:1.0:1746144909.183632:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144909.183635:0:7111:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50e00/0x4076af6727515ff4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183639:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50e00/0x4076af6727515ff4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183651:0:7111:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50a00/0x4076af6727515ffb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183656:0:7111:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50a00/0x4076af6727515ffb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183660:0:7111:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50a00/0x4076af6727515ffb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183664:0:7111:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ea50a00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144909.183666:0:7111:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50a00/0x4076af6727515ffb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183669:0:7111:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50a00/0x4076af6727515ffb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183674:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff88009bbcae00) 00010000:00010000:1.0:1746144909.183675:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144909.183677:0:7111:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50a00/0x4076af6727515ffb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183681:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ea50a00/0x4076af6727515ffb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.183702:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093d00200/0x4076af6727515fed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ab expref: 21 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.183710:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf22800/0x4076af6727516002 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ab expref: 20 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.183715:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff88009a8b7c00) 00010000:00010000:1.0:1746144909.183716:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144909.183718:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf22800, rc 0) 00000100:00100000:1.0:1746144909.183788:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092586d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1118:x1830965175411200:12345-192.168.202.16@tcp:101:checkstat.0 Request processed in 1406us (1689us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144909.183794:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48264 00000100:00100000:2.0:1746144909.186909:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.187245:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.187326:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175411456 00000100:00100000:3.0:1746144909.187336:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175411456 00000100:00100000:3.0:1746144909.187371:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175411328 00000100:00100000:3.0:1746144909.187373:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175411328 00000100:00100000:3.0:1746144909.187404:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5883 00000100:00100000:3.0:1746144909.187411:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175411456:12345-192.168.202.16@tcp:101:checkstat.0 00000100:00100000:2.0:1746144909.187415:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5884 00010000:00010000:3.0:1746144909.187425:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746144909.187426:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175411328:12345-192.168.202.16@tcp:101:checkstat.0 00010000:00010000:3.0:1746144909.187441:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009930a400/0x4076af6727516009 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af955b9 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144909.187441:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144909.187457:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b467200/0x4076af6727516010 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af955b2 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144909.187483:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172542848:192.168.202.16@tcp:106: 00000100:00100000:2.0:1746144909.187498:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092586300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172542976:192.168.202.16@tcp:106: 00000100:00100000:3.0:1746144909.187561:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008bae7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144909.187603:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4380000 going to sleep for 11 seconds 00002000:00010000:3.0:1746144909.189895:0:10401:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb size: 0 -> 12582912 00002000:00010000:3.0:1746144909.189900:0:10401:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb mtime: 0 -> 1746144908 00002000:00010000:3.0:1746144909.189902:0:10401:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb atime: 0 -> 1746144908 00002000:00010000:3.0:1746144909.189904:0:10401:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb ctime: 0 -> 1746144908 00002000:00010000:3.0:1746144909.189905:0:10401:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x240000400:0x1b:0x0] updating lvb blocks: 1 -> 6151 00002000:00010000:2.0:1746144909.189911:0:8430:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb size: 0 -> 13631488 00002000:00010000:2.0:1746144909.189914:0:8430:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb mtime: 0 -> 1746144908 00002000:00010000:2.0:1746144909.189916:0:8430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb atime: 0 -> 1746144908 00002000:00010000:2.0:1746144909.189917:0:8430:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb ctime: 0 -> 1746144908 00002000:00010000:2.0:1746144909.189919:0:8430:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb blocks: 1 -> 18439 00002000:00010000:2.0:1746144909.189928:0:8430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1b:0x0] updating lvb blocks from disk: 18439 -> 26633 00000100:00100000:3.0:1746144909.189930:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172542848:192.168.202.16@tcp:106: 00000100:00100000:2.0:1746144909.189933:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092586300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172542976:192.168.202.16@tcp:106: 00010000:00010000:3.0:1746144909.189954:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009930a400/0x4076af6727516009 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955b9 expref: 7 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144909.189954:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b467200/0x4076af6727516010 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955b2 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144909.189965:0:8430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b467200/0x4076af6727516010 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955b2 expref: 8 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144909.189968:0:10401:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009930a400/0x4076af6727516009 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955b9 expref: 7 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144909.190076:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b467200, rc 0) 00000100:00100000:2.0:1746144909.190113:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092584a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175411328:12345-192.168.202.16@tcp:101:checkstat.0 Request processed in 2690us (2867us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144909.190119:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5884 00010000:00010000:3.0:1746144909.190251:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009930a400, rc 0) 00000100:00100000:3.0:1746144909.190272:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175411456:12345-192.168.202.16@tcp:101:checkstat.0 Request processed in 2861us (3373us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144909.190278:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5883 00000100:00100000:2.0:1746144909.197714:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.197895:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175411584 00000100:00100000:1.0:1746144909.197903:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175411584 00000100:00100000:1.0:1746144909.198004:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48265 00000100:00100000:1.0:1746144909.198013:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1119:x1830965175411584:12345-192.168.202.16@tcp:101:checkstat.0 00010000:00010000:1.0:1746144909.198032:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144909.198046:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23600/0x4076af6727516017 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af955c0 expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.198092:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af672751601e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.198102:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af672751601e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.198111:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af672751601e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:1.0:1746144909.198164:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:1.0:1746144909.198167:0:7111:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144909.198181:0:7111:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af672751601e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.198199:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23600/0x4076af6727516017 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955c0 expref: 16 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.198230:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af672751601e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955c0 expref: 15 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.198237:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbcac00) 00010000:00010000:1.0:1746144909.198240:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746144909.198242:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a6b400, rc 0) 00000100:00100000:1.0:1746144909.198290:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092586300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+15:1119:x1830965175411584:12345-192.168.202.16@tcp:101:checkstat.0 Request processed in 279us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144909.198296:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48265 00000100:00100000:2.0:1746144909.218316:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.218378:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175411840 00000100:00100000:3.0:1746144909.218386:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175411840 00000100:00100000:3.0:1746144909.218438:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48266 00000100:00100000:3.0:1746144909.218446:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+20:1120:x1830965175411840:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:3.0:1746144909.218462:0:21076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144909.218477:0:21076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0caa00/0x4076af6727516025 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af955c7 expref: -99 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144909.218549:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918d6600/0x4076af672751602c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144909.218559:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800918d6600/0x4076af672751602c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144909.218567:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800918d6600/0x4076af672751602c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000004:00200000:3.0:1746144909.218576:0:21076:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 26214400 00010000:00010000:3.0:1746144909.218735:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0caa00/0x4076af6727516025 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955c7 expref: 23 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144909.218787:0:21076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800918d6600/0x4076af672751602c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955c7 expref: 22 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144909.218793:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca000) 00010000:00010000:3.0:1746144909.218805:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1746144909.218809:0:21076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800918d6600, rc 0) 00000100:00100000:3.0:1746144909.218858:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092585880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1120:x1830965175411840:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 413us (549us total) trans 4294987526 rc 0/0 00000100:00100000:3.0:1746144909.218863:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48266 00000100:00100000:2.0:1746144909.223728:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.224426:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175412096 00000100:00100000:3.0:1746144909.224434:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175412096 00000100:00100000:3.0:1746144909.225582:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48267 00000100:00100000:3.0:1746144909.225591:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1120:x1830965175412096:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:3.0:1746144909.225615:0:21076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144909.225631:0:21076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0cb200/0x4076af672751603a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af955ce expref: -99 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144909.225708:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929dea00/0x4076af6727516041 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144909.225720:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929dea00/0x4076af6727516041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144909.225729:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929dea00/0x4076af6727516041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000004:00200000:3.0:1746144909.225738:0:21076:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 26214400 00010000:00010000:3.0:1746144909.225869:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0cb200/0x4076af672751603a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ce expref: 25 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144909.225895:0:21076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929dea00/0x4076af6727516041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ce expref: 24 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144909.225902:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff88009a8b7c00) 00010000:00010000:3.0:1746144909.225904:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144909.225907:0:21076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929dea00, rc 0) 00000100:00100000:3.0:1746144909.225959:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092587100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1120:x1830965175412096:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 369us (2238us total) trans 4294987527 rc 0/0 00000100:00100000:3.0:1746144909.225964:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48267 00000100:00100000:2.0:1746144909.229526:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.229729:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175412224 00000100:00100000:0.0:1746144909.229736:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175412224 00000100:00100000:3.0:1746144909.230039:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 292 00000100:00100000:3.0:1746144909.230049:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1984:x1830965175412224:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144909.230061:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144909.230081:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929dea00/0x4076af6727516041 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ce expref: 24 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144909.230095:0:7098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff88009a8b7c00) 00010000:00010000:3.0:1746144909.230099:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144909.230134:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1984:x1830965175412224:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 88us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144909.230140:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 292 00000100:00100000:2.0:1746144909.230374:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.230409:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.230417:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175412480 00000100:00100000:3.0:1746144909.230421:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175412480 00000100:00100000:3.0:1746144909.230451:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175412352 00000100:00100000:3.0:1746144909.230453:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175412352 00000100:00100000:2.0:1746144909.230466:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5885 00000100:00100000:3.0:1746144909.230479:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5886 00000100:00100000:3.0:1746144909.230484:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175412352:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:3.0:1746144909.230496:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144909.230506:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af672751604f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af955d5 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144909.230517:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1985:x1830965175412480:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:2.0:1746144909.230526:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144909.230534:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092feac00/0x4076af6727516056 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af955dc expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144909.230542:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093e81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172543104:192.168.202.16@tcp:106: 00000100:00100000:2.0:1746144909.230570:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172543232:192.168.202.16@tcp:106: 00000100:00100000:3.0:1746144909.230610:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008bae7540 going to sleep for 11 seconds 00000100:00100000:2.0:1746144909.230615:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4380000 going to sleep for 11 seconds 00000100:00100000:3.0:1746144909.232595:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093e81180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172543104:192.168.202.16@tcp:106: 00010000:00010000:3.0:1746144909.232618:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af672751604f lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955d5 expref: 8 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144909.232629:0:10401:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a5c200/0x4076af672751604f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955d5 expref: 8 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144909.232637:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:2.0:1746144909.232735:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172543232:192.168.202.16@tcp:106: 00010000:00010000:2.0:1746144909.232749:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092feac00/0x4076af6727516056 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955dc expref: 7 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144909.232756:0:8430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092feac00/0x4076af6727516056 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955dc expref: 7 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144909.232806:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092feac00, rc 0) 00000100:00100000:3.0:1746144909.233060:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175412352:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 2574us (2648us total) trans 0 rc 301/301 00000100:00100000:3.0:1746144909.233067:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5886 00000100:00100000:2.0:1746144909.233221:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1985:x1830965175412480:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 2748us (3039us total) trans 0 rc 301/301 00000100:00100000:2.0:1746144909.233226:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5885 00000100:00100000:0.0:1746144909.245395:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.247897:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.247930:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.247973:0:25029:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175412864 00000100:00100000:0.0:1746144909.247974:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.247981:0:25029:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175412864 00000100:00100000:0.0:1746144909.248003:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175412992 00000100:00100000:0.0:1746144909.248006:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175412992 00002000:00100000:2.0:1746144909.248020:0:25029:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1a:0x0] (0->1048575) req@ffff88009ac86300 x1830965175412864/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.248021:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (1048576->2097151) req@ffff8801391d3800 x1830965175412992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.248029:0:25029:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac86300 with x1830965175412864 ext(0->1048575) 00002000:00100000:0.0:1746144909.248029:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d3800 with x1830965175412992 ext(1048576->2097151) 00002000:00010000:2.0:1746144909.248033:0:25029:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac86300 00002000:00010000:0.0:1746144909.248033:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801391d3800 00000100:00100000:0.0:1746144909.248053:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175413376 00000100:00100000:0.0:1746144909.248056:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175413376 00002000:00100000:0.0:1746144909.248069:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (1048576->2097151) req@ffff8801391d3b80 x1830965175413376/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.248080:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d3b80 with x1830965175413376 ext(1048576->2097151) 00002000:00010000:0.0:1746144909.248083:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801391d3b80 00000100:00100000:2.0:1746144909.248335:0:25029:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175413248 00000100:00100000:2.0:1746144909.248338:0:25029:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175413248 00002000:00100000:2.0:1746144909.248349:0:25029:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1a:0x0] (0->1048575) req@ffff8801391d1880 x1830965175413248/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.248356:0:25029:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d1880 with x1830965175413248 ext(0->1048575) 00002000:00010000:2.0:1746144909.248359:0:25029:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801391d1880 00000100:00100000:0.0:1746144909.248460:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4357 00000100:00100000:0.0:1746144909.248467:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175412992:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.249146:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4358 00000100:00100000:0.0:1746144909.249153:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175412864:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.249703:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4359 00000100:00100000:0.0:1746144909.249710:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175413376:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.250123:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4360 00000100:00100000:3.0:1746144909.250130:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175413248:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.270626:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175412992:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 22147us (22723us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.270636:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4357 00002000:00100000:0.0:1746144909.270648:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (1048576->2097151) req@ffff8801391d3800 x1830965175412992/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.270657:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d3800 with x1830965175412992 ext(1048576->2097151) 00002000:00010000:0.0:1746144909.270662:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8801391d3800 00000100:00100000:1.0:1746144909.273228:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1984:x1830965175412864:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 24068us (27834us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144909.273238:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4358 00002000:00100000:1.0:1746144909.273246:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1a:0x0] (0->1048575) req@ffff88009ac86300 x1830965175412864/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.273256:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac86300 with x1830965175412864 ext(0->1048575) 00002000:00010000:1.0:1746144909.273261:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac86300 00000100:00100000:0.0:1746144909.275910:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175413376:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 26193us (27971us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.275919:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4359 00002000:00100000:0.0:1746144909.275927:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (1048576->2097151) req@ffff8801391d3b80 x1830965175413376/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.275935:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d3b80 with x1830965175413376 ext(1048576->2097151) 00002000:00010000:0.0:1746144909.275939:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801391d3b80 00000100:00100000:3.0:1746144909.276879:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175413248:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 26748us (28902us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144909.276886:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4360 00002000:00100000:3.0:1746144909.276891:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1a:0x0] (0->1048575) req@ffff8801391d1880 x1830965175413248/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.276904:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d1880 with x1830965175413248 ext(0->1048575) 00002000:00010000:3.0:1746144909.276908:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801391d1880 00000100:00100000:3.0:1746144909.293995:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.295372:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175413632 00000100:00100000:2.0:1746144909.295381:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175413632 00000100:00100000:2.0:1746144909.295749:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5887 00000100:00100000:2.0:1746144909.295757:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1120:x1830965175413632:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:2.0:1746144909.295781:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144909.295817:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d327c00/0x4076af672751605d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af955e3 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144909.295841:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727515e65 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95581 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144909.295847:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144909.295849:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746144909.295852:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d327c00/0x4076af672751605d lrc: 4/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955e3 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144909.295872:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727515e65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95581 expref: 7 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144909.295881:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727515e65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95581 expref: 7 pid: 10401 timeout: 603 lvb_type: 0 00000100:00100000:2.0:1746144909.295891:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009398d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172543360:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144909.295966:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4380000 going to sleep for 11 seconds 00000100:00100000:0.0:1746144909.301291:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009398d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172543360:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144909.301318:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012d327c00/0x4076af672751605d lrc: 3/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955e3 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.301333:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012d327c00, rc 0) 00000100:00100000:0.0:1746144909.301756:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093e81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1120:x1830965175413632:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 5998us (7766us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144909.301789:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5887 00000100:00100000:0.0:1746144909.317686:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.318372:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175413760 00000100:00100000:3.0:1746144909.318380:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175413760 00010000:00010000:3.0:1746144909.318429:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727515e65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95581 expref: 8 pid: 10401 timeout: 603 lvb_type: 0 00000100:00080000:2.0:1746144909.318438:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746144909.318467:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11287 00000100:00100000:3.0:1746144909.318474:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1985:x1830965175413760:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144909.318485:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144909.318504:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727515e65 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95581 expref: 8 pid: 10401 timeout: 603 lvb_type: 0 00010000:00010000:3.0:1746144909.318515:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727515e65 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95581 expref: 8 pid: 10401 timeout: 603 lvb_type: 0 00010000:00010000:3.0:1746144909.318531:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727515e65 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95581 expref: 8 pid: 10401 timeout: 603 lvb_type: 0 00010000:00010000:3.0:1746144909.318554:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144909.318556:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144909.318562:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d327c00/0x4076af672751605d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955e3 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144909.318570:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d327c00/0x4076af672751605d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955e3 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144909.318719:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012d327c00/0x4076af672751605d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955e3 expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144909.318731:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bae1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172543488:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144909.318956:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008bae7540 going to sleep for 11 seconds 00000100:00100000:0.0:1746144909.324431:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bae1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7098:1830965172543488:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144909.324453:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144909.324502:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1985:x1830965175413760:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 6028us (6823us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144909.324512:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11287 00000100:00100000:3.0:1746144909.324575:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.324793:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175414016 00000100:00100000:2.0:1746144909.324808:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175414016 00002000:00100000:2.0:1746144909.324836:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1b:0x0] (0->1048575) req@ffff88009bae3b80 x1830965175414016/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.324842:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae3b80 with x1830965175414016 ext(0->1048575) 00002000:00010000:2.0:1746144909.324845:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bae3b80 00000100:00100000:2.0:1746144909.324866:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4361 00000100:00100000:2.0:1746144909.324872:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175414016:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144909.331649:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175414016:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 6769us (7066us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144909.331659:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4361 00002000:00100000:2.0:1746144909.331669:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1b:0x0] (0->1048575) req@ffff88009bae3b80 x1830965175414016/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.331677:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae3b80 with x1830965175414016 ext(0->1048575) 00002000:00010000:2.0:1746144909.331682:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bae3b80 00000100:00100000:1.0:1746144909.336969:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.337061:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175414144 00000100:00100000:0.0:1746144909.337070:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175414144 00000100:00100000:0.0:1746144909.337657:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5888 00000100:00100000:0.0:1746144909.337665:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+6:1120:x1830965175414144:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:0.0:1746144909.337680:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144909.337693:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727516064 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af955ea expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.337718:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e33d600/0x4076af6727515e6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95588 expref: 25 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.337726:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144909.337727:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144909.337730:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727516064 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ea expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.337815:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012e33d600/0x4076af6727515e6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95588 expref: 25 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.337827:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012e33d600/0x4076af6727515e6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95588 expref: 25 pid: 8432 timeout: 603 lvb_type: 0 00000100:00100000:0.0:1746144909.337837:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801391d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172543616:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144909.338971:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144909.340716:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801391d0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172543616:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144909.340741:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727516064 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ea expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.340754:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bb68e00, rc 0) 00000100:00100000:0.0:1746144909.340821:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1120:x1830965175414144:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 3156us (3860us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144909.340828:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5888 00000100:00100000:2.0:1746144909.349011:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.349117:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175414272 00000100:00100000:0.0:1746144909.349125:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175414272 00010000:00010000:0.0:1746144909.349166:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012e33d600/0x4076af6727515e6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95588 expref: 26 pid: 8432 timeout: 603 lvb_type: 0 00000100:00100000:0.0:1746144909.349193:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11288 00000100:00100000:0.0:1746144909.349200:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1984:x1830965175414272:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144909.349210:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144909.349229:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012e33d600/0x4076af6727515e6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95588 expref: 26 pid: 8432 timeout: 603 lvb_type: 0 00010000:00010000:0.0:1746144909.349240:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012e33d600/0x4076af6727515e6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95588 expref: 26 pid: 8432 timeout: 603 lvb_type: 0 00000100:00080000:2.0:1746144909.349278:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1746144909.349353:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e33d600/0x4076af6727515e6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1040383) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95588 expref: 26 pid: 8432 timeout: 603 lvb_type: 0 00010000:00010000:0.0:1746144909.349377:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144909.349379:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144909.349384:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727516064 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ea expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.349391:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727516064 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ea expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.349415:0:7098:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727516064 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ea expref: 6 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144909.349424:0:7098:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8801391d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172543744:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144909.349547:0:7098:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144909.351583:0:7098:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8801391d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7098:1830965172543744:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144909.351602:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144909.352120:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+25:1984:x1830965175414272:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2919us (3116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144909.352128:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11288 00000100:00100000:2.0:1746144909.357021:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.357056:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.357090:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.357152:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175414656 00000100:00100000:0.0:1746144909.357160:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175414656 00002000:00100000:0.0:1746144909.357197:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (0->1048575) req@ffff88009398d500 x1830965175414656/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.357207:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398d500 with x1830965175414656 ext(0->1048575) 00002000:00010000:0.0:1746144909.357211:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398d500 00000100:00100000:0.0:1746144909.357224:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175414784 00000100:00100000:0.0:1746144909.357226:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175414784 00002000:00100000:0.0:1746144909.357235:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (1048576->2097151) req@ffff8800918efb80 x1830965175414784/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.357241:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918efb80 with x1830965175414784 ext(1048576->2097151) 00002000:00010000:0.0:1746144909.357243:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918efb80 00000100:00100000:0.0:1746144909.357250:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175415040 00000100:00100000:0.0:1746144909.357252:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175415040 00002000:00100000:0.0:1746144909.357260:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1b:0x0] (1048576->2097151) req@ffff8800918eed80 x1830965175415040/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.357266:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eed80 with x1830965175415040 ext(1048576->2097151) 00002000:00010000:0.0:1746144909.357268:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918eed80 00000100:00100000:0.0:1746144909.357291:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4362 00000100:00100000:0.0:1746144909.357298:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175414656:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144909.358553:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4363 00000100:00100000:2.0:1746144909.358564:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175414784:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.358684:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4364 00000100:00100000:0.0:1746144909.358692:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175415040:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.373931:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175414656:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 16626us (16910us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.373941:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4362 00002000:00100000:0.0:1746144909.373952:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (0->1048575) req@ffff88009398d500 x1830965175414656/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.373962:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398d500 with x1830965175414656 ext(0->1048575) 00002000:00010000:0.0:1746144909.373967:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398d500 00000100:00100000:0.0:1746144909.377595:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175414784:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 19026us (20529us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.377606:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4363 00002000:00100000:0.0:1746144909.377615:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (1048576->2097151) req@ffff8800918efb80 x1830965175414784/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.377624:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918efb80 with x1830965175414784 ext(1048576->2097151) 00002000:00010000:0.0:1746144909.377628:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918efb80 00000100:00100000:1.0:1746144909.377739:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175415040:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 19048us (20647us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144909.377745:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4364 00002000:00100000:1.0:1746144909.377749:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1b:0x0] (1048576->2097151) req@ffff8800918eed80 x1830965175415040/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.377755:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918eed80 with x1830965175415040 ext(1048576->2097151) 00002000:00010000:1.0:1746144909.377758:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918eed80 00000100:00100000:1.0:1746144909.394348:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.394387:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.394399:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.394424:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.394644:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175415552 00000100:00100000:2.0:1746144909.394645:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175415424 00000100:00100000:2.0:1746144909.394652:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175415424 00000100:00100000:0.0:1746144909.394652:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175415552 00002000:00100000:2.0:1746144909.394683:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1a:0x0] (2097152->3145727) req@ffff88009167e300 x1830965175415424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.394683:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (3145728->4194303) req@ffff8800a4f0a680 x1830965175415552/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.394691:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167e300 with x1830965175415424 ext(2097152->3145727) 00002000:00100000:0.0:1746144909.394692:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f0a680 with x1830965175415552 ext(3145728->4194303) 00002000:00010000:2.0:1746144909.394695:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009167e300 00002000:00010000:0.0:1746144909.394695:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4f0a680 00000100:00100000:1.0:1746144909.394728:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175415808 00000100:00100000:1.0:1746144909.394731:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175415808 00002000:00100000:1.0:1746144909.394746:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (2097152->3145727) req@ffff88009167c380 x1830965175415808/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00000100:00100000:0.0:1746144909.394746:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175415936 00000100:00100000:0.0:1746144909.394748:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175415936 00002000:00100000:1.0:1746144909.394752:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167c380 with x1830965175415808 ext(2097152->3145727) 00002000:00010000:1.0:1746144909.394755:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167c380 00002000:00100000:0.0:1746144909.394758:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (3145728->4194303) req@ffff88009167df80 x1830965175415936/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.394782:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167df80 with x1830965175415936 ext(3145728->4194303) 00000100:00100000:1.0:1746144909.394785:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4365 00002000:00010000:0.0:1746144909.394785:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167df80 00000100:00100000:1.0:1746144909.394792:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175415424:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.394806:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4366 00000100:00100000:0.0:1746144909.394811:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175415552:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144909.394854:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4367 00000100:00100000:1.0:1746144909.394859:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175415808:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.395155:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4368 00000100:00100000:3.0:1746144909.395163:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175415936:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.409228:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175415808:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 14360us (14819us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.409238:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4367 00002000:00100000:0.0:1746144909.409247:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1a:0x0] (2097152->3145727) req@ffff88009167c380 x1830965175415808/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.409256:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167c380 with x1830965175415808 ext(2097152->3145727) 00002000:00010000:0.0:1746144909.409262:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167c380 00000100:00100000:0.0:1746144909.415757:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175415552:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 20933us (21403us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.415781:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4366 00002000:00100000:0.0:1746144909.415792:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (3145728->4194303) req@ffff8800a4f0a680 x1830965175415552/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.415811:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f0a680 with x1830965175415552 ext(3145728->4194303) 00002000:00010000:0.0:1746144909.416607:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4f0a680 00000100:00100000:0.0:1746144909.420368:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175415936:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 25197us (25935us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.420377:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4368 00002000:00100000:0.0:1746144909.420386:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1a:0x0] (3145728->4194303) req@ffff88009167df80 x1830965175415936/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.420394:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167df80 with x1830965175415936 ext(3145728->4194303) 00002000:00010000:0.0:1746144909.420400:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167df80 00000100:00100000:2.0:1746144909.423288:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175415424:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 28490us (28893us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144909.423298:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4365 00002000:00100000:2.0:1746144909.423306:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (2097152->3145727) req@ffff88009167e300 x1830965175415424/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.423314:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167e300 with x1830965175415424 ext(2097152->3145727) 00002000:00010000:2.0:1746144909.423319:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009167e300 00000100:00100000:2.0:1746144909.434616:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.434918:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.434949:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.434974:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.435470:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175416448 00000100:00100000:1.0:1746144909.435479:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175416448 00002000:00100000:1.0:1746144909.435515:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1b:0x0] (2097152->3145727) req@ffff8800918ec380 x1830965175416448/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.435528:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec380 with x1830965175416448 ext(2097152->3145727) 00002000:00010000:1.0:1746144909.435532:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918ec380 00000100:00100000:1.0:1746144909.435890:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175416576 00000100:00100000:1.0:1746144909.435894:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175416576 00002000:00100000:1.0:1746144909.435907:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1b:0x0] (3145728->4194303) req@ffff8800918ed500 x1830965175416576/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.435913:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ed500 with x1830965175416576 ext(3145728->4194303) 00002000:00010000:1.0:1746144909.435916:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918ed500 00000100:00100000:0.0:1746144909.436024:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175416960 00000100:00100000:0.0:1746144909.436027:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175416960 00002000:00100000:0.0:1746144909.436043:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1b:0x0] (3145728->4194303) req@ffff8800918ec000 x1830965175416960/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.436049:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec000 with x1830965175416960 ext(3145728->4194303) 00002000:00010000:0.0:1746144909.436052:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ec000 00000100:00100000:0.0:1746144909.436063:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175416832 00000100:00100000:0.0:1746144909.436065:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175416832 00002000:00100000:0.0:1746144909.436072:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (2097152->3145727) req@ffff8800918ec700 x1830965175416832/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.436078:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec700 with x1830965175416832 ext(2097152->3145727) 00002000:00010000:0.0:1746144909.436080:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ec700 00000100:00100000:0.0:1746144909.436096:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4369 00000100:00100000:0.0:1746144909.436103:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175416448:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.436112:0:25029:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4370 00000100:00100000:3.0:1746144909.436118:0:25029:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175416576:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.436159:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4371 00000100:00100000:3.0:1746144909.436164:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175416960:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144909.436192:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4372 00000100:00100000:1.0:1746144909.436196:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175416832:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.458141:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175416960:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 21967us (23181us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.458150:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4371 00002000:00100000:0.0:1746144909.458160:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1b:0x0] (3145728->4194303) req@ffff8800918ec000 x1830965175416960/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.458168:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec000 with x1830965175416960 ext(3145728->4194303) 00002000:00010000:0.0:1746144909.458173:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ec000 00000100:00100000:1.0:1746144909.458363:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1982:x1830965175416448:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 22259us (23752us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144909.458370:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4369 00002000:00100000:1.0:1746144909.458375:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1b:0x0] (2097152->3145727) req@ffff8800918ec380 x1830965175416448/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.458382:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec380 with x1830965175416448 ext(2097152->3145727) 00002000:00010000:1.0:1746144909.458385:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918ec380 00000100:00100000:0.0:1746144909.462188:0:25029:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175416576:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 26061us (27261us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.462198:0:25029:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4370 00002000:00100000:0.0:1746144909.462207:0:25029:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1b:0x0] (3145728->4194303) req@ffff8800918ed500 x1830965175416576/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.462221:0:25029:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ed500 with x1830965175416576 ext(3145728->4194303) 00002000:00010000:0.0:1746144909.462226:0:25029:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918ed500 00000100:00100000:1.0:1746144909.472100:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175416832:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 35895us (37116us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144909.472110:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4372 00002000:00100000:1.0:1746144909.472120:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1b:0x0] (2097152->3145727) req@ffff8800918ec700 x1830965175416832/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.472128:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ec700 with x1830965175416832 ext(2097152->3145727) 00002000:00010000:1.0:1746144909.472134:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ec700 00000100:00100000:3.0:1746144909.487160:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.487790:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175417344 00000100:00100000:1.0:1746144909.487808:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175417344 00002000:00100000:1.0:1746144909.487846:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1a:0x0] (4194304->5242879) req@ffff88009bae1f80 x1830965175417344/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.487855:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae1f80 with x1830965175417344 ext(4194304->5242879) 00002000:00010000:1.0:1746144909.487859:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae1f80 00000100:00100000:1.0:1746144909.487886:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4373 00000100:00100000:1.0:1746144909.487892:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175417344:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144909.494472:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.494509:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.494554:0:25029:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175417600 00000100:00100000:0.0:1746144909.494563:0:25029:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175417600 00002000:00100000:0.0:1746144909.494599:0:25029:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1a:0x0] (5242880->6291455) req@ffff8800918ee680 x1830965175417600/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.494608:0:25029:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ee680 with x1830965175417600 ext(5242880->6291455) 00002000:00010000:0.0:1746144909.494613:0:25029:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ee680 00000100:00100000:0.0:1746144909.494629:0:25029:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175417984 00000100:00100000:0.0:1746144909.494632:0:25029:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175417984 00002000:00100000:0.0:1746144909.494644:0:25029:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1a:0x0] (5242880->6291455) req@ffff8800918ef480 x1830965175417984/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.494650:0:25029:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ef480 with x1830965175417984 ext(5242880->6291455) 00002000:00010000:0.0:1746144909.494653:0:25029:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918ef480 00000100:00100000:0.0:1746144909.494679:0:25029:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4374 00000100:00100000:0.0:1746144909.494686:0:25029:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175417600:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144909.494819:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.494833:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175417856 00000100:00100000:2.0:1746144909.494836:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175417856 00002000:00100000:2.0:1746144909.494850:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (4194304->5242879) req@ffff8800918ece00 x1830965175417856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.494857:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ece00 with x1830965175417856 ext(4194304->5242879) 00002000:00010000:2.0:1746144909.494860:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918ece00 00000100:00100000:2.0:1746144909.494870:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4375 00000100:00100000:2.0:1746144909.494875:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175417984:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144909.495468:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4376 00000100:00100000:2.0:1746144909.495487:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175417856:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144909.500759:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bae1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175417344:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 12857us (13598us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144909.500783:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4373 00002000:00100000:1.0:1746144909.500807:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1a:0x0] (4194304->5242879) req@ffff88009bae1f80 x1830965175417344/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.500815:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bae1f80 with x1830965175417344 ext(4194304->5242879) 00002000:00010000:1.0:1746144909.500820:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bae1f80 00000100:00100000:2.0:1746144909.509398:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965175417984:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 14512us (14877us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144909.509408:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4375 00002000:00100000:2.0:1746144909.509419:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (5242880->6291455) req@ffff8800918ef480 x1830965175417984/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.509429:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ef480 with x1830965175417984 ext(5242880->6291455) 00002000:00010000:2.0:1746144909.509434:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918ef480 00000100:00100000:0.0:1746144909.515228:0:25029:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175417600:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 20360us (20582us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.516132:0:25029:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4374 00002000:00100000:0.0:1746144909.516147:0:25029:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1a:0x0] (5242880->6291455) req@ffff8800918ee680 x1830965175417600/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.516156:0:25029:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ee680 with x1830965175417600 ext(5242880->6291455) 00002000:00010000:0.0:1746144909.516161:0:25029:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800918ee680 00000100:00100000:2.0:1746144909.516748:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175417856:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 21273us (21927us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144909.516756:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4376 00002000:00100000:2.0:1746144909.516776:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1a:0x0] (4194304->5242879) req@ffff8800918ece00 x1830965175417856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.516783:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ece00 with x1830965175417856 ext(4194304->5242879) 00002000:00010000:2.0:1746144909.516787:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918ece00 00000100:00100000:1.0:1746144909.528417:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.528909:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175418368 00000100:00100000:2.0:1746144909.528917:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175418368 00002000:00100000:2.0:1746144909.528952:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1a:0x0] (6291456->7340031) req@ffff88009167ca80 x1830965175418368/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.528961:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167ca80 with x1830965175418368 ext(6291456->7340031) 00002000:00010000:2.0:1746144909.528966:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167ca80 00000100:00100000:2.0:1746144909.528989:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4377 00000100:00100000:2.0:1746144909.528995:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175418368:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144909.535887:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175418368:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 6883us (7470us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144909.535897:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4377 00002000:00100000:2.0:1746144909.535907:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1a:0x0] (6291456->7340031) req@ffff88009167ca80 x1830965175418368/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.535916:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167ca80 with x1830965175418368 ext(6291456->7340031) 00002000:00010000:2.0:1746144909.535921:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009167ca80 00000100:00100000:3.0:1746144909.537403:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.537443:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.537512:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175418880 00000100:00100000:2.0:1746144909.537519:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175418880 00002000:00100000:2.0:1746144909.537547:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1b:0x0] (5242880->6291455) req@ffff880091c29c00 x1830965175418880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.537555:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c29c00 with x1830965175418880 ext(5242880->6291455) 00002000:00010000:2.0:1746144909.537559:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c29c00 00000100:00100000:2.0:1746144909.537571:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175418752 00000100:00100000:2.0:1746144909.537573:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175418752 00002000:00100000:2.0:1746144909.537583:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1b:0x0] (4194304->5242879) req@ffff88009ad5fb80 x1830965175418752/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.537590:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5fb80 with x1830965175418752 ext(4194304->5242879) 00002000:00010000:2.0:1746144909.537592:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5fb80 00000100:00100000:2.0:1746144909.537615:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4378 00000100:00100000:2.0:1746144909.537621:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175418880:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.537906:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4379 00000100:00100000:3.0:1746144909.537913:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175418752:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.538184:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.538240:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175419264 00000100:00100000:3.0:1746144909.538243:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175419264 00002000:00100000:3.0:1746144909.538260:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1b:0x0] (5242880->6291455) req@ffff8801391d0e00 x1830965175419264/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.538273:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d0e00 with x1830965175419264 ext(5242880->6291455) 00002000:00010000:3.0:1746144909.538276:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801391d0e00 00000100:00100000:3.0:1746144909.538287:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4380 00000100:00100000:3.0:1746144909.538292:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175419264:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.538976:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.538993:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175419136 00000100:00100000:0.0:1746144909.538996:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175419136 00002000:00100000:0.0:1746144909.539013:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1b:0x0] (4194304->5242879) req@ffff8801391d3480 x1830965175419136/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.539020:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d3480 with x1830965175419136 ext(4194304->5242879) 00002000:00010000:0.0:1746144909.539022:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801391d3480 00000100:00100000:0.0:1746144909.539033:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4381 00000100:00100000:0.0:1746144909.539038:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965175419136:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144909.554650:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175418880:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 17020us (17244us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144909.554665:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4378 00002000:00100000:2.0:1746144909.554676:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1b:0x0] (5242880->6291455) req@ffff880091c29c00 x1830965175418880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.554685:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091c29c00 with x1830965175418880 ext(5242880->6291455) 00002000:00010000:2.0:1746144909.554690:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091c29c00 00000100:00100000:3.0:1746144909.557829:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175418752:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 19910us (20379us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144909.557838:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4379 00002000:00100000:3.0:1746144909.557847:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1b:0x0] (4194304->5242879) req@ffff88009ad5fb80 x1830965175418752/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.557854:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5fb80 with x1830965175418752 ext(4194304->5242879) 00002000:00010000:3.0:1746144909.557859:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5fb80 00000100:00100000:0.0:1746144909.558017:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965175419264:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 19723us (19832us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.558024:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4380 00002000:00100000:0.0:1746144909.558029:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1b:0x0] (5242880->6291455) req@ffff8801391d0e00 x1830965175419264/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.558036:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d0e00 with x1830965175419264 ext(5242880->6291455) 00002000:00010000:0.0:1746144909.558038:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801391d0e00 00000100:00100000:0.0:1746144909.561941:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175419136:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 22895us (22958us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.561952:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4381 00002000:00100000:0.0:1746144909.561961:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1b:0x0] (4194304->5242879) req@ffff8801391d3480 x1830965175419136/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.561968:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8801391d3480 with x1830965175419136 ext(4194304->5242879) 00002000:00010000:0.0:1746144909.561973:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8801391d3480 00000100:00100000:1.0:1746144909.569810:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.569837:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175419648 00000100:00100000:0.0:1746144909.569845:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175419648 00002000:00100000:0.0:1746144909.569880:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1b:0x0] (6291456->7340031) req@ffff88009167f100 x1830965175419648/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.569889:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167f100 with x1830965175419648 ext(6291456->7340031) 00002000:00010000:0.0:1746144909.569895:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009167f100 00000100:00100000:0.0:1746144909.569922:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4382 00000100:00100000:0.0:1746144909.569928:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175419648:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144909.582415:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.582617:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175419904 00000100:00100000:0.0:1746144909.582628:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175419904 00002000:00100000:0.0:1746144909.582673:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1a:0x0] (6291456->7340031) req@ffff8800918ee300 x1830965175419904/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.582683:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ee300 with x1830965175419904 ext(6291456->7340031) 00002000:00010000:0.0:1746144909.582689:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918ee300 00000100:00100000:0.0:1746144909.582717:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4383 00000100:00100000:0.0:1746144909.582724:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800918ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175419904:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.587864:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.587889:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.588005:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175420288 00000100:00100000:2.0:1746144909.588014:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175420288 00002000:00100000:2.0:1746144909.588057:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1a:0x0] (7340032->8388607) req@ffff88009bbc4e00 x1830965175420288/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.588067:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4e00 with x1830965175420288 ext(7340032->8388607) 00002000:00010000:2.0:1746144909.588073:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bbc4e00 00000100:00100000:2.0:1746144909.588098:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175420416 00000100:00100000:2.0:1746144909.588100:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175420416 00002000:00100000:2.0:1746144909.588113:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1a:0x0] (7340032->8388607) req@ffff88009bbc7100 x1830965175420416/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.588119:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc7100 with x1830965175420416 ext(7340032->8388607) 00002000:00010000:2.0:1746144909.588123:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc7100 00000100:00100000:2.0:1746144909.588135:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4384 00000100:00100000:2.0:1746144909.588142:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1984:x1830965175420288:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.588484:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4385 00000100:00100000:0.0:1746144909.588509:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175420416:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144909.589957:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1985:x1830965175419648:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 20022us (20192us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144909.589968:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4382 00002000:00100000:1.0:1746144909.589978:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1b:0x0] (6291456->7340031) req@ffff88009167f100 x1830965175419648/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.589987:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009167f100 with x1830965175419648 ext(6291456->7340031) 00002000:00010000:1.0:1746144909.589993:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009167f100 00000100:00100000:0.0:1746144909.596555:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800918ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175419904:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 13820us (14138us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.596566:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4383 00002000:00100000:0.0:1746144909.596579:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1a:0x0] (6291456->7340031) req@ffff8800918ee300 x1830965175419904/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.596589:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800918ee300 with x1830965175419904 ext(6291456->7340031) 00002000:00010000:0.0:1746144909.596596:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800918ee300 00000100:00100000:0.0:1746144909.603218:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175420288:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 15063us (15352us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.603231:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4384 00002000:00100000:0.0:1746144909.603244:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1a:0x0] (7340032->8388607) req@ffff88009bbc4e00 x1830965175420288/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.603253:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc4e00 with x1830965175420288 ext(7340032->8388607) 00002000:00010000:0.0:1746144909.603259:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bbc4e00 00000100:00100000:3.0:1746144909.603377:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175420416:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 14880us (15485us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144909.603384:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4385 00002000:00100000:3.0:1746144909.603390:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (7340032->8388607) req@ffff88009bbc7100 x1830965175420416/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.603397:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc7100 with x1830965175420416 ext(7340032->8388607) 00002000:00010000:3.0:1746144909.603401:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc7100 00000100:00100000:3.0:1746144909.607452:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.610659:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175420672 00000100:00100000:0.0:1746144909.610675:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175420672 00002000:00100000:0.0:1746144909.610732:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (8388608->9437183) req@ffff88009bbc6d80 x1830965175420672/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.610743:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc6d80 with x1830965175420672 ext(8388608->9437183) 00002000:00010000:0.0:1746144909.610749:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc6d80 00000100:00100000:0.0:1746144909.610808:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4386 00000100:00100000:0.0:1746144909.610817:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175420672:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144909.613348:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.613929:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175420928 00000100:00100000:3.0:1746144909.613938:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175420928 00002000:00100000:3.0:1746144909.614012:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1a:0x0] (8388608->9437183) req@ffff88013612d500 x1830965175420928/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.614022:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612d500 with x1830965175420928 ext(8388608->9437183) 00002000:00010000:3.0:1746144909.614028:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013612d500 00000100:00100000:3.0:1746144909.614060:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4387 00000100:00100000:3.0:1746144909.614068:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175420928:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.624407:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175420672:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 13577us (16950us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.624420:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4386 00002000:00100000:0.0:1746144909.624434:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (8388608->9437183) req@ffff88009bbc6d80 x1830965175420672/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.624444:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc6d80 with x1830965175420672 ext(8388608->9437183) 00002000:00010000:0.0:1746144909.624451:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc6d80 00000100:00100000:3.0:1746144909.624946:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175420928:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 10878us (11606us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144909.624953:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4387 00002000:00100000:3.0:1746144909.624958:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1a:0x0] (8388608->9437183) req@ffff88013612d500 x1830965175420928/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.624966:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612d500 with x1830965175420928 ext(8388608->9437183) 00002000:00010000:3.0:1746144909.624969:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013612d500 00000100:00100000:0.0:1746144909.625567:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.625592:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.625617:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.625632:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175421440 00000100:00100000:1.0:1746144909.625633:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175421696 00000100:00100000:1.0:1746144909.625640:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175421696 00000100:00100000:0.0:1746144909.625640:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175421440 00002000:00100000:0.0:1746144909.625668:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (7340032->8388607) req@ffff88009ae41180 x1830965175421440/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.625669:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1b:0x0] (7340032->8388607) req@ffff88009ae40700 x1830965175421696/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.625676:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae41180 with x1830965175421440 ext(7340032->8388607) 00002000:00100000:1.0:1746144909.625677:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae40700 with x1830965175421696 ext(7340032->8388607) 00002000:00010000:0.0:1746144909.625679:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae41180 00002000:00010000:1.0:1746144909.625680:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae40700 00000100:00100000:0.0:1746144909.625690:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175421312 00000100:00100000:0.0:1746144909.625691:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175421312 00002000:00100000:0.0:1746144909.625698:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (6291456->7340031) req@ffff88009ae40a80 x1830965175421312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.625704:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae40a80 with x1830965175421312 ext(6291456->7340031) 00002000:00010000:0.0:1746144909.625706:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae40a80 00000100:00100000:1.0:1746144909.625712:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4388 00000100:00100000:1.0:1746144909.625722:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175421696:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.625723:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4389 00000100:00100000:0.0:1746144909.625728:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175421440:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144909.626571:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4390 00000100:00100000:1.0:1746144909.626576:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175421312:12345-192.168.202.16@tcp:3:cmp.0 00010000:00010000:3.0:1746144909.638134:0:7101:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746144909.642737:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175421696:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 17005us (17130us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144909.642751:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4388 00002000:00100000:2.0:1746144909.642803:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1b:0x0] (7340032->8388607) req@ffff88009ae40700 x1830965175421696/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.642813:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae40700 with x1830965175421696 ext(7340032->8388607) 00002000:00010000:2.0:1746144909.642819:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae40700 00000100:00100000:0.0:1746144909.646537:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175421440:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 20796us (20959us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.646550:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4389 00002000:00100000:0.0:1746144909.646561:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (7340032->8388607) req@ffff88009ae41180 x1830965175421440/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.646572:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae41180 with x1830965175421440 ext(7340032->8388607) 00002000:00010000:0.0:1746144909.646578:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae41180 00000100:00100000:1.0:1746144909.647106:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175421312:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 20528us (21485us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144909.647115:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4390 00002000:00100000:1.0:1746144909.647122:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1b:0x0] (6291456->7340031) req@ffff88009ae40a80 x1830965175421312/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.647130:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae40a80 with x1830965175421312 ext(6291456->7340031) 00002000:00010000:1.0:1746144909.647133:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae40a80 00000100:00100000:2.0:1746144909.655651:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.656311:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175421952 00000100:00100000:1.0:1746144909.656322:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175421952 00002000:00100000:1.0:1746144909.656369:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1b:0x0] (8388608->9437183) req@ffff88013612d880 x1830965175421952/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.656378:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612d880 with x1830965175421952 ext(8388608->9437183) 00002000:00010000:1.0:1746144909.656382:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013612d880 00000100:00100000:1.0:1746144909.656405:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4391 00000100:00100000:1.0:1746144909.656412:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175421952:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144909.656920:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.657501:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175422208 00000100:00100000:0.0:1746144909.657506:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175422208 00002000:00100000:0.0:1746144909.657536:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (8388608->9437183) req@ffff88013612ed80 x1830965175422208/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.657549:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ed80 with x1830965175422208 ext(8388608->9437183) 00002000:00010000:0.0:1746144909.657552:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612ed80 00000100:00100000:0.0:1746144909.657580:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4392 00000100:00100000:0.0:1746144909.657587:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175422208:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144909.664814:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.664849:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.665304:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175422592 00000100:00100000:3.0:1746144909.665305:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175422720 00000100:00100000:3.0:1746144909.665314:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175422720 00000100:00100000:0.0:1746144909.665314:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175422592 00002000:00100000:3.0:1746144909.665361:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (9437184->10485759) req@ffff88013612ea00 x1830965175422720/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.665361:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (9437184->10485759) req@ffff88013612c380 x1830965175422592/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.665370:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ea00 with x1830965175422720 ext(9437184->10485759) 00002000:00100000:0.0:1746144909.665370:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612c380 with x1830965175422592 ext(9437184->10485759) 00002000:00010000:3.0:1746144909.665375:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013612ea00 00002000:00010000:0.0:1746144909.665376:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612c380 00000100:00100000:0.0:1746144909.665410:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4393 00000100:00100000:3.0:1746144909.665415:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4394 00000100:00100000:0.0:1746144909.665418:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175422592:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.665421:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965175422720:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144909.672857:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965175421952:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 16434us (17204us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144909.672869:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4391 00002000:00100000:1.0:1746144909.672882:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1b:0x0] (8388608->9437183) req@ffff88013612d880 x1830965175421952/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.672891:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612d880 with x1830965175421952 ext(8388608->9437183) 00002000:00010000:1.0:1746144909.672897:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013612d880 00000100:00100000:0.0:1746144909.674236:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175422208:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 16644us (17313us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.674245:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4392 00002000:00100000:0.0:1746144909.674253:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (8388608->9437183) req@ffff88013612ed80 x1830965175422208/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.674261:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ed80 with x1830965175422208 ext(8388608->9437183) 00002000:00010000:0.0:1746144909.674265:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612ed80 00000100:00100000:1.0:1746144909.678592:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175422592:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 13169us (13793us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144909.678603:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4393 00002000:00100000:1.0:1746144909.678615:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (9437184->10485759) req@ffff88013612c380 x1830965175422592/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.678625:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612c380 with x1830965175422592 ext(9437184->10485759) 00002000:00010000:1.0:1746144909.678631:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612c380 00000100:00100000:0.0:1746144909.679855:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175422720:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 12125us (12694us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.679866:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4394 00002000:00100000:0.0:1746144909.679876:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (9437184->10485759) req@ffff88013612ea00 x1830965175422720/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.679885:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ea00 with x1830965175422720 ext(9437184->10485759) 00002000:00010000:0.0:1746144909.679888:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013612ea00 00000100:00100000:3.0:1746144909.684151:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.684210:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.684301:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175422976 00000100:00100000:1.0:1746144909.684311:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175422976 00002000:00100000:1.0:1746144909.684360:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (10485760->11534335) req@ffff88009bbc7480 x1830965175422976/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.684370:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc7480 with x1830965175422976 ext(10485760->11534335) 00002000:00010000:1.0:1746144909.684375:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc7480 00000100:00100000:1.0:1746144909.684406:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175423232 00000100:00100000:1.0:1746144909.684408:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175423232 00002000:00100000:1.0:1746144909.684420:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1a:0x0] (10485760->11534335) req@ffff88009b032d80 x1830965175423232/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.684426:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b032d80 with x1830965175423232 ext(10485760->11534335) 00002000:00010000:1.0:1746144909.684429:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b032d80 00000100:00100000:1.0:1746144909.684441:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4395 00000100:00100000:1.0:1746144909.684447:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175422976:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.685292:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4396 00000100:00100000:0.0:1746144909.685303:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175423232:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.692746:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.693081:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175423488 00000100:00100000:2.0:1746144909.693091:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175423488 00002000:00100000:2.0:1746144909.693136:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1a:0x0] (11534336->12582911) req@ffff88009b031880 x1830965175423488/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.693146:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031880 with x1830965175423488 ext(11534336->12582911) 00002000:00010000:2.0:1746144909.693152:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b031880 00000100:00100000:2.0:1746144909.693188:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4397 00000100:00100000:2.0:1746144909.693195:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175423488:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.697908:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.699080:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.699208:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bbc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175422976:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 14758us (15066us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.699219:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4395 00002000:00100000:0.0:1746144909.699231:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1a:0x0] (10485760->11534335) req@ffff88009bbc7480 x1830965175422976/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.699241:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bbc7480 with x1830965175422976 ext(10485760->11534335) 00002000:00010000:0.0:1746144909.699248:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bbc7480 00000100:00100000:0.0:1746144909.699277:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175423872 00000100:00100000:0.0:1746144909.699283:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175423872 00002000:00100000:0.0:1746144909.699314:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (9437184->10485759) req@ffff88009ae43480 x1830965175423872/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.699321:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae43480 with x1830965175423872 ext(9437184->10485759) 00002000:00010000:0.0:1746144909.699325:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae43480 00000100:00100000:0.0:1746144909.699337:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175424000 00000100:00100000:0.0:1746144909.699338:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175424000 00002000:00100000:0.0:1746144909.699351:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1b:0x0] (9437184->10485759) req@ffff88009ae40e00 x1830965175424000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.699363:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae40e00 with x1830965175424000 ext(9437184->10485759) 00002000:00010000:0.0:1746144909.699366:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae40e00 00000100:00100000:0.0:1746144909.699378:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4398 00000100:00100000:0.0:1746144909.699385:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175423872:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.699829:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4399 00000100:00100000:0.0:1746144909.699835:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ae40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175424000:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.702759:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b032d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175423232:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 17448us (18536us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144909.702802:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4396 00002000:00100000:3.0:1746144909.702813:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (10485760->11534335) req@ffff88009b032d80 x1830965175423232/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.702824:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b032d80 with x1830965175423232 ext(10485760->11534335) 00002000:00010000:3.0:1746144909.702830:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b032d80 00000100:00100000:3.0:1746144909.711308:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175423488:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 18102us (18561us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144909.711322:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4397 00002000:00100000:3.0:1746144909.711334:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1a:0x0] (11534336->12582911) req@ffff88009b031880 x1830965175423488/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.711344:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031880 with x1830965175423488 ext(11534336->12582911) 00002000:00010000:3.0:1746144909.711350:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b031880 00000100:00100000:0.0:1746144909.714496:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175423872:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 15100us (16587us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.714508:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4398 00002000:00100000:0.0:1746144909.714519:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (9437184->10485759) req@ffff88009ae43480 x1830965175423872/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.714528:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae43480 with x1830965175423872 ext(9437184->10485759) 00002000:00010000:0.0:1746144909.714534:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ae43480 00000100:00100000:0.0:1746144909.714789:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ae40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175424000:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 14953us (15710us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.714804:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4399 00002000:00100000:0.0:1746144909.714810:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1b:0x0] (9437184->10485759) req@ffff88009ae40e00 x1830965175424000/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.714817:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ae40e00 with x1830965175424000 ext(9437184->10485759) 00002000:00010000:0.0:1746144909.714820:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ae40e00 00000100:00100000:2.0:1746144909.720382:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.720427:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.720489:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175424256 00000100:00100000:1.0:1746144909.720499:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175424256 00002000:00100000:1.0:1746144909.720549:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1b:0x0] (10485760->11534335) req@ffff88013612ca80 x1830965175424256/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.720559:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ca80 with x1830965175424256 ext(10485760->11534335) 00002000:00010000:1.0:1746144909.720563:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013612ca80 00000100:00100000:0.0:1746144909.720578:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175424512 00000100:00100000:0.0:1746144909.720590:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175424512 00000100:00100000:1.0:1746144909.720600:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4400 00000100:00100000:1.0:1746144909.720608:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175424256:12345-192.168.202.16@tcp:3:cmp.0 00002000:00100000:0.0:1746144909.720630:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1b:0x0] (10485760->11534335) req@ffff88013612e300 x1830965175424512/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.720639:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612e300 with x1830965175424512 ext(10485760->11534335) 00002000:00010000:0.0:1746144909.720645:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612e300 00000100:00100000:0.0:1746144909.720678:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4401 00000100:00100000:0.0:1746144909.720685:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175424512:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.724273:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.724408:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175424768 00000100:00100000:0.0:1746144909.724417:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175424768 00002000:00100000:0.0:1746144909.724457:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1b:0x0] (11534336->12582911) req@ffff88009b032a00 x1830965175424768/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.724466:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b032a00 with x1830965175424768 ext(11534336->12582911) 00002000:00010000:0.0:1746144909.724470:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b032a00 00000100:00100000:0.0:1746144909.724499:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4402 00000100:00100000:0.0:1746144909.724505:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965175424768:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.736150:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175424512:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 15454us (15711us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.736161:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4401 00002000:00100000:0.0:1746144909.736172:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1b:0x0] (10485760->11534335) req@ffff88013612e300 x1830965175424512/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.736181:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612e300 with x1830965175424512 ext(10485760->11534335) 00002000:00010000:0.0:1746144909.736187:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013612e300 00000100:00100000:2.0:1746144909.736193:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.736820:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175425024 00000100:00100000:3.0:1746144909.736832:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175425024 00002000:00100000:3.0:1746144909.736872:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (11534336->12582911) req@ffff88013612fb80 x1830965175425024/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.736881:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612fb80 with x1830965175425024 ext(11534336->12582911) 00002000:00010000:3.0:1746144909.736885:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013612fb80 00000100:00100000:3.0:1746144909.736923:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4403 00000100:00100000:3.0:1746144909.736929:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1984:x1830965175425024:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144909.737785:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1984:x1830965175424256:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 17174us (17412us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144909.737804:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4400 00002000:00100000:1.0:1746144909.737812:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1b:0x0] (10485760->11534335) req@ffff88013612ca80 x1830965175424256/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.737821:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612ca80 with x1830965175424256 ext(10485760->11534335) 00002000:00010000:1.0:1746144909.737825:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013612ca80 00000100:00100000:0.0:1746144909.739158:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b032a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965175424768:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 14648us (14892us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.739165:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4402 00002000:00100000:0.0:1746144909.739173:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1b:0x0] (11534336->12582911) req@ffff88009b032a00 x1830965175424768/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.739181:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b032a00 with x1830965175424768 ext(11534336->12582911) 00002000:00010000:0.0:1746144909.739184:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b032a00 00000100:00100000:3.0:1746144909.744281:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013612fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175425024:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 7344us (8082us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144909.744290:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4403 00002000:00100000:3.0:1746144909.744298:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1a:0x0] (11534336->12582911) req@ffff88013612fb80 x1830965175425024/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.744304:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013612fb80 with x1830965175425024 ext(11534336->12582911) 00002000:00010000:3.0:1746144909.744309:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013612fb80 00000100:00100000:2.0:1746144909.750269:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.750377:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175425280 00000100:00100000:3.0:1746144909.750387:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175425280 00002000:00100000:3.0:1746144909.750423:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (12582912->13631487) req@ffff88009b463480 x1830965175425280/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.750432:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463480 with x1830965175425280 ext(12582912->13631487) 00002000:00010000:3.0:1746144909.750436:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b463480 00000100:00100000:3.0:1746144909.750462:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4404 00000100:00100000:3.0:1746144909.750468:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175425280:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144909.757021:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.757256:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175425536 00000100:00100000:0.0:1746144909.757270:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175425536 00002000:00100000:0.0:1746144909.757318:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (11534336->12582911) req@ffff88009b462300 x1830965175425536/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.757328:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b462300 with x1830965175425536 ext(11534336->12582911) 00002000:00010000:0.0:1746144909.757334:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b462300 00000100:00100000:0.0:1746144909.757370:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4405 00000100:00100000:0.0:1746144909.757378:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175425536:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.759597:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175425280:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 9122us (9327us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144909.759607:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4404 00002000:00100000:3.0:1746144909.759617:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1a:0x0] (12582912->13631487) req@ffff88009b463480 x1830965175425280/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.759625:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b463480 with x1830965175425280 ext(12582912->13631487) 00002000:00010000:3.0:1746144909.759630:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b463480 00000100:00100000:0.0:1746144909.763473:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175425536:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 6084us (6447us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.763485:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4405 00002000:00100000:0.0:1746144909.763498:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (11534336->12582911) req@ffff88009b462300 x1830965175425536/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.763508:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b462300 with x1830965175425536 ext(11534336->12582911) 00002000:00010000:0.0:1746144909.763514:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b462300 00000100:00100000:2.0:1746144909.773845:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.773927:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175425792 00000100:00100000:0.0:1746144909.773938:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175425792 00002000:00100000:0.0:1746144909.773990:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1b:0x0] (12582912->13631487) req@ffff88009b460000 x1830965175425792/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.774001:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460000 with x1830965175425792 ext(12582912->13631487) 00002000:00010000:0.0:1746144909.774007:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b460000 00000100:00100000:0.0:1746144909.774603:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4406 00000100:00100000:0.0:1746144909.774613:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175425792:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.783990:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175425792:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 9365us (10141us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.784003:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4406 00002000:00100000:0.0:1746144909.784015:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1b:0x0] (12582912->13631487) req@ffff88009b460000 x1830965175425792/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.784024:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b460000 with x1830965175425792 ext(12582912->13631487) 00002000:00010000:0.0:1746144909.784031:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b460000 00000100:00100000:2.0:1746144909.791676:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.791834:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175426048 00000100:00100000:3.0:1746144909.791846:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175426048 00000100:00100000:3.0:1746144909.791901:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 167 00000100:00100000:3.0:1746144909.791910:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1120:x1830965175426048:12345-192.168.202.16@tcp:35:cmp.0 00000100:00100000:3.0:1746144909.793228:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1120:x1830965175426048:12345-192.168.202.16@tcp:35:cmp.0 Request processed in 1315us (1558us total) trans 4294987528 rc 0/0 00000100:00100000:3.0:1746144909.793237:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 167 00000100:00100000:2.0:1746144909.805468:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.806022:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175426304 00000100:00100000:1.0:1746144909.806032:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175426304 00000100:00100000:1.0:1746144909.806618:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48268 00000100:00100000:1.0:1746144909.806628:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+15:1122:x1830965175426304:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:1.0:1746144909.806649:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144909.806667:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e5c00/0x4076af672751606b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af955f1 expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.806756:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e5200/0x4076af6727516072 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.806815:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e5200/0x4076af6727516072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144909.806827:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e5200/0x4076af6727516072 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:1.0:1746144909.806837:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 26214400 00010000:00010000:1.0:1746144909.806959:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e5c00/0x4076af672751606b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955f1 expref: 18 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.806997:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e5200/0x4076af6727516072 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955f1 expref: 17 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144909.807004:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca000) 00010000:00010000:1.0:1746144909.807007:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144909.807010:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800941e5200, rc 0) 00000100:00100000:1.0:1746144909.810501:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1122:x1830965175426304:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 3859us (5028us total) trans 4294987529 rc 0/0 00000100:00100000:1.0:1746144909.810513:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48268 00000100:00100000:1.0:1746144909.816471:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.816575:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144909.816755:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175426560 00000100:00100000:2.0:1746144909.816804:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175426560 00000100:00100000:2.0:1746144909.816866:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48269 00000100:00100000:2.0:1746144909.816875:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1122:x1830965175426560:12345-192.168.202.16@tcp:101:cmp.0 00000100:00100000:0.0:1746144909.816950:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175426688 00000100:00100000:0.0:1746144909.816955:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175426688 00000100:00100000:0.0:1746144909.816986:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 293 00000100:00100000:0.0:1746144909.816990:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1982:x1830965175426688:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144909.817003:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144909.817029:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800941e5200/0x4076af6727516072 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955f1 expref: 18 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.817056:0:7098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca000) 00010000:00010000:0.0:1746144909.817061:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144909.817255:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144909.817270:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091709400/0x4076af6727516080 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af955f8 expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144909.817367:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091709a00/0x4076af6727516087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00000100:00100000:0.0:1746144909.817375:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1982:x1830965175426688:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 382us (798us total) trans 0 rc 0/0 00010000:00010000:2.0:1746144909.817380:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091709a00/0x4076af6727516087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00000100:00100000:0.0:1746144909.817381:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 293 00010000:00010000:2.0:1746144909.817389:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091709a00/0x4076af6727516087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:2.0:1746144909.817398:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4d:0x0]: returning size 26214400 00010000:00010000:3.0:1746144909.818103:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091709400/0x4076af6727516080 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955f8 expref: 19 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144909.819549:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091709a00/0x4076af6727516087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955f8 expref: 18 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144909.819559:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff88009a8b7c00) 00010000:00010000:3.0:1746144909.819561:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144909.819565:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091709a00, rc 0) 00000100:00100000:2.0:1746144909.819700:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1122:x1830965175426560:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 2826us (3238us total) trans 4294987530 rc 0/0 00000100:00100000:2.0:1746144909.819706:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48269 00000100:00100000:1.0:1746144909.821559:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.821610:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.821814:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175426816 00000100:00100000:0.0:1746144909.821822:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175426816 00000100:00100000:0.0:1746144909.821861:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175426944 00000100:00100000:0.0:1746144909.821862:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175426944 00000100:00100000:0.0:1746144909.821877:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5889 00000100:00100000:0.0:1746144909.821883:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+7:1985:x1830965175426816:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:0.0:1746144909.821900:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144909.821915:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009422ae00/0x4076af6727516095 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af955ff expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.821941:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144909.821943:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144909.821950:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009422ae00/0x4076af6727516095 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ff expref: 8 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144909.821964:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009422ae00/0x4076af6727516095 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ff expref: 8 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144909.821975:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009422ae00, rc 0) 00000100:00100000:0.0:1746144909.822023:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1985:x1830965175426816:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 139us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144909.822028:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5889 00000100:00100000:0.0:1746144909.822043:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5890 00000100:00100000:0.0:1746144909.822047:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+25:1985:x1830965175426944:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:0.0:1746144909.822054:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144909.822063:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af672751609c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95606 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.822074:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144909.822076:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144909.822079:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af672751609c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95606 expref: 26 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144909.822088:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af672751609c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95606 expref: 26 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144909.822095:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009422a000, rc 0) 00000100:00100000:0.0:1746144909.822109:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1985:x1830965175426944:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 62us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144909.822114:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5890 00000100:00100000:0.0:1746144909.822357:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.822376:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175427072 00000100:00100000:0.0:1746144909.822380:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175427072 00000100:00100000:0.0:1746144909.822402:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 294 00000100:00100000:0.0:1746144909.822406:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1984:x1830965175427072:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144909.822414:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144909.822432:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091709a00/0x4076af6727516087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955f8 expref: 18 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144909.822444:0:7098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff88009a8b7c00) 00010000:00010000:0.0:1746144909.822447:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144909.822460:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1984:x1830965175427072:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 54us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144909.822465:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 294 00000100:00100000:1.0:1746144909.846496:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.846524:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.846552:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.846590:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.846611:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175427456 00000100:00100000:3.0:1746144909.846612:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175427584 00000100:00100000:3.0:1746144909.846620:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175427584 00000100:00100000:1.0:1746144909.846620:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175427456 00000100:00100000:2.0:1746144909.846649:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175427968 00000100:00100000:2.0:1746144909.846654:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175427968 00002000:00100000:3.0:1746144909.846665:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1b:0x0] (1048576->2097151) req@ffff88009bb48e00 x1830965175427584/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.846665:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1b:0x0] (0->1048575) req@ffff88009bb48a80 x1830965175427456/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.846675:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb48e00 with x1830965175427584 ext(1048576->2097151) 00002000:00100000:2.0:1746144909.846675:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1b:0x0] (1048576->2097151) req@ffff88009bb4b480 x1830965175427968/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.846675:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb48a80 with x1830965175427456 ext(0->1048575) 00002000:00010000:3.0:1746144909.846680:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb48e00 00002000:00010000:1.0:1746144909.846680:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb48a80 00002000:00100000:2.0:1746144909.846682:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b480 with x1830965175427968 ext(1048576->2097151) 00002000:00010000:2.0:1746144909.846686:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4b480 00000100:00100000:3.0:1746144909.846704:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4407 00000100:00100000:3.0:1746144909.846712:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1983:x1830965175427456:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.846729:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4408 00000100:00100000:0.0:1746144909.846739:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1983:x1830965175427584:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144909.846751:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4409 00000100:00100000:2.0:1746144909.846757:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1983:x1830965175427968:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144909.847602:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175427840 00000100:00100000:1.0:1746144909.847608:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175427840 00002000:00100000:1.0:1746144909.847626:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (0->1048575) req@ffff88009bb4aa00 x1830965175427840/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.847633:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4aa00 with x1830965175427840 ext(0->1048575) 00002000:00010000:1.0:1746144909.847636:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4aa00 00000100:00100000:1.0:1746144909.847655:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4410 00000100:00100000:1.0:1746144909.847661:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+28:1983:x1830965175427840:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.856049:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1983:x1830965175427456:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 9325us (9552us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144909.856061:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4407 00002000:00100000:3.0:1746144909.856075:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1b:0x0] (0->1048575) req@ffff88009bb48a80 x1830965175427456/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.856084:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb48a80 with x1830965175427456 ext(0->1048575) 00002000:00010000:3.0:1746144909.856091:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb48a80 00000100:00100000:3.0:1746144909.856723:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+28:1983:x1830965175427968:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 9964us (10168us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144909.856730:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4409 00002000:00100000:3.0:1746144909.856735:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1b:0x0] (1048576->2097151) req@ffff88009bb4b480 x1830965175427968/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.856742:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b480 with x1830965175427968 ext(1048576->2097151) 00002000:00010000:3.0:1746144909.856745:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4b480 00000100:00100000:2.0:1746144909.865730:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1983:x1830965175427840:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 18055us (19125us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144909.865745:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4410 00002000:00100000:2.0:1746144909.865758:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (0->1048575) req@ffff88009bb4aa00 x1830965175427840/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.865807:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4aa00 with x1830965175427840 ext(0->1048575) 00002000:00010000:2.0:1746144909.865814:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4aa00 00000100:00100000:0.0:1746144909.867473:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1983:x1830965175427584:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 20730us (20941us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.867482:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4408 00002000:00100000:0.0:1746144909.867491:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1b:0x0] (1048576->2097151) req@ffff88009bb48e00 x1830965175427584/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.867499:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb48e00 with x1830965175427584 ext(1048576->2097151) 00002000:00010000:0.0:1746144909.867504:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb48e00 00000100:00100000:3.0:1746144909.883576:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.883604:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.883620:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.883631:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175428480 00000100:00100000:3.0:1746144909.883635:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175428608 00000100:00100000:3.0:1746144909.883640:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175428608 00000100:00100000:0.0:1746144909.883641:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175428480 00000100:00100000:2.0:1746144909.883652:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175428992 00000100:00100000:2.0:1746144909.883657:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175428992 00002000:00100000:3.0:1746144909.883682:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1b:0x0] (3145728->4194303) req@ffff88009b031500 x1830965175428608/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.883683:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (3145728->4194303) req@ffff88013619b100 x1830965175428992/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.883683:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1b:0x0] (2097152->3145727) req@ffff88009b033100 x1830965175428480/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.883689:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031500 with x1830965175428608 ext(3145728->4194303) 00002000:00100000:0.0:1746144909.883690:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033100 with x1830965175428480 ext(2097152->3145727) 00002000:00100000:2.0:1746144909.883692:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013619b100 with x1830965175428992 ext(3145728->4194303) 00002000:00010000:3.0:1746144909.883694:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b031500 00002000:00010000:0.0:1746144909.883694:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b033100 00002000:00010000:2.0:1746144909.883696:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013619b100 00000100:00100000:2.0:1746144909.883714:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4411 00000100:00100000:0.0:1746144909.883718:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4412 00000100:00100000:3.0:1746144909.883721:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4413 00000100:00100000:2.0:1746144909.883721:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013619b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1985:x1830965175428992:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.883723:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1985:x1830965175428480:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.883725:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1985:x1830965175428608:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.883759:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.883783:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175428864 00000100:00100000:3.0:1746144909.883786:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175428864 00002000:00100000:3.0:1746144909.883811:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (2097152->3145727) req@ffff880135eaa300 x1830965175428864/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.883816:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135eaa300 with x1830965175428864 ext(2097152->3145727) 00002000:00010000:3.0:1746144909.883818:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135eaa300 00000100:00100000:3.0:1746144909.883825:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4414 00000100:00100000:3.0:1746144909.883828:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+27:1985:x1830965175428864:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144909.895282:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013619b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+28:1985:x1830965175428992:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 11547us (11645us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144909.895296:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4411 00002000:00100000:2.0:1746144909.895310:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (3145728->4194303) req@ffff88013619b100 x1830965175428992/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.895321:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013619b100 with x1830965175428992 ext(3145728->4194303) 00002000:00010000:2.0:1746144909.895331:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013619b100 00000100:00100000:0.0:1746144909.902185:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1985:x1830965175428864:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 18342us (18410us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.902198:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4414 00002000:00100000:0.0:1746144909.902210:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (2097152->3145727) req@ffff880135eaa300 x1830965175428864/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.902221:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135eaa300 with x1830965175428864 ext(2097152->3145727) 00002000:00010000:0.0:1746144909.902280:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135eaa300 00000100:00100000:0.0:1746144909.902505:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b031500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1985:x1830965175428608:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 18778us (18898us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.902512:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4413 00002000:00100000:0.0:1746144909.902517:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1b:0x0] (3145728->4194303) req@ffff88009b031500 x1830965175428608/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.902524:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b031500 with x1830965175428608 ext(3145728->4194303) 00002000:00010000:0.0:1746144909.902527:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b031500 00000100:00100000:0.0:1746144909.906316:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1985:x1830965175428480:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 22581us (22737us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.906327:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4412 00002000:00100000:0.0:1746144909.906338:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1b:0x0] (2097152->3145727) req@ffff88009b033100 x1830965175428480/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.906347:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b033100 with x1830965175428480 ext(2097152->3145727) 00002000:00010000:0.0:1746144909.906354:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b033100 00000100:00100000:1.0:1746144909.928167:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.928193:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.928210:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.928213:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175429632 00000100:00100000:0.0:1746144909.928223:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175429632 00000100:00100000:1.0:1746144909.928240:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144909.928259:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175429504 00000100:00100000:1.0:1746144909.928262:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175429504 00002000:00100000:0.0:1746144909.928270:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1b:0x0] (5242880->6291455) req@ffff88009bb4a680 x1830965175429632/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.928280:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1b:0x0] (4194304->5242879) req@ffff88009bb4ad80 x1830965175429504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.928280:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4a680 with x1830965175429632 ext(5242880->6291455) 00002000:00010000:0.0:1746144909.928285:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4a680 00002000:00100000:1.0:1746144909.928292:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4ad80 with x1830965175429504 ext(4194304->5242879) 00002000:00010000:1.0:1746144909.928295:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4ad80 00000100:00100000:0.0:1746144909.928311:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175429888 00000100:00100000:0.0:1746144909.928313:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175429888 00000100:00100000:1.0:1746144909.928321:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175430016 00000100:00100000:1.0:1746144909.928323:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175430016 00002000:00100000:0.0:1746144909.928324:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1b:0x0] (4194304->5242879) req@ffff88009bb4b800 x1830965175429888/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.928331:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b800 with x1830965175429888 ext(4194304->5242879) 00002000:00010000:0.0:1746144909.928334:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb4b800 00002000:00100000:1.0:1746144909.928337:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1b:0x0] (5242880->6291455) req@ffff88009bb4b100 x1830965175430016/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.928343:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b100 with x1830965175430016 ext(5242880->6291455) 00000100:00100000:3.0:1746144909.928345:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4415 00002000:00010000:1.0:1746144909.928345:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb4b100 00000100:00100000:0.0:1746144909.928351:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4416 00000100:00100000:3.0:1746144909.928356:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+27:1984:x1830965175429632:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.928356:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+27:1984:x1830965175429504:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144909.928561:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4417 00000100:00100000:1.0:1746144909.928568:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1984:x1830965175429888:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.928961:0:25029:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4418 00000100:00100000:0.0:1746144909.928967:0:25029:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1984:x1830965175430016:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144909.945385:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+28:1984:x1830965175429504:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 17018us (17180us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144909.945395:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4416 00002000:00100000:0.0:1746144909.945405:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1b:0x0] (4194304->5242879) req@ffff88009bb4ad80 x1830965175429504/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144909.945414:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4ad80 with x1830965175429504 ext(4194304->5242879) 00002000:00010000:0.0:1746144909.945419:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4ad80 00000100:00100000:2.0:1746144909.952096:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1984:x1830965175429888:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 23507us (23863us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144909.952109:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4417 00002000:00100000:2.0:1746144909.952122:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1b:0x0] (4194304->5242879) req@ffff88009bb4b800 x1830965175429888/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.952131:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b800 with x1830965175429888 ext(4194304->5242879) 00002000:00010000:2.0:1746144909.952136:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb4b800 00000100:00100000:1.0:1746144909.953318:0:25029:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1984:x1830965175430016:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 24348us (25073us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144909.953326:0:25029:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4418 00002000:00100000:1.0:1746144909.953333:0:25029:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1b:0x0] (5242880->6291455) req@ffff88009bb4b100 x1830965175430016/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144909.953340:0:25029:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4b100 with x1830965175430016 ext(5242880->6291455) 00002000:00010000:1.0:1746144909.953344:0:25029:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb4b100 00000100:00100000:3.0:1746144909.957282:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1984:x1830965175429632:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 28920us (29116us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144909.957296:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4415 00002000:00100000:3.0:1746144909.957542:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1b:0x0] (5242880->6291455) req@ffff88009bb4a680 x1830965175429632/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.957551:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4a680 with x1830965175429632 ext(5242880->6291455) 00002000:00010000:3.0:1746144909.957556:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009bb4a680 00000100:00100000:0.0:1746144909.966208:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.966912:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175430400 00000100:00100000:3.0:1746144909.966920:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175430400 00002000:00100000:3.0:1746144909.966955:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1b:0x0] (6291456->7340031) req@ffff880092588a80 x1830965175430400/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.966964:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092588a80 with x1830965175430400 ext(6291456->7340031) 00002000:00010000:3.0:1746144909.966968:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092588a80 00000100:00100000:3.0:1746144909.966994:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4419 00000100:00100000:3.0:1746144909.967000:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1985:x1830965175430400:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.976118:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1985:x1830965175430400:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 9109us (9909us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144909.976129:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4419 00002000:00100000:3.0:1746144909.976138:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1b:0x0] (6291456->7340031) req@ffff880092588a80 x1830965175430400/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.976146:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092588a80 with x1830965175430400 ext(6291456->7340031) 00002000:00010000:3.0:1746144909.976151:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092588a80 00000100:00100000:0.0:1746144909.983155:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.983189:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144909.983850:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144909.983925:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175430784 00000100:00100000:3.0:1746144909.983933:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175430784 00002000:00100000:3.0:1746144909.983970:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1b:0x0] (6291456->7340031) req@ffff88009258a680 x1830965175430784/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.983979:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258a680 with x1830965175430784 ext(6291456->7340031) 00002000:00010000:3.0:1746144909.983983:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258a680 00000100:00100000:3.0:1746144909.983996:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175430912 00000100:00100000:3.0:1746144909.983998:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175430912 00002000:00100000:3.0:1746144909.984006:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1b:0x0] (7340032->8388607) req@ffff88009258b100 x1830965175430912/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144909.984012:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258b100 with x1830965175430912 ext(7340032->8388607) 00002000:00010000:3.0:1746144909.984014:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258b100 00000100:00100000:3.0:1746144909.984022:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175431168 00000100:00100000:3.0:1746144909.984024:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175431168 00002000:00100000:3.0:1746144909.984032:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1b:0x0] (7340032->8388607) req@ffff880135ea4e00 x1830965175431168/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/0 e 0 to 0 dl 1746144920 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00000100:00100000:2.0:1746144909.984032:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4420 00002000:00100000:3.0:1746144909.984038:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4e00 with x1830965175431168 ext(7340032->8388607) 00002000:00010000:3.0:1746144909.984040:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ea4e00 00000100:00100000:2.0:1746144909.984040:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+27:1985:x1830965175430784:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.984050:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4421 00000100:00100000:3.0:1746144909.984054:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+27:1985:x1830965175430912:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144909.984320:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4422 00000100:00100000:3.0:1746144909.984326:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1985:x1830965175431168:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144909.997444:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+28:1985:x1830965175430784:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 13398us (14288us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144909.997455:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4420 00002000:00100000:2.0:1746144909.997466:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1b:0x0] (6291456->7340031) req@ffff88009258a680 x1830965175430784/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144909.997474:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258a680 with x1830965175430784 ext(6291456->7340031) 00002000:00010000:2.0:1746144909.997479:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258a680 00000100:00100000:3.0:1746144910.000866:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1985:x1830965175431168:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 16533us (17008us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144910.000874:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4422 00002000:00100000:3.0:1746144910.000883:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1b:0x0] (7340032->8388607) req@ffff880135ea4e00 x1830965175431168/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.000891:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4e00 with x1830965175431168 ext(7340032->8388607) 00002000:00010000:3.0:1746144910.000895:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ea4e00 00000100:00100000:3.0:1746144910.003603:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1985:x1830965175430912:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 19541us (20406us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144910.003612:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4421 00002000:00100000:3.0:1746144910.003621:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1b:0x0] (7340032->8388607) req@ffff88009258b100 x1830965175430912/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:550/0 lens 488/440 e 0 to 0 dl 1746144920 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.003629:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258b100 with x1830965175430912 ext(7340032->8388607) 00002000:00010000:3.0:1746144910.003633:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009258b100 00000100:00100000:0.0:1746144910.009252:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.009339:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175431424 00000100:00100000:3.0:1746144910.009347:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175431424 00002000:00100000:3.0:1746144910.009379:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1b:0x0] (8388608->9437183) req@ffff880135ea6300 x1830965175431424/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.009387:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea6300 with x1830965175431424 ext(8388608->9437183) 00002000:00010000:3.0:1746144910.009392:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ea6300 00000100:00100000:3.0:1746144910.009414:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4423 00000100:00100000:3.0:1746144910.009420:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1984:x1830965175431424:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144910.013687:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.013759:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175431680 00000100:00100000:0.0:1746144910.013812:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175431680 00002000:00100000:0.0:1746144910.013851:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1b:0x0] (8388608->9437183) req@ffff88009b461c00 x1830965175431680/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144910.013861:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b461c00 with x1830965175431680 ext(8388608->9437183) 00002000:00010000:0.0:1746144910.013866:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b461c00 00000100:00100000:0.0:1746144910.013896:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4424 00000100:00100000:0.0:1746144910.013904:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1985:x1830965175431680:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144910.019465:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1984:x1830965175431424:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 10036us (10212us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144910.019474:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4423 00002000:00100000:3.0:1746144910.019484:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1b:0x0] (8388608->9437183) req@ffff880135ea6300 x1830965175431424/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/440 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.019492:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea6300 with x1830965175431424 ext(8388608->9437183) 00002000:00010000:3.0:1746144910.019497:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ea6300 00000100:00100000:0.0:1746144910.022543:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b461c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1985:x1830965175431680:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 8630us (8855us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144910.022553:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4424 00002000:00100000:0.0:1746144910.022561:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1b:0x0] (8388608->9437183) req@ffff88009b461c00 x1830965175431680/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/440 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144910.022570:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b461c00 with x1830965175431680 ext(8388608->9437183) 00002000:00010000:0.0:1746144910.022574:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b461c00 00000100:00100000:0.0:1746144910.030965:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.031003:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.031132:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175432192 00000100:00100000:2.0:1746144910.031139:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175432192 00002000:00100000:2.0:1746144910.031171:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1b:0x0] (9437184->10485759) req@ffff880135ea5f80 x1830965175432192/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.031177:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5f80 with x1830965175432192 ext(9437184->10485759) 00002000:00010000:2.0:1746144910.031181:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ea5f80 00000100:00100000:2.0:1746144910.031198:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175432064 00000100:00100000:2.0:1746144910.031200:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175432064 00002000:00100000:2.0:1746144910.031207:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1b:0x0] (9437184->10485759) req@ffff880135ea6d80 x1830965175432064/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.031215:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea6d80 with x1830965175432064 ext(9437184->10485759) 00000100:00100000:3.0:1746144910.031217:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4425 00002000:00010000:2.0:1746144910.031217:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea6d80 00000100:00100000:3.0:1746144910.031227:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1985:x1830965175432192:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144910.031283:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4426 00000100:00100000:2.0:1746144910.031286:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1984:x1830965175432064:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144910.047249:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1984:x1830965175432064:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 15953us (16236us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144910.047259:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4426 00002000:00100000:2.0:1746144910.047269:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1b:0x0] (9437184->10485759) req@ffff880135ea6d80 x1830965175432064/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/440 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.047278:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea6d80 with x1830965175432064 ext(9437184->10485759) 00002000:00010000:2.0:1746144910.047284:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea6d80 00000100:00100000:3.0:1746144910.049833:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1985:x1830965175432192:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 18599us (18865us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144910.049843:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4425 00002000:00100000:3.0:1746144910.049852:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1b:0x0] (9437184->10485759) req@ffff880135ea5f80 x1830965175432192/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/440 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.049860:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5f80 with x1830965175432192 ext(9437184->10485759) 00002000:00010000:3.0:1746144910.049865:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ea5f80 00000100:00100000:0.0:1746144910.055203:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.055254:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.055308:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175432448 00000100:00100000:2.0:1746144910.055316:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175432448 00002000:00100000:2.0:1746144910.055349:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1b:0x0] (10485760->11534335) req@ffff880135ea7100 x1830965175432448/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.055358:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea7100 with x1830965175432448 ext(10485760->11534335) 00002000:00010000:2.0:1746144910.055363:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ea7100 00000100:00100000:2.0:1746144910.055375:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175432704 00000100:00100000:2.0:1746144910.055376:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175432704 00002000:00100000:2.0:1746144910.055384:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1b:0x0] (10485760->11534335) req@ffff880135ea4a80 x1830965175432704/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.055390:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4a80 with x1830965175432704 ext(10485760->11534335) 00002000:00010000:2.0:1746144910.055393:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea4a80 00000100:00100000:2.0:1746144910.055417:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4427 00000100:00100000:2.0:1746144910.055423:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1983:x1830965175432448:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144910.058093:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4428 00000100:00100000:3.0:1746144910.058110:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1983:x1830965175432704:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144910.070578:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.070981:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175432960 00000100:00100000:0.0:1746144910.070990:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175432960 00002000:00100000:0.0:1746144910.071024:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1b:0x0] (11534336->12582911) req@ffff88009bb4a300 x1830965175432960/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144910.071034:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4a300 with x1830965175432960 ext(11534336->12582911) 00002000:00010000:0.0:1746144910.071039:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb4a300 00000100:00100000:0.0:1746144910.071066:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4429 00000100:00100000:0.0:1746144910.071072:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1982:x1830965175432960:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144910.072363:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1983:x1830965175432448:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 16933us (17162us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144910.072375:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4427 00002000:00100000:3.0:1746144910.072384:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1b:0x0] (10485760->11534335) req@ffff880135ea7100 x1830965175432448/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/440 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.072392:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea7100 with x1830965175432448 ext(10485760->11534335) 00002000:00010000:3.0:1746144910.072396:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ea7100 00000100:00100000:3.0:1746144910.080609:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1983:x1830965175432704:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 22493us (25343us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144910.080620:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4428 00002000:00100000:3.0:1746144910.080632:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1b:0x0] (10485760->11534335) req@ffff880135ea4a80 x1830965175432704/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/440 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.080641:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4a80 with x1830965175432704 ext(10485760->11534335) 00002000:00010000:3.0:1746144910.080645:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea4a80 00000100:00100000:0.0:1746144910.082343:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1982:x1830965175432960:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 11266us (11767us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144910.082350:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4429 00002000:00100000:0.0:1746144910.082357:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1b:0x0] (11534336->12582911) req@ffff88009bb4a300 x1830965175432960/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/440 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144910.082371:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb4a300 with x1830965175432960 ext(11534336->12582911) 00002000:00010000:0.0:1746144910.082375:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb4a300 00000100:00100000:0.0:1746144910.090506:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.090611:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175433216 00000100:00100000:2.0:1746144910.090619:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175433216 00002000:00100000:2.0:1746144910.090657:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1b:0x0] (11534336->12582911) req@ffff880135ea4000 x1830965175433216/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.090666:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4000 with x1830965175433216 ext(11534336->12582911) 00002000:00010000:2.0:1746144910.090671:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea4000 00000100:00100000:2.0:1746144910.091891:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4430 00000100:00100000:2.0:1746144910.091901:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1985:x1830965175433216:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144910.101251:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1985:x1830965175433216:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 9342us (10742us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144910.101261:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4430 00002000:00100000:0.0:1746144910.101271:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1b:0x0] (11534336->12582911) req@ffff880135ea4000 x1830965175433216/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/440 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144910.101284:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea4000 with x1830965175433216 ext(11534336->12582911) 00002000:00010000:0.0:1746144910.101289:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135ea4000 00000100:00100000:0.0:1746144910.107296:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.107395:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175433472 00000100:00100000:2.0:1746144910.107403:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175433472 00002000:00100000:2.0:1746144910.107439:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1b:0x0] (12582912->13631487) req@ffff880135ea7480 x1830965175433472/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.107448:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea7480 with x1830965175433472 ext(12582912->13631487) 00002000:00010000:2.0:1746144910.107453:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ea7480 00000100:00100000:2.0:1746144910.107484:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4431 00000100:00100000:2.0:1746144910.107490:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1984:x1830965175433472:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144910.118700:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1984:x1830965175433472:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 11202us (11403us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144910.118711:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4431 00002000:00100000:2.0:1746144910.118721:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1b:0x0] (12582912->13631487) req@ffff880135ea7480 x1830965175433472/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/440 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.118730:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea7480 with x1830965175433472 ext(12582912->13631487) 00002000:00010000:2.0:1746144910.118737:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ea7480 00000100:00100000:0.0:1746144910.123745:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.124609:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175433728 00000100:00100000:3.0:1746144910.124617:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175433728 00000100:00100000:3.0:1746144910.124663:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 168 00000100:00100000:3.0:1746144910.124670:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1122:x1830965175433728:12345-192.168.202.16@tcp:35:cmp.0 00000100:00100000:3.0:1746144910.125219:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1122:x1830965175433728:12345-192.168.202.16@tcp:35:cmp.0 Request processed in 548us (1481us total) trans 4294987531 rc 0/0 00000100:00100000:3.0:1746144910.125225:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 168 00000100:00080000:2.0:1746144910.125408:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746144910.132080:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.132169:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175433984 00000100:00100000:3.0:1746144910.132177:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175433984 00000100:00100000:3.0:1746144910.132332:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 169 00000100:00100000:3.0:1746144910.132339:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1122:x1830965175433984:12345-192.168.202.16@tcp:35:cmp.0 00000100:00100000:3.0:1746144910.133068:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+19:1122:x1830965175433984:12345-192.168.202.16@tcp:35:cmp.0 Request processed in 726us (992us total) trans 4294987532 rc 0/0 00000100:00100000:3.0:1746144910.133074:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 169 00000100:00100000:2.0:1746144910.148320:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.148386:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.148430:0:7117:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175434368 00000100:00100000:0.0:1746144910.148437:0:7117:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175434368 00000100:00100000:3.0:1746144910.148781:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175434240 00000100:00100000:3.0:1746144910.148785:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175434240 00000100:00100000:3.0:1746144910.148830:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48270 00000100:00100000:3.0:1746144910.148836:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1123:x1830965175434240:12345-192.168.202.16@tcp:36:rm.0 00010000:00010000:3.0:1746144910.149278:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1746144910.149299:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf22800/0x4076af6727516002 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ab expref: 25 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.149328:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a800/0x4076af6727515d8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95542 expref: 24 pid: 21076 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144910.149375:0:7117:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:0.0:1746144910.149381:0:7117:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1982:x1830965175434368:12345-192.168.202.16@tcp:63:ll_sa.0 00010000:00010000:0.0:1746144910.149398:0:7117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144910.149408:0:7117:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a939000/0x4076af67275160a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9560d expref: -99 pid: 7117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.149437:0:7117:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a939c00/0x4076af67275160aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144910.149447:0:7117:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a939c00/0x4076af67275160aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144910.149455:0:7117:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a939c00/0x4076af67275160aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144910.149465:0:7117:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af67275160b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144910.149470:0:7117:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af67275160b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144910.149475:0:7117:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af67275160b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7117 initiator: MDT0 00010000:00010000:3.0:1746144910.149658:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff88009a8b7c00) 00010000:00010000:3.0:1746144910.149669:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880094199a00/0x4076af6727515fe6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955a4 expref: 24 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.149676:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbcac00) 00010000:00010000:3.0:1746144910.149677:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144910.149685:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144910.149692:0:7111:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af672751601e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955c0 expref: 18 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.149698:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144910.149723:0:7111:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af672751601e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955c0 expref: 18 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.149734:0:7111:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af672751601e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955c0 expref: 18 pid: 7111 timeout: 604 lvb_type: 0 00000100:00100000:3.0:1746144910.149743:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135eaad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7111:1830965172543872:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144910.149843:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008bae7b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746144910.150530:0:7117:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a939c00/0x4076af67275160aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.150537:0:7117:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a939c00/0x4076af67275160aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.150542:0:7117:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a939c00/0x4076af67275160aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.150668:0:7117:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a939c00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144910.150672:0:7117:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a939c00/0x4076af67275160aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.150678:0:7117:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a939c00/0x4076af67275160aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.150686:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbcac00) 00010000:00010000:1.0:1746144910.150688:0:7117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144910.150690:0:7117:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.150695:0:7117:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a939c00/0x4076af67275160aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.150699:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a939c00/0x4076af67275160aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.150926:0:7117:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af67275160b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.150931:0:7117:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af67275160b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.150935:0:7117:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af67275160b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.150939:0:7117:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012cf07400 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144910.150941:0:7117:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af67275160b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.150946:0:7117:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af67275160b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.150955:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce70cf (ffff88009282c600) 00010000:00010000:1.0:1746144910.150957:0:7117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144910.150959:0:7117:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af67275160b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.150963:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07400/0x4076af67275160b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.151001:0:7117:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a939000/0x4076af67275160a3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9560d expref: 23 pid: 7117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.151009:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbcac00) 00010000:00010000:1.0:1746144910.151011:0:7117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746144910.151012:0:7117:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.151018:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a939000/0x4076af67275160a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9560d expref: 23 pid: 7117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.151024:0:7117:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a939000, rc -2) 00000100:00100000:1.0:1746144910.151723:0:7117:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1982:x1830965175434368:12345-192.168.202.16@tcp:63:ll_sa.0 Request processed in 2339us (3334us total) trans 0 rc -2/-2 00000100:00100000:1.0:1746144910.151735:0:7117:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5 00000100:00100000:0.0:1746144910.153082:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135eaad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7111:1830965172543872:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144910.153100:0:7111:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000100:00100000:3.0:1746144910.154952:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.154996:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175434496 00000100:00100000:0.0:1746144910.155003:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175434496 00010000:00010000:0.0:1746144910.155030:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af672751601e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955c0 expref: 19 pid: 7111 timeout: 604 lvb_type: 0 00000100:00100000:0.0:1746144910.156641:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11289 00000100:00100000:1.0:1746144910.156684:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+19:1984:x1830965175434496:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144910.156699:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144910.156707:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af672751601e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955c0 expref: 19 pid: 7111 timeout: 604 lvb_type: 0 00010000:00010000:1.0:1746144910.156723:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af672751601e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955c0 expref: 19 pid: 7111 timeout: 604 lvb_type: 0 00010000:00010000:1.0:1746144910.157007:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a6b400/0x4076af672751601e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955c0 expref: 19 pid: 7111 timeout: 604 lvb_type: 0 00010000:00010000:1.0:1746144910.157022:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbcac00) 00010000:00010000:1.0:1746144910.157026:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.157033:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.157038:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.157053:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144910.157090:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1984:x1830965175434496:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 439us (2143us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144910.157096:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11289 00010000:00010000:0.0:1746144910.158275:0:7111:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144910.158286:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144910.158304:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30e00/0x4076af67275160bf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144910.158312:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30e00/0x4076af67275160bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144910.158320:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30e00/0x4076af67275160bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144910.158575:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30200/0x4076af67275160c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144910.158586:0:7111:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07800/0x4076af6727515e18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9556c expref: 17 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.158592:0:7111:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30200/0x4076af67275160c6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144910.158620:0:7111:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07800/0x4076af6727515e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9556c expref: 17 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.158632:0:7111:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07800/0x4076af6727515e18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9556c expref: 17 pid: 7111 timeout: 604 lvb_type: 0 00000100:00100000:0.0:1746144910.158643:0:7111:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7111:1830965172544000:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144910.159145:0:7111:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800876b3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144910.161086:0:7111:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea5180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7111:1830965172544000:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144910.161106:0:7111:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30200/0x4076af67275160c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000100:00100000:0.0:1746144910.161668:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.161858:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175434624 00000100:00100000:1.0:1746144910.161864:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175434624 00010000:00010000:1.0:1746144910.161888:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07800/0x4076af6727515e18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9556c expref: 18 pid: 7111 timeout: 604 lvb_type: 0 00000100:00100000:1.0:1746144910.161918:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11290 00000100:00100000:1.0:1746144910.161924:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1985:x1830965175434624:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144910.161934:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144910.161939:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07800/0x4076af6727515e18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9556c expref: 18 pid: 7111 timeout: 604 lvb_type: 0 00010000:00010000:1.0:1746144910.161947:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07800/0x4076af6727515e18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9556c expref: 18 pid: 7111 timeout: 604 lvb_type: 0 00010000:00010000:1.0:1746144910.161963:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012cf07800/0x4076af6727515e18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9556c expref: 18 pid: 7111 timeout: 604 lvb_type: 0 00010000:00010000:1.0:1746144910.161973:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff88009a8b7c00) 00010000:00010000:1.0:1746144910.161976:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30200/0x4076af67275160c6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.161983:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30200/0x4076af67275160c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.161988:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30200/0x4076af67275160c6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.162000:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144910.162038:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1985:x1830965175434624:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 113us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144910.162044:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11290 00010000:00010000:0.0:1746144910.162797:0:7111:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30200/0x4076af67275160c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144910.162804:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30200/0x4076af67275160c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000040:00080000:0.0:1746144910.163403:0:7111:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].13, 64 off9024 00000004:00080000:0.0:1746144910.163410:0:7111:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 504310646638ns, next at 505310645267ns, rc = 0 00000040:00080000:0.0:1746144910.163435:0:7111:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].14, 64 off9088 00000004:00080000:0.0:1746144910.163438:0:7111:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 504310675063ns, next at 505310674400ns, rc = 0 00010000:00010000:0.0:1746144910.163487:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ac00/0x4076af67275160cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144910.163495:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ac00/0x4076af67275160cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144910.163502:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ac00/0x4076af67275160cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144910.163507:0:7111:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ac00/0x4076af67275160cd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144910.163512:0:7111:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ac00/0x4076af67275160cd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144910.163516:0:7111:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ac00/0x4076af67275160cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7111 initiator: MDT0 00010000:00010000:0.0:1746144910.164214:0:7111:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1746144910.164336:0:8446:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746144910.164342:0:8446:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ac00/0x4076af67275160cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144910.164348:0:8446:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009170ac00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144910.164351:0:8446:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ac00/0x4076af67275160cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144910.164356:0:8446:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ac00/0x4076af67275160cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144910.164365:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff88009a8b7c00) 00010000:00010000:2.0:1746144910.164368:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1746144910.164370:0:8446:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ac00/0x4076af67275160cd lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144910.164375:0:8446:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009170ac00/0x4076af67275160cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.164458:0:7111:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30200/0x4076af67275160c6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.164464:0:7111:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30200/0x4076af67275160c6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.164468:0:7111:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30200/0x4076af67275160c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.164472:0:7111:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad30200 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144910.164475:0:7111:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30200/0x4076af67275160c6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.164479:0:7111:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30200/0x4076af67275160c6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.164485:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff88009a8b7c00) 00010000:00010000:1.0:1746144910.164487:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746144910.164489:0:7111:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30200/0x4076af67275160c6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.164493:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30200/0x4076af67275160c6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.164540:0:7111:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.164544:0:7111:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.164548:0:7111:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.164552:0:7111:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093167600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144910.164554:0:7111:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.164558:0:7111:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.164563:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbcac00) 00010000:00010000:1.0:1746144910.164565:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144910.164567:0:7111:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.164574:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160b8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00000004:00010000:1.0:1746144910.164588:0:7111:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009b462680 reply state ffff880091a18000 transno 4294987533 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30e00/0x4076af67275160bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000100:00100000:1.0:1746144910.164593:0:7111:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746144910.164658:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1123:x1830965175434240:12345-192.168.202.16@tcp:36:rm.0 Request processed in 15819us (16342us total) trans 4294987533 rc 0/0 00000100:00100000:1.0:1746144910.164665:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48270 00010000:00010000:2.0:1746144910.164731:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746144910.164732:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746144910.164734:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746144910.168612:0:3292:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30e00/0x4076af67275160bf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144910.168623:0:3292:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30e00/0x4076af67275160bf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144910.168629:0:3292:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30e00/0x4076af67275160bf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144910.168634:0:3292:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad30e00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144910.168637:0:3292:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30e00/0x4076af67275160bf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144910.168643:0:3292:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30e00/0x4076af67275160bf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144910.168655:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff88009282c400) 00010000:00010000:3.0:1746144910.168657:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144910.168659:0:3292:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30e00/0x4076af67275160bf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144910.168663:0:3292:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad30e00/0x4076af67275160bf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00000100:00100000:0.0:1746144910.208743:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.209862:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175434752 00000100:00100000:1.0:1746144910.209870:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175434752 00000100:00100000:1.0:1746144910.209913:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48271 00000100:00100000:1.0:1746144910.209920:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+22:1126:x1830965175434752:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1746144910.209940:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144910.209954:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b200/0x4076af67275160d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95645 expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.210045:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82a200/0x4076af67275160db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.210054:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82a200/0x4076af67275160db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.210063:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82a200/0x4076af67275160db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:1.0:1746144910.210102:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:1.0:1746144910.210104:0:7111:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 28 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144910.210116:0:7111:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82a200/0x4076af67275160db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.210133:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b200/0x4076af67275160d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95645 expref: 24 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.210154:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82a200/0x4076af67275160db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95645 expref: 23 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.210161:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca200) 00010000:00010000:1.0:1746144910.210163:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746144910.210166:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b82a200, rc 0) 00000100:00100000:1.0:1746144910.211715:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1126:x1830965175434752:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1788us (2972us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144910.211723:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48271 00000100:00100000:0.0:1746144910.214688:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.215110:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175435008 00000100:00100000:1.0:1746144910.215118:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175435008 00000100:00100000:1.0:1746144910.215162:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48272 00000100:00100000:1.0:1746144910.215169:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+23:1126:x1830965175435008:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1746144910.215186:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144910.215189:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746144910.215210:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82a200/0x4076af67275160db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95645 expref: 23 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.215226:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca200) 00010000:00010000:1.0:1746144910.215232:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144910.215241:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82be00/0x4076af67275160e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9564c expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.215334:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82ba00/0x4076af67275160e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.215344:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82ba00/0x4076af67275160e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.215351:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82ba00/0x4076af67275160e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.215360:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160f0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.215365:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.215370:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.215704:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929f2800/0x4076af67275160f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.215711:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800929f2800/0x4076af67275160f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.215716:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929f2800/0x4076af67275160f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:1.0:1746144910.215724:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 0 00010000:00010000:1.0:1746144910.215738:0:7111:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82ba00/0x4076af67275160e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.215743:0:7111:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82ba00/0x4076af67275160e9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.215748:0:7111:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82ba00/0x4076af67275160e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.215752:0:7111:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b82ba00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144910.215756:0:7111:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82ba00/0x4076af67275160e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.215779:0:7111:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82ba00/0x4076af67275160e9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.215794:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbcab00) 00010000:00010000:1.0:1746144910.215796:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144910.215799:0:7111:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82ba00/0x4076af67275160e9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.215803:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82ba00/0x4076af67275160e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00000004:00010000:1.0:1746144910.215811:0:7111:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800932a9880 reply state ffff8801351ad000 transno 4294987534 ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000100:00100000:1.0:1746144910.215815:0:7111:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746144910.215831:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82be00/0x4076af67275160e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9564c expref: 25 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.215841:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929f2800/0x4076af67275160f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9564c expref: 24 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.215846:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff88009bbca900) 00010000:00010000:1.0:1746144910.215847:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144910.215849:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929f2800, rc 0) 00000100:00100000:1.0:1746144910.215888:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1126:x1830965175435008:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 719us (1208us total) trans 4294987534 rc 0/0 00000100:00100000:1.0:1746144910.215894:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48272 00010000:00010000:2.0:1746144910.219432:0:3293:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144910.219444:0:3293:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160f0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144910.219450:0:3293:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160f0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144910.219458:0:3293:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093167600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144910.219462:0:3293:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160f0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144910.219468:0:3293:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160f0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144910.219479:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff88009bbca500) 00010000:00010000:2.0:1746144910.219482:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144910.219484:0:3293:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160f0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144910.219488:0:3293:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af67275160f0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00000100:00100000:0.0:1746144910.222595:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.222683:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175435264 00000100:00100000:2.0:1746144910.222690:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175435264 00000100:00100000:2.0:1746144910.222728:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48273 00000100:00100000:2.0:1746144910.222734:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1126:x1830965175435264:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1746144910.222752:0:21076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144910.222785:0:21076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092553000/0x4076af6727516105 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95653 expref: -99 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.222857:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092553c00/0x4076af672751610c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.222867:0:21076:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929f2800/0x4076af67275160f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9564c expref: 25 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.222873:0:21076:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092553c00/0x4076af672751610c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.222897:0:21076:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800929f2800/0x4076af67275160f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9564c expref: 25 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.222907:0:21076:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800929f2800/0x4076af67275160f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9564c expref: 25 pid: 7111 timeout: 604 lvb_type: 0 00000100:00100000:2.0:1746144910.222917:0:21076:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b462d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21076:1830965172544128:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144910.222987:0:21076:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43800c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144910.225072:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.225133:0:21076:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b462d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:21076:1830965172544128:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144910.225150:0:21076:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880092553c00/0x4076af672751610c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000100:00100000:0.0:1746144910.225189:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175435392 00000100:00100000:0.0:1746144910.225194:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175435392 00010000:00010000:0.0:1746144910.225215:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800929f2800/0x4076af67275160f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9564c expref: 26 pid: 7111 timeout: 604 lvb_type: 0 00000100:00100000:0.0:1746144910.225239:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11291 00000100:00100000:0.0:1746144910.225244:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1985:x1830965175435392:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144910.225253:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144910.225257:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800929f2800/0x4076af67275160f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9564c expref: 26 pid: 7111 timeout: 604 lvb_type: 0 00010000:00010000:0.0:1746144910.225265:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800929f2800/0x4076af67275160f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9564c expref: 26 pid: 7111 timeout: 604 lvb_type: 0 00010000:00010000:0.0:1746144910.225280:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929f2800/0x4076af67275160f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9564c expref: 26 pid: 7111 timeout: 604 lvb_type: 0 00010000:00010000:0.0:1746144910.225294:0:7098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff88009bbca900) 00010000:00010000:0.0:1746144910.225298:0:7098:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880092553c00/0x4076af672751610c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144910.225304:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092553c00/0x4076af672751610c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144910.225308:0:7098:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092553c00/0x4076af672751610c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 21076 initiator: MDT0 00010000:00010000:0.0:1746144910.225318:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144910.225343:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1985:x1830965175435392:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 99us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144910.225348:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11291 00010000:00010000:3.0:1746144910.225678:0:21076:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880092553c00/0x4076af672751610c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144910.225684:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092553c00/0x4076af672751610c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000004:00200000:3.0:1746144910.225698:0:21076:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 0 00000004:00080000:3.0:1746144910.225938:0:21076:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c:0x0], index 0: 0 00000004:00080000:3.0:1746144910.225944:0:21076:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d:0x0], index 1: 0 00010000:00010000:3.0:1746144910.226028:0:21076:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880092553c00/0x4076af672751610c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144910.226034:0:21076:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092553c00/0x4076af672751610c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144910.226039:0:21076:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092553c00/0x4076af672751610c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144910.226043:0:21076:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092553c00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144910.226046:0:21076:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092553c00/0x4076af672751610c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144910.226051:0:21076:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092553c00/0x4076af672751610c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144910.226057:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff88009bbca900) 00010000:00010000:3.0:1746144910.226059:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144910.226061:0:21076:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092553c00/0x4076af672751610c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144910.226065:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092553c00/0x4076af672751610c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144910.226104:0:21076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092553000/0x4076af6727516105 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95653 expref: 25 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.226110:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092553000/0x4076af6727516105 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95653 expref: 25 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.226118:0:21076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092553000, rc 0) 00000100:00100000:3.0:1746144910.226151:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1126:x1830965175435264:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 3417us (3563us total) trans 4294987535 rc 301/301 00000100:00100000:3.0:1746144910.226156:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48273 00000100:00100000:3.0:1746144910.228510:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.228573:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175435648 00000100:00100000:0.0:1746144910.228579:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175435648 00000100:00100000:0.0:1746144910.228623:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 170 00000100:00100000:0.0:1746144910.228630:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+24:1126:x1830965175435648:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:0.0:1746144910.228905:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1126:x1830965175435648:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 274us (400us total) trans 4294987536 rc 0/0 00000100:00100000:0.0:1746144910.228911:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 170 00000100:00100000:0.0:1746144910.230933:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.230991:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175435776 00000100:00100000:3.0:1746144910.230997:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175435776 00000100:00100000:3.0:1746144910.231411:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48274 00000100:00100000:3.0:1746144910.231418:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+25:1126:x1830965175435776:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1746144910.231437:0:21076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144910.231453:0:21076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3200/0x4076af672751611a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9565a expref: -99 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.231495:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3200/0x4076af672751611a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9565a expref: 26 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.231505:0:21076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3200/0x4076af672751611a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9565a expref: 26 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.231518:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff88009a8b7e00) 00010000:00010000:3.0:1746144910.231520:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746144910.231523:0:21076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b3200, rc 0) 00000100:00100000:3.0:1746144910.231569:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1126:x1830965175435776:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 150us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144910.231574:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48274 00000100:00100000:0.0:1746144910.233554:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.233638:0:7114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175436032 00000100:00100000:2.0:1746144910.233644:0:7114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175436032 00000100:00100000:2.0:1746144910.233681:0:7114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 171 00000100:00100000:2.0:1746144910.233687:0:7114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+26:1126:x1830965175436032:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:2.0:1746144910.233862:0:7114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1126:x1830965175436032:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 175us (314us total) trans 4294987537 rc 0/0 00000100:00100000:2.0:1746144910.233868:0:7114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 171 00000100:00100000:2.0:1746144910.247880:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.248072:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175436160 00000100:00100000:1.0:1746144910.248081:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175436160 00000100:00100000:1.0:1746144910.248124:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48275 00000100:00100000:1.0:1746144910.248131:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+27:1127:x1830965175436160:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1746144910.248150:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144910.248164:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82a200/0x4076af6727516121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95661 expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.248206:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b200/0x4076af6727516128 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.248350:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b200/0x4076af6727516128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.248360:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b200/0x4076af6727516128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:1.0:1746144910.248406:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:1.0:1746144910.248408:0:7111:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144910.248420:0:7111:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b200/0x4076af6727516128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.248436:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82a200/0x4076af6727516121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95661 expref: 29 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.248542:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b200/0x4076af6727516128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95661 expref: 28 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.248549:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:1.0:1746144910.248551:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746144910.248553:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b82b200, rc 0) 00000100:00100000:1.0:1746144910.248748:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1127:x1830965175436160:12345-192.168.202.16@tcp:101:dd.0 Request processed in 617us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144910.248757:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48275 00000100:00100000:0.0:1746144910.250321:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.250409:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175436288 00000100:00100000:1.0:1746144910.250415:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175436288 00000100:00100000:1.0:1746144910.250450:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48276 00000100:00100000:1.0:1746144910.250456:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1128:x1830965175436288:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1746144910.250472:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144910.250483:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b600/0x4076af672751612f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95668 expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.250518:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82ba00/0x4076af6727516136 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.250526:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82ba00/0x4076af6727516136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.250533:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82ba00/0x4076af6727516136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:1.0:1746144910.250568:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:1.0:1746144910.250571:0:7111:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144910.250582:0:7111:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82ba00/0x4076af6727516136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.250595:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b600/0x4076af672751612f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95668 expref: 19 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.250607:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82ba00/0x4076af6727516136 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95668 expref: 18 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.250613:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:1.0:1746144910.250616:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746144910.250618:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b82ba00, rc 0) 00000100:00100000:1.0:1746144910.250655:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1128:x1830965175436288:12345-192.168.202.16@tcp:101:dd.0 Request processed in 199us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144910.250661:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48276 00000100:00100000:0.0:1746144910.252842:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.253514:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175436544 00000100:00100000:3.0:1746144910.253520:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175436544 00000100:00100000:3.0:1746144910.253555:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48277 00000100:00100000:3.0:1746144910.253561:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1128:x1830965175436544:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:3.0:1746144910.253575:0:21076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144910.253588:0:21076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af672751613d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9566f expref: -99 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.253652:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2600/0x4076af6727516144 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144910.253662:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2600/0x4076af6727516144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:3.0:1746144910.253670:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2600/0x4076af6727516144 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000004:00200000:3.0:1746144910.253677:0:21076:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 26214400 00010000:00010000:3.0:1746144910.253810:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2c00/0x4076af672751613d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9566f expref: 21 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.253826:0:21076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2600/0x4076af6727516144 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9566f expref: 20 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.253833:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca000) 00010000:00010000:3.0:1746144910.253835:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144910.253838:0:21076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800931b2600, rc 0) 00000100:00100000:3.0:1746144910.253870:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1128:x1830965175436544:12345-192.168.202.16@tcp:101:dd.0 Request processed in 309us (1034us total) trans 4294987538 rc 0/0 00000100:00100000:3.0:1746144910.253876:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48277 00000100:00100000:0.0:1746144910.254346:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.254436:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175436800 00000100:00100000:1.0:1746144910.254440:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175436800 00000100:00100000:1.0:1746144910.254459:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48278 00000100:00100000:1.0:1746144910.254464:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+28:1127:x1830965175436800:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1746144910.254471:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144910.254473:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746144910.254485:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82b200/0x4076af6727516128 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95661 expref: 28 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.254496:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:1.0:1746144910.254499:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144910.254504:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82a200/0x4076af6727516152 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af956a7 expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.254543:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727516159 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.254549:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727516159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144910.254555:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727516159 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:1.0:1746144910.254561:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 26214400 00010000:00010000:1.0:1746144910.254608:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82a200/0x4076af6727516152 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956a7 expref: 30 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.254618:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727516159 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956a7 expref: 29 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.254623:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff880099b35800) 00010000:00010000:1.0:1746144910.254625:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144910.254626:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880093167600, rc 0) 00000100:00100000:1.0:1746144910.254647:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+29:1127:x1830965175436800:12345-192.168.202.16@tcp:101:dd.0 Request processed in 182us (302us total) trans 4294987539 rc 0/0 00000100:00100000:1.0:1746144910.254652:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48278 00000100:00100000:0.0:1746144910.258608:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.258821:0:7117:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175436928 00000100:00100000:1.0:1746144910.258828:0:7117:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175436928 00000100:00100000:1.0:1746144910.258860:0:7117:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:1.0:1746144910.258866:0:7117:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+29:1983:x1830965175436928:12345-192.168.202.16@tcp:63:ll_sa.0 00010000:00010000:1.0:1746144910.258891:0:7117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144910.258903:0:7117:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82be00/0x4076af6727516167 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95676 expref: -99 pid: 7117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.258943:0:7117:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093d00200/0x4076af672751616e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.258953:0:7117:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093d00200/0x4076af672751616e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.258962:0:7117:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093d00200/0x4076af672751616e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.258972:0:7117:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a800/0x4076af6727516175 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.258981:0:7117:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a800/0x4076af6727516175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.258985:0:7117:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a800/0x4076af6727516175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259069:0:7117:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a400/0x4076af672751617c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259075:0:7117:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a400/0x4076af672751617c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259081:0:7117:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a400/0x4076af672751617c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7117 initiator: MDT0 00000004:00200000:1.0:1746144910.259095:0:7117:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 0 00000004:00200000:1.0:1746144910.259099:0:7117:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144910.259112:0:7117:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a400/0x4076af672751617c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259125:0:7117:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a400/0x4076af672751617c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259131:0:7117:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093d00200/0x4076af672751616e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259137:0:7117:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093d00200/0x4076af672751616e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259142:0:7117:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880093d00200/0x4076af672751616e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259146:0:7117:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880093d00200 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144910.259150:0:7117:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093d00200/0x4076af672751616e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259156:0:7117:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880093d00200/0x4076af672751616e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259164:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:1.0:1746144910.259166:0:7117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144910.259169:0:7117:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880093d00200/0x4076af672751616e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259173:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093d00200/0x4076af672751616e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259183:0:7117:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a800/0x4076af6727516175 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259187:0:7117:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a800/0x4076af6727516175 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259192:0:7117:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a800/0x4076af6727516175 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259195:0:7117:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009930a800 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144910.259197:0:7117:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a800/0x4076af6727516175 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259201:0:7117:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a800/0x4076af6727516175 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259206:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff88009bbca800) 00010000:00010000:1.0:1746144910.259208:0:7117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144910.259210:0:7117:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a800/0x4076af6727516175 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259214:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a800/0x4076af6727516175 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259234:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82be00/0x4076af6727516167 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95676 expref: 31 pid: 7117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.259243:0:7117:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a400/0x4076af672751617c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95676 expref: 30 pid: 7117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.259249:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff88009a8b7e00) 00010000:00010000:1.0:1746144910.259250:0:7117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144910.259252:0:7117:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009930a400, rc 0) 00010000:00010000:1.0:1746144910.259255:0:7117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144910.259261:0:7117:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091750a00/0x4076af6727516183 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9567d expref: -99 pid: 7117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.259275:0:7117:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091750e00/0x4076af672751618a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259280:0:7117:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091750e00/0x4076af672751618a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259286:0:7117:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091750e00/0x4076af672751618a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7117 initiator: MDT0 00000100:00100000:3.0:1746144910.259290:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:1.0:1746144910.259292:0:7117:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af6727516191 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259297:0:7117:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af6727516191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259301:0:7117:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af6727516191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259320:0:7117:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091750e00/0x4076af672751618a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259325:0:7117:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091750e00/0x4076af672751618a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259330:0:7117:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091750e00/0x4076af672751618a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259333:0:7117:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091750e00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144910.259335:0:7117:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091750e00/0x4076af672751618a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259340:0:7117:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091750e00/0x4076af672751618a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259345:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:1.0:1746144910.259347:0:7117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144910.259349:0:7117:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091750e00/0x4076af672751618a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259352:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091750e00/0x4076af672751618a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259359:0:7117:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af6727516191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259363:0:7117:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af6727516191 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259367:0:7117:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af6727516191 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259370:0:7117:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091750200 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144910.259372:0:7117:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af6727516191 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259380:0:7117:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af6727516191 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259386:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce70cf (ffff88009bbcac00) 00010000:00010000:1.0:1746144910.259387:0:7117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144910.259389:0:7117:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af6727516191 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259393:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af6727516191 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7117 initiator: MDT0 00010000:00010000:1.0:1746144910.259415:0:7117:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff880091750a00/0x4076af6727516183 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9567d expref: 31 pid: 7117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.259422:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:1.0:1746144910.259424:0:7117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746144910.259426:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091750a00/0x4076af6727516183 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9567d expref: 31 pid: 7117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.259432:0:7117:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091750a00, rc -2) 00000100:00100000:1.0:1746144910.259471:0:7117:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1983:x1830965175436928:12345-192.168.202.16@tcp:63:ll_sa.0 Request processed in 604us (869us total) trans 0 rc -2/-2 00000100:00100000:1.0:1746144910.259477:0:7117:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 6 00000100:00100000:3.0:1746144910.259648:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.259689:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175437312 00000100:00100000:1.0:1746144910.259693:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175437312 00000100:00100000:1.0:1746144910.259718:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 295 00000100:00100000:1.0:1746144910.259723:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1982:x1830965175437312:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144910.259730:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746144910.261674:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175437184 00000100:00100000:2.0:1746144910.261681:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175437184 00000100:00100000:2.0:1746144910.261713:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48279 00000100:00100000:2.0:1746144910.261719:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+21:1128:x1830965175437184:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1746144910.261736:0:21076:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144910.261738:0:21076:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746144910.261754:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b82ba00/0x4076af6727516136 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95668 expref: 21 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.261797:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:2.0:1746144910.261805:0:21076:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746144910.261818:0:21076:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092552a00/0x4076af6727516198 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af956b5 expref: -99 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.261919:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092553a00/0x4076af672751619f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.261927:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092553a00/0x4076af672751619f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.261934:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092553a00/0x4076af672751619f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.261942:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092552000/0x4076af67275161a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.261947:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092552000/0x4076af67275161a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.261952:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092552000/0x4076af67275161a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.261991:0:21076:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092553e00/0x4076af67275161ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.261997:0:21076:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092553e00/0x4076af67275161ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.262002:0:21076:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092553e00/0x4076af67275161ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 21076 initiator: MDT0 00000004:00200000:2.0:1746144910.262013:0:21076:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 0 00010000:00010000:2.0:1746144910.262068:0:21076:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092553a00/0x4076af672751619f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.262074:0:21076:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092553a00/0x4076af672751619f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.262079:0:21076:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092553a00/0x4076af672751619f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.262083:0:21076:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092553a00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144910.262085:0:21076:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092553a00/0x4076af672751619f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.262089:0:21076:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092553a00/0x4076af672751619f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.262095:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a47e0d00) 00010000:00010000:2.0:1746144910.262097:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144910.262099:0:21076:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092553a00/0x4076af672751619f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.262103:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092553a00/0x4076af672751619f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.262110:0:21076:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880092552000/0x4076af67275161a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.262115:0:21076:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092552000/0x4076af67275161a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.262119:0:21076:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092552000/0x4076af67275161a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.262126:0:21076:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092552000 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144910.262128:0:21076:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092552000/0x4076af67275161a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.262133:0:21076:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092552000/0x4076af67275161a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.262137:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff8800a47e0c00) 00010000:00010000:2.0:1746144910.262139:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144910.262141:0:21076:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092552000/0x4076af67275161a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.262145:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092552000/0x4076af67275161a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 21076 initiator: MDT0 00010000:00010000:2.0:1746144910.262168:0:21076:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092552a00/0x4076af6727516198 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956b5 expref: 23 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.262178:0:21076:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880092553e00/0x4076af67275161ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956b5 expref: 22 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.262183:0:21076:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff88009a8b7e00) 00010000:00010000:2.0:1746144910.262185:0:21076:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746144910.262187:0:21076:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092553e00, rc 0) 00000100:00100000:2.0:1746144910.262222:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135eaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+22:1128:x1830965175437184:12345-192.168.202.16@tcp:101:dd.0 Request processed in 503us (2934us total) trans 4294987540 rc 0/0 00000100:00100000:2.0:1746144910.262227:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48279 00000100:00100000:0.0:1746144910.262574:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.262589:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175437440 00000100:00100000:0.0:1746144910.262593:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175437440 00000100:00100000:0.0:1746144910.262621:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 296 00000100:00100000:0.0:1746144910.262626:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1985:x1830965175437440:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144910.262634:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144910.262643:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093167600/0x4076af6727516159 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956a7 expref: 30 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.262654:0:7098:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff880099b35800) 00010000:00010000:0.0:1746144910.262657:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144910.262670:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+29:1985:x1830965175437440:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 44us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144910.262674:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 296 00000100:00100000:0.0:1746144910.262712:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00010000:00010000:1.0:1746144910.262717:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b2600/0x4076af6727516144 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9566f expref: 21 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.262729:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca000) 00010000:00010000:1.0:1746144910.262732:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144910.262747:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.262751:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1982:x1830965175437312:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3028us (3103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144910.262756:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 295 00000100:00100000:0.0:1746144910.262800:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175437824 00000100:00100000:0.0:1746144910.262803:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175437824 00000100:00100000:0.0:1746144910.262838:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175437952 00000100:00100000:0.0:1746144910.262840:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175437952 00000100:00100000:1.0:1746144910.262849:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4432 00000100:00100000:1.0:1746144910.262855:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175437824:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:1.0:1746144910.262873:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af67275161bb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.262883:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.262884:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.262887:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af67275161bb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00080000:3.0:1746144910.262891:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746144910.262894:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746144910.262896:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af67275161bb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144910.263189:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4433 00000100:00100000:0.0:1746144910.263195:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175437952:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:0.0:1746144910.263212:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af67275161c2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.263220:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.263221:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.263224:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af67275161c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.263233:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af67275161c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144910.269351:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.269386:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.269450:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175438080 00000100:00100000:1.0:1746144910.269457:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175438080 00000100:00100000:1.0:1746144910.269483:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175438208 00000100:00100000:1.0:1746144910.269484:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175438208 00000100:00100000:1.0:1746144910.269496:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5891 00000100:00100000:1.0:1746144910.269501:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175438080:12345-192.168.202.16@tcp:101:ll_agl.0 00010000:00010000:1.0:1746144910.269514:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144910.269529:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091751600/0x4076af67275161c9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af956bc expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144910.269547:0:8432:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1746144910.269561:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.269563:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.269569:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091751600/0x4076af67275161c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956bc expref: 10 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144910.269580:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091751600/0x4076af67275161c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956bc expref: 10 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144910.269589:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091751600, rc 0) 00000100:00100000:1.0:1746144910.269631:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965175438080:12345-192.168.202.16@tcp:101:ll_agl.0 Request processed in 129us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144910.269636:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5891 00000100:00100000:1.0:1746144910.269649:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5892 00000100:00100000:1.0:1746144910.269653:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965175438208:12345-192.168.202.16@tcp:101:ll_agl.0 00010000:00010000:1.0:1746144910.269658:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144910.269666:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af67275161d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af956c3 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144910.269676:0:8432:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1746144910.269683:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.269684:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.269686:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af67275161d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956c3 expref: 11 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144910.269698:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af67275161d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956c3 expref: 11 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144910.269703:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091750c00, rc 0) 00000100:00100000:1.0:1746144910.269714:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1984:x1830965175438208:12345-192.168.202.16@tcp:101:ll_agl.0 Request processed in 61us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144910.269718:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5892 00010000:00010000:1.0:1746144910.277809:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af67275161bb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.277824:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af67275161bb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.277831:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af67275161bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.277836:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091750000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.277840:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af67275161bb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.277846:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af67275161bb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.277860:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af67275161bb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.277865:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091750000/0x4076af67275161bb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.277923:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175437824:12345-192.168.202.16@tcp:3:dd.0 Request processed in 15064us (15206us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144910.277932:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4432 00010000:00010000:1.0:1746144910.278550:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af67275161c2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.278558:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af67275161c2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.278563:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af67275161c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.278567:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad30200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.278570:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af67275161c2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.278575:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af67275161c2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.278583:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af67275161c2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.278588:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad30200/0x4076af67275161c2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.279609:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175437952:12345-192.168.202.16@tcp:3:dd.0 Request processed in 16409us (16856us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144910.279619:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4433 00000100:00100000:0.0:1746144910.281325:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.281385:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175438336 00000100:00100000:2.0:1746144910.281392:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175438336 00000100:00100000:2.0:1746144910.281422:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5893 00000100:00100000:2.0:1746144910.281427:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1128:x1830965175438336:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1746144910.281439:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144910.281452:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275161d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af956ca expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.281474:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091751600/0x4076af67275161c9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956bc expref: 7 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144910.281480:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144910.281482:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144910.281485:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275161d7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956ca expref: 27 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.281508:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091751600/0x4076af67275161c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956bc expref: 7 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144910.281518:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091751600/0x4076af67275161c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956bc expref: 7 pid: 8432 timeout: 604 lvb_type: 1 00000100:00100000:2.0:1746144910.281528:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172544256:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144910.282167:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b43800c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144910.284490:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.284988:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.285583:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b4fa300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8430:1830965172544256:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144910.285605:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275161d7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956ca expref: 27 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.285619:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880092553a00, rc 0) 00000100:00100000:3.0:1746144910.285650:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+27:1128:x1830965175438336:12345-192.168.202.16@tcp:101:dd.0 Request processed in 4223us (4825us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144910.285657:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5893 00000100:00100000:1.0:1746144910.285832:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175438720 00000100:00100000:1.0:1746144910.285837:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175438720 00000100:00100000:1.0:1746144910.285864:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175438592 00000100:00100000:1.0:1746144910.285866:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175438592 00000100:00100000:1.0:1746144910.285877:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4434 00000100:00100000:1.0:1746144910.285882:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175438720:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:1.0:1746144910.285906:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af67275161de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.285916:0:31844:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727515fd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9559d expref: 10 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.285922:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144910.285923:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144910.285926:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af67275161de lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.285946:0:31844:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727515fd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9559d expref: 10 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.285955:0:31844:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727515fd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9559d expref: 10 pid: 8433 timeout: 604 lvb_type: 0 00000100:00100000:1.0:1746144910.285965:0:31844:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009bb48000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:31844:1830965172544384:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144910.286003:0:31844:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4167600 going to sleep for 11 seconds 00000100:00100000:0.0:1746144910.286267:0:25029:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4435 00000100:00100000:0.0:1746144910.286274:0:25029:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175438592:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:0.0:1746144910.286287:0:25029:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b467600/0x4076af67275161e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.286294:0:25029:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144910.286295:0:25029:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746144910.286297:0:25029:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b467600/0x4076af67275161e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.286303:0:25029:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009b467600/0x4076af67275161e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.286664:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.286709:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175438976 00000100:00100000:3.0:1746144910.286712:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175438976 00010000:00010000:3.0:1746144910.286727:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091751600/0x4076af67275161c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956bc expref: 8 pid: 8432 timeout: 604 lvb_type: 1 00000100:00100000:3.0:1746144910.286743:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11292 00000100:00100000:3.0:1746144910.286747:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175438976:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144910.286754:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144910.286794:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091751600/0x4076af67275161c9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956bc expref: 8 pid: 8432 timeout: 604 lvb_type: 1 00010000:00010000:3.0:1746144910.286808:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091751600/0x4076af67275161c9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956bc expref: 8 pid: 8432 timeout: 604 lvb_type: 1 00010000:00010000:3.0:1746144910.286823:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091751600/0x4076af67275161c9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956bc expref: 8 pid: 8432 timeout: 604 lvb_type: 1 00010000:00010000:3.0:1746144910.286835:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144910.286837:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144910.286841:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275161d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956ca expref: 26 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.286847:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275161d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956ca expref: 26 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.286865:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275161d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956ca expref: 26 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144910.286873:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093854380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172544512:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144910.286898:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008bae7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144910.290449:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093854380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172544512:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144910.290466:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144910.290500:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175438976:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 3751us (3835us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144910.290508:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11292 00000100:00100000:1.0:1746144910.290587:0:31844:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009bb48000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_011:lustre-OST0001_UUID:31844:1830965172544384:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144910.290601:0:31844:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af67275161de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144910.294629:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.295035:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175439104 00000100:00100000:3.0:1746144910.295043:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175439104 00010000:00010000:3.0:1746144910.295073:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727515fd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9559d expref: 11 pid: 8433 timeout: 604 lvb_type: 0 00000100:00100000:3.0:1746144910.295108:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11293 00000100:00100000:3.0:1746144910.295115:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1984:x1830965175439104:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144910.295124:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746144910.295148:0:9812:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb size from disk: 25067520 -> 26214400 00002000:00010000:3.0:1746144910.295151:0:9812:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb blocks from disk: 49163 -> 51211 00010000:00010000:3.0:1746144910.295155:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727515fd8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9559d expref: 11 pid: 8433 timeout: 604 lvb_type: 0 00010000:00010000:3.0:1746144910.295166:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727515fd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9559d expref: 11 pid: 8433 timeout: 604 lvb_type: 0 00010000:00010000:3.0:1746144910.295184:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b467c00/0x4076af6727515fd8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 25067520->26214399) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9559d expref: 11 pid: 8433 timeout: 604 lvb_type: 0 00010000:00010000:3.0:1746144910.295211:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144910.295213:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144910.295217:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af67275161de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.295224:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af67275161de lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.295230:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144910.295232:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144910.295234:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b467600/0x4076af67275161e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.295239:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b467600/0x4076af67275161e5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.295302:0:31844:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af67275161de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.295310:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af67275161de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.295372:0:25029:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009b467600/0x4076af67275161e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.295379:0:25029:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b467600/0x4076af67275161e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.295534:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144910.295857:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1984:x1830965175439104:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 742us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144910.296444:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11293 00000100:00100000:0.0:1746144910.300884:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.300936:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.301106:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175439488 00000100:00100000:2.0:1746144910.301115:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175439488 00002000:00100000:2.0:1746144910.301149:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (0->1048575) req@ffff88012cf2e300 x1830965175439488/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.301157:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2e300 with x1830965175439488 ext(0->1048575) 00002000:00010000:2.0:1746144910.301162:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2e300 00000100:00100000:2.0:1746144910.301180:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4436 00000100:00100000:2.0:1746144910.301187:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+27:1982:x1830965175439488:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144910.301514:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175439360 00000100:00100000:3.0:1746144910.301518:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175439360 00000100:00100000:3.0:1746144910.301552:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5894 00000100:00100000:3.0:1746144910.301557:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1128:x1830965175439360:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:3.0:1746144910.301566:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144910.301579:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a91ce00/0x4076af67275161ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af956d1 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.301599:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af67275161d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956c3 expref: 11 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144910.301605:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144910.301607:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144910.301610:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a91ce00/0x4076af67275161ec lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956d1 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.301634:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af67275161d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956c3 expref: 11 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144910.301649:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af67275161d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956c3 expref: 11 pid: 8432 timeout: 604 lvb_type: 1 00000100:00100000:3.0:1746144910.301659:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093854380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172544640:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144910.301717:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008bae7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144910.305435:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093854380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172544640:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144910.305462:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a91ce00/0x4076af67275161ec lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956d1 expref: 9 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.305478:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a91ce00, rc 0) 00000100:00100000:3.0:1746144910.306728:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1128:x1830965175439360:12345-192.168.202.16@tcp:101:dd.0 Request processed in 5165us (5846us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144910.306737:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5894 00000100:00100000:0.0:1746144910.314574:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.314863:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175439616 00000100:00100000:3.0:1746144910.314871:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175439616 00010000:00010000:3.0:1746144910.314900:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af67275161d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956c3 expref: 12 pid: 8432 timeout: 604 lvb_type: 1 00000100:00100000:3.0:1746144910.314925:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11294 00000100:00100000:3.0:1746144910.314932:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1984:x1830965175439616:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144910.314942:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144910.314959:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af67275161d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956c3 expref: 12 pid: 8432 timeout: 604 lvb_type: 1 00010000:00010000:3.0:1746144910.314974:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af67275161d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956c3 expref: 12 pid: 8432 timeout: 604 lvb_type: 1 00010000:00010000:3.0:1746144910.314992:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091750c00/0x4076af67275161d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956c3 expref: 12 pid: 8432 timeout: 604 lvb_type: 1 00010000:00010000:3.0:1746144910.315019:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144910.315021:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144910.315026:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a91ce00/0x4076af67275161ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956d1 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.315033:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a91ce00/0x4076af67275161ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956d1 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.315058:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a91ce00/0x4076af67275161ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956d1 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144910.315068:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093854380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965172544768:192.168.202.16@tcp:105: 00000100:00100000:3.0:1746144910.315137:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008bae7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746144910.328891:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093854380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965172544768:192.168.202.16@tcp:105: 00010000:00010000:3.0:1746144910.328909:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144910.329171:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+13:1984:x1830965175439616:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 14238us (14601us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144910.329180:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11294 00000100:00100000:3.0:1746144910.329506:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.329527:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175439872 00000100:00100000:3.0:1746144910.329531:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175439872 00002000:00100000:3.0:1746144910.329556:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1d:0x0] (0->1048575) req@ffff880093854380 x1830965175439872/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.329563:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854380 with x1830965175439872 ext(0->1048575) 00002000:00010000:3.0:1746144910.329568:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093854380 00000100:00100000:3.0:1746144910.329581:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4437 00000100:00100000:3.0:1746144910.329586:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1985:x1830965175439872:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144910.336109:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.336277:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175440128 00000100:00100000:3.0:1746144910.336285:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175440128 00002000:00100000:3.0:1746144910.336320:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c:0x0] (1048576->2097151) req@ffff88012cf2d880 x1830965175440128/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.336328:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2d880 with x1830965175440128 ext(1048576->2097151) 00002000:00010000:3.0:1746144910.336332:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2d880 00000100:00100000:3.0:1746144910.336356:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4438 00000100:00100000:3.0:1746144910.336362:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+29:1984:x1830965175440128:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144910.340706:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+31:1982:x1830965175439488:12345-192.168.202.16@tcp:4:dd.0 Request processed in 39510us (39760us total) trans 4294968083 rc 0/0 00000100:00100000:1.0:1746144910.340717:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4436 00002000:00100000:1.0:1746144910.341969:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (0->1048575) req@ffff88012cf2e300 x1830965175439488/t4294968083(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144910.341978:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2e300 with x1830965175439488 ext(0->1048575) 00002000:00010000:1.0:1746144910.341983:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2e300 00000100:00100000:0.0:1746144910.343103:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.343190:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175440384 00000100:00100000:0.0:1746144910.343196:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175440384 00000100:00100000:3.0:1746144910.343546:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+11:1985:x1830965175439872:12345-192.168.202.16@tcp:4:dd.0 Request processed in 13958us (14039us total) trans 4294968590 rc 0/0 00000100:00100000:3.0:1746144910.343554:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4437 00002000:00100000:3.0:1746144910.343560:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1d:0x0] (0->1048575) req@ffff880093854380 x1830965175439872/t4294968590(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.343568:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854380 with x1830965175439872 ext(0->1048575) 00002000:00010000:3.0:1746144910.343572:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093854380 00002000:00100000:0.0:1746144910.344894:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (1048576->2097151) req@ffff88012cf2c700 x1830965175440384/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144910.344903:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2c700 with x1830965175440384 ext(1048576->2097151) 00002000:00010000:0.0:1746144910.344906:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cf2c700 00000100:00100000:0.0:1746144910.344929:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4439 00000100:00100000:0.0:1746144910.344937:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+11:1984:x1830965175440384:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144910.351318:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.352777:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+31:1984:x1830965175440128:12345-192.168.202.16@tcp:4:dd.0 Request processed in 16398us (16658us total) trans 4294968084 rc 0/0 00000100:00100000:3.0:1746144910.352796:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4438 00002000:00100000:3.0:1746144910.352805:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c:0x0] (1048576->2097151) req@ffff88012cf2d880 x1830965175440128/t4294968084(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.352813:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2d880 with x1830965175440128 ext(1048576->2097151) 00002000:00010000:3.0:1746144910.352818:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2d880 00000100:00100000:3.0:1746144910.352835:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175440640 00000100:00100000:3.0:1746144910.352840:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175440640 00002000:00100000:3.0:1746144910.352861:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c:0x0] (2097152->3145727) req@ffff88012cf2ca80 x1830965175440640/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.352867:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2ca80 with x1830965175440640 ext(2097152->3145727) 00002000:00010000:3.0:1746144910.352869:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2ca80 00000100:00100000:3.0:1746144910.352898:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4440 00000100:00100000:3.0:1746144910.352903:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+31:1984:x1830965175440640:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144910.352918:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+13:1984:x1830965175440384:12345-192.168.202.16@tcp:4:dd.0 Request processed in 7982us (9817us total) trans 4294968591 rc 0/0 00000100:00100000:2.0:1746144910.352924:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4439 00002000:00100000:2.0:1746144910.352927:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (1048576->2097151) req@ffff88012cf2c700 x1830965175440384/t4294968591(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.352933:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2c700 with x1830965175440384 ext(1048576->2097151) 00002000:00010000:2.0:1746144910.352937:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cf2c700 00000100:00100000:2.0:1746144910.365091:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000001:00080000:3.0:1746144910.365709:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968588 is committed 00000100:00100000:1.0:1746144910.365710:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175440896 00000100:00100000:1.0:1746144910.365718:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175440896 00002000:00100000:1.0:1746144910.365748:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1d:0x0] (2097152->3145727) req@ffff88009b4f8380 x1830965175440896/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144910.365757:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4f8380 with x1830965175440896 ext(2097152->3145727) 00002000:00010000:1.0:1746144910.365779:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b4f8380 00000100:00100000:1.0:1746144910.365806:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4441 00000100:00100000:1.0:1746144910.365813:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+13:1985:x1830965175440896:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:2.0:1746144910.365876:0:25029:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb mtime from disk: 1746144909 -> 1746144910 00002000:00010000:2.0:1746144910.365879:0:25029:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb ctime from disk: 1746144909 -> 1746144910 00010000:00010000:2.0:1746144910.365887:0:25029:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b467600/0x4076af67275161e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.365895:0:25029:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b467600/0x4076af67275161e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.365902:0:25029:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b467600/0x4076af67275161e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.365907:0:25029:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b467600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144910.365910:0:25029:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b467600/0x4076af67275161e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.365920:0:25029:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b467600/0x4076af67275161e5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.365933:0:25029:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b467600/0x4076af67275161e5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.365938:0:25029:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b467600/0x4076af67275161e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25029 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144910.365985:0:25029:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1985:x1830965175438592:12345-192.168.202.16@tcp:4:dd.0 Request processed in 79711us (80996us total) trans 4294968588 rc 0/0 00000100:00100000:2.0:1746144910.365990:0:25029:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4435 00000100:00100000:2.0:1746144910.372006:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.373162:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+33:1984:x1830965175440640:12345-192.168.202.16@tcp:4:dd.0 Request processed in 20253us (21844us total) trans 4294968085 rc 0/0 00000100:00100000:2.0:1746144910.373171:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4440 00002000:00100000:2.0:1746144910.373183:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c:0x0] (2097152->3145727) req@ffff88012cf2ca80 x1830965175440640/t4294968085(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.373192:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2ca80 with x1830965175440640 ext(2097152->3145727) 00002000:00010000:2.0:1746144910.373197:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2ca80 00000100:00100000:2.0:1746144910.373216:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175441152 00000100:00100000:2.0:1746144910.373222:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175441152 00002000:00100000:2.0:1746144910.373243:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c:0x0] (3145728->4194303) req@ffff88009b4fa680 x1830965175441152/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.373249:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4fa680 with x1830965175441152 ext(3145728->4194303) 00002000:00010000:2.0:1746144910.373252:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4fa680 00000100:00100000:2.0:1746144910.373263:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4442 00000100:00100000:2.0:1746144910.373268:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+33:1984:x1830965175441152:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144910.378116:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+15:1985:x1830965175440896:12345-192.168.202.16@tcp:4:dd.0 Request processed in 12295us (13022us total) trans 4294968592 rc 0/0 00000100:00100000:1.0:1746144910.378126:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4441 00002000:00100000:1.0:1746144910.378136:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1d:0x0] (2097152->3145727) req@ffff88009b4f8380 x1830965175440896/t4294968592(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144910.378143:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4f8380 with x1830965175440896 ext(2097152->3145727) 00002000:00010000:1.0:1746144910.378148:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b4f8380 00000100:00100000:0.0:1746144910.382826:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+35:1984:x1830965175441152:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9549us (10819us total) trans 4294968086 rc 0/0 00000100:00100000:0.0:1746144910.382837:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4442 00002000:00100000:0.0:1746144910.382847:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c:0x0] (3145728->4194303) req@ffff88009b4fa680 x1830965175441152/t4294968086(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144910.382855:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4fa680 with x1830965175441152 ext(3145728->4194303) 00002000:00010000:0.0:1746144910.382860:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4fa680 00000100:00100000:0.0:1746144910.382910:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.382971:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175441408 00000100:00100000:0.0:1746144910.382977:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175441408 00002000:00100000:0.0:1746144910.383001:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (3145728->4194303) req@ffff88012cf2f800 x1830965175441408/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144910.383008:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2f800 with x1830965175441408 ext(3145728->4194303) 00002000:00010000:0.0:1746144910.383012:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cf2f800 00000100:00100000:0.0:1746144910.383024:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4443 00000100:00100000:0.0:1746144910.383029:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+15:1985:x1830965175441408:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144910.388946:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.389051:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175441664 00000100:00100000:0.0:1746144910.389059:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175441664 00002000:00100000:0.0:1746144910.389094:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1c:0x0] (4194304->5242879) req@ffff88009b4fa300 x1830965175441664/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144910.389107:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4fa300 with x1830965175441664 ext(4194304->5242879) 00002000:00010000:0.0:1746144910.389111:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4fa300 00000100:00100000:0.0:1746144910.389136:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4444 00000100:00100000:0.0:1746144910.389142:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+35:1985:x1830965175441664:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144910.392223:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1985:x1830965175441408:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9187us (9306us total) trans 4294968593 rc 0/0 00000100:00100000:1.0:1746144910.392233:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4443 00002000:00100000:1.0:1746144910.392242:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (3145728->4194303) req@ffff88012cf2f800 x1830965175441408/t4294968593(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144910.392251:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2f800 with x1830965175441408 ext(3145728->4194303) 00002000:00010000:1.0:1746144910.392256:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cf2f800 00000100:00100000:1.0:1746144910.396746:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+37:1985:x1830965175441664:12345-192.168.202.16@tcp:4:dd.0 Request processed in 7598us (7799us total) trans 4294968087 rc 0/0 00000100:00100000:1.0:1746144910.396756:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4444 00002000:00100000:1.0:1746144910.396778:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1c:0x0] (4194304->5242879) req@ffff88009b4fa300 x1830965175441664/t4294968087(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144910.396796:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4fa300 with x1830965175441664 ext(4194304->5242879) 00002000:00010000:1.0:1746144910.396801:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4fa300 00000100:00100000:1.0:1746144910.405676:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.405958:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175441920 00000100:00100000:2.0:1746144910.405965:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175441920 00002000:00100000:2.0:1746144910.405998:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1d:0x0] (4194304->5242879) req@ffff88009bb48000 x1830965175441920/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.406006:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb48000 with x1830965175441920 ext(4194304->5242879) 00002000:00010000:2.0:1746144910.406011:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb48000 00000100:00100000:2.0:1746144910.406026:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4445 00000100:00100000:2.0:1746144910.406046:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1984:x1830965175441920:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:1.0:1746144910.418653:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af67275161de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.418667:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af67275161de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.418674:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af67275161de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.418680:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091751e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.418683:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af67275161de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.418690:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af67275161de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.418705:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af67275161de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.418711:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af67275161de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.418811:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175438720:12345-192.168.202.16@tcp:4:dd.0 Request processed in 132923us (134321us total) trans 4294968589 rc 0/0 00000100:00100000:1.0:1746144910.418820:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4434 00000001:00080000:2.0:1746144910.418971:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968589 is committed 00000001:00080000:2.0:1746144910.418985:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968591 is committed 00000100:00100000:2.0:1746144910.421620:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009bb48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+15:1984:x1830965175441920:12345-192.168.202.16@tcp:4:dd.0 Request processed in 15580us (15944us total) trans 4294968594 rc 0/0 00000100:00100000:2.0:1746144910.421629:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4445 00002000:00100000:2.0:1746144910.421638:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1d:0x0] (4194304->5242879) req@ffff88009bb48000 x1830965175441920/t4294968594(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.421647:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009bb48000 with x1830965175441920 ext(4194304->5242879) 00002000:00010000:2.0:1746144910.421651:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009bb48000 00000100:00100000:1.0:1746144910.423066:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.423098:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.423118:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.423134:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175442176 00000100:00100000:1.0:1746144910.423140:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175442176 00002000:00100000:1.0:1746144910.423168:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c:0x0] (5242880->6291455) req@ffff88009398fb80 x1830965175442176/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144910.423176:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398fb80 with x1830965175442176 ext(5242880->6291455) 00002000:00010000:1.0:1746144910.423179:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398fb80 00000100:00100000:1.0:1746144910.423203:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175442560 00000100:00100000:1.0:1746144910.423205:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175442560 00000100:00100000:1.0:1746144910.423220:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175442688 00000100:00100000:1.0:1746144910.423222:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175442688 00000100:00100000:3.0:1746144910.423232:0:25029:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4446 00000100:00100000:3.0:1746144910.423245:0:25029:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+37:1985:x1830965175442176:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144910.423507:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4447 00000100:00100000:1.0:1746144910.423513:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175442560:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144910.423540:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4448 00000100:00100000:0.0:1746144910.423547:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009167e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175442688:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:0.0:1746144910.423565:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091cea800/0x4076af67275161f3 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.423576:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.423577:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.423582:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091cea800/0x4076af67275161f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.423598:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091cea800/0x4076af67275161f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.423860:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af67275161fa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.423867:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.423868:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.423871:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af67275161fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.423883:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af67275161fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144910.433656:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.433796:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175442944 00000100:00100000:1.0:1746144910.433804:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175442944 00002000:00100000:1.0:1746144910.433839:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (5242880->6291455) req@ffff88012cf2df80 x1830965175442944/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144910.433849:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2df80 with x1830965175442944 ext(5242880->6291455) 00002000:00010000:1.0:1746144910.433853:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cf2df80 00000100:00100000:1.0:1746144910.433881:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4449 00000100:00100000:1.0:1746144910.433888:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+15:1984:x1830965175442944:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:2.0:1746144910.434242:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af67275161fa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.434252:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af67275161fa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.434260:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af67275161fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.434267:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bb9e800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144910.434270:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af67275161fa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.434278:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af67275161fa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.434292:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af67275161fa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.434297:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bb9e800/0x4076af67275161fa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144910.434349:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175442560:12345-192.168.202.16@tcp:3:dd.0 Request processed in 10836us (11250us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144910.434356:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4447 00010000:00010000:0.0:1746144910.437573:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091cea800/0x4076af67275161f3 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.437588:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091cea800/0x4076af67275161f3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.437595:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091cea800/0x4076af67275161f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.437601:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091cea800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144910.437605:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091cea800/0x4076af67275161f3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.437611:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091cea800/0x4076af67275161f3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.437677:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091cea800/0x4076af67275161f3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.437683:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091cea800/0x4076af67275161f3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144910.438148:0:25029:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009398fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+39:1985:x1830965175442176:12345-192.168.202.16@tcp:4:dd.0 Request processed in 14904us (15081us total) trans 4294968088 rc 0/0 00000100:00100000:0.0:1746144910.438148:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009167e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175442688:12345-192.168.202.16@tcp:3:dd.0 Request processed in 14597us (15023us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144910.438157:0:25029:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4446 00000100:00100000:0.0:1746144910.438161:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4448 00002000:00100000:3.0:1746144910.438167:0:25029:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1c:0x0] (5242880->6291455) req@ffff88009398fb80 x1830965175442176/t4294968088(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.438174:0:25029:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009398fb80 with x1830965175442176 ext(5242880->6291455) 00002000:00010000:3.0:1746144910.438178:0:25029:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009398fb80 00000100:00100000:1.0:1746144910.447026:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1984:x1830965175442944:12345-192.168.202.16@tcp:4:dd.0 Request processed in 13130us (13368us total) trans 4294968595 rc 0/0 00000100:00100000:1.0:1746144910.447036:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4449 00002000:00100000:1.0:1746144910.447048:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (5242880->6291455) req@ffff88012cf2df80 x1830965175442944/t4294968595(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144910.447057:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2df80 with x1830965175442944 ext(5242880->6291455) 00002000:00010000:1.0:1746144910.447062:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cf2df80 00000100:00100000:0.0:1746144910.447406:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.447476:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.447514:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.447531:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175443456 00000100:00100000:0.0:1746144910.447537:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175443456 00002000:00100000:0.0:1746144910.447562:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1c:0x0] (6291456->7340031) req@ffff88012cf2fb80 x1830965175443456/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144910.447569:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2fb80 with x1830965175443456 ext(6291456->7340031) 00002000:00010000:0.0:1746144910.447572:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2fb80 00000100:00100000:0.0:1746144910.447584:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175443584 00000100:00100000:0.0:1746144910.447586:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175443584 00000100:00100000:0.0:1746144910.447598:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175443328 00000100:00100000:0.0:1746144910.447600:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175443328 00000100:00100000:0.0:1746144910.447612:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4450 00000100:00100000:0.0:1746144910.447617:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+39:1985:x1830965175443456:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144910.447679:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4451 00000100:00100000:2.0:1746144910.447687:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175443584:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:2.0:1746144910.447717:0:31840:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 26214400, mtime: 0x68140e8e, atime: 0x0, ctime: 0x68140e8e, blocks: 0xc80b 00010000:00010000:2.0:1746144910.447723:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b467e00/0x4076af6727516201 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.447735:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144910.447737:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144910.447741:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b467e00/0x4076af6727516201 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.447753:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b467e00/0x4076af6727516201 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144910.447859:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4452 00000100:00100000:2.0:1746144910.447864:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175443328:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:2.0:1746144910.447877:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727516208 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.447883:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144910.447885:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144910.447887:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727516208 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.447894:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727516208 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.453726:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.454331:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175443968 00000100:00100000:1.0:1746144910.454338:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175443968 00002000:00100000:1.0:1746144910.454369:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (6291456->7340031) req@ffff88009258b800 x1830965175443968/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144910.454378:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258b800 with x1830965175443968 ext(6291456->7340031) 00002000:00010000:1.0:1746144910.454382:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009258b800 00000100:00100000:1.0:1746144910.455253:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4453 00000100:00100000:1.0:1746144910.455262:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009258b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1985:x1830965175443968:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144910.455329:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+41:1985:x1830965175443456:12345-192.168.202.16@tcp:4:dd.0 Request processed in 7710us (7922us total) trans 4294968089 rc 0/0 00000100:00100000:2.0:1746144910.455337:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4450 00002000:00100000:2.0:1746144910.455343:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1c:0x0] (6291456->7340031) req@ffff88012cf2fb80 x1830965175443456/t4294968089(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.455349:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2fb80 with x1830965175443456 ext(6291456->7340031) 00002000:00010000:2.0:1746144910.455352:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2fb80 00000100:00100000:2.0:1746144910.465213:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.465408:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175444224 00000100:00100000:2.0:1746144910.465416:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175444224 00002000:00100000:2.0:1746144910.465456:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1c:0x0] (7340032->8388607) req@ffff880093257480 x1830965175444224/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.465465:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257480 with x1830965175444224 ext(7340032->8388607) 00002000:00010000:2.0:1746144910.465469:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093257480 00000100:00100000:2.0:1746144910.465485:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4454 00000100:00100000:2.0:1746144910.465492:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+41:1985:x1830965175444224:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144910.474424:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.476300:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009258b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+19:1985:x1830965175443968:12345-192.168.202.16@tcp:4:dd.0 Request processed in 20522us (22064us total) trans 4294968598 rc 0/0 00000100:00100000:1.0:1746144910.476310:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4453 00002000:00100000:1.0:1746144910.476321:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (6291456->7340031) req@ffff88009258b800 x1830965175443968/t4294968598(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144910.476336:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009258b800 with x1830965175443968 ext(6291456->7340031) 00002000:00010000:1.0:1746144910.476341:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009258b800 00000100:00100000:1.0:1746144910.476423:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175444480 00000100:00100000:1.0:1746144910.476429:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175444480 00002000:00100000:1.0:1746144910.476450:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (7340032->8388607) req@ffff88012d365880 x1830965175444480/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144910.476457:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d365880 with x1830965175444480 ext(7340032->8388607) 00002000:00010000:1.0:1746144910.476459:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d365880 00000100:00100000:1.0:1746144910.476471:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4455 00000100:00100000:1.0:1746144910.476553:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+19:1985:x1830965175444480:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144910.479566:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+43:1985:x1830965175444224:12345-192.168.202.16@tcp:4:dd.0 Request processed in 14068us (14355us total) trans 4294968090 rc 0/0 00000100:00100000:2.0:1746144910.479575:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4454 00002000:00100000:2.0:1746144910.479583:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1c:0x0] (7340032->8388607) req@ffff880093257480 x1830965175444224/t4294968090(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.479591:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093257480 with x1830965175444224 ext(7340032->8388607) 00002000:00010000:2.0:1746144910.479595:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093257480 00000100:00100000:1.0:1746144910.484136:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.484259:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175444736 00000100:00100000:2.0:1746144910.484266:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175444736 00002000:00100000:2.0:1746144910.484300:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1c:0x0] (8388608->9437183) req@ffff88012d366680 x1830965175444736/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.484307:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d366680 with x1830965175444736 ext(8388608->9437183) 00002000:00010000:2.0:1746144910.484312:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d366680 00000100:00100000:2.0:1746144910.484328:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4456 00000100:00100000:2.0:1746144910.484334:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d366680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+43:1984:x1830965175444736:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144910.485943:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+21:1985:x1830965175444480:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9459us (11520us total) trans 4294968599 rc 0/0 00000100:00100000:0.0:1746144910.485955:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4455 00002000:00100000:0.0:1746144910.485963:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (7340032->8388607) req@ffff88012d365880 x1830965175444480/t4294968599(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144910.485971:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d365880 with x1830965175444480 ext(7340032->8388607) 00002000:00010000:0.0:1746144910.485975:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d365880 00000100:00100000:0.0:1746144910.490280:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.490303:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175444992 00000100:00100000:0.0:1746144910.490311:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175444992 00002000:00100000:0.0:1746144910.490616:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (8388608->9437183) req@ffff880093f44380 x1830965175444992/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144910.490625:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f44380 with x1830965175444992 ext(8388608->9437183) 00002000:00010000:0.0:1746144910.490631:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f44380 00000100:00100000:0.0:1746144910.490661:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4457 00000100:00100000:0.0:1746144910.490669:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+21:1984:x1830965175444992:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144910.494570:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d366680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:7454cbaf-97e3-4716-92c6-77cd48a94a90+45:1984:x1830965175444736:12345-192.168.202.16@tcp:4:dd.0 Request processed in 10226us (10428us total) trans 4294968091 rc 0/0 00000100:00100000:1.0:1746144910.496244:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4456 00002000:00100000:1.0:1746144910.496257:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1c:0x0] (8388608->9437183) req@ffff88012d366680 x1830965175444736/t4294968091(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144910.496266:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d366680 with x1830965175444736 ext(8388608->9437183) 00002000:00010000:1.0:1746144910.496271:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d366680 00000100:00100000:1.0:1746144910.504492:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+23:1984:x1830965175444992:12345-192.168.202.16@tcp:4:dd.0 Request processed in 13818us (14213us total) trans 4294968600 rc 0/0 00000100:00100000:1.0:1746144910.504502:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4457 00002000:00100000:1.0:1746144910.504512:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (8388608->9437183) req@ffff880093f44380 x1830965175444992/t4294968600(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144910.504525:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f44380 with x1830965175444992 ext(8388608->9437183) 00002000:00010000:1.0:1746144910.504531:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093f44380 00000100:00100000:3.0:1746144910.505372:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.505398:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175445248 00000100:00100000:2.0:1746144910.505405:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175445248 00002000:00100000:2.0:1746144910.505433:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (9437184->10485759) req@ffff880093854e00 x1830965175445248/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.505440:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854e00 with x1830965175445248 ext(9437184->10485759) 00002000:00010000:2.0:1746144910.505443:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093854e00 00000100:00100000:2.0:1746144910.505467:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4458 00000100:00100000:2.0:1746144910.505473:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+45:1984:x1830965175445248:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144910.512694:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+47:1984:x1830965175445248:12345-192.168.202.16@tcp:4:dd.0 Request processed in 7215us (7317us total) trans 4294968092 rc 0/0 00000100:00100000:3.0:1746144910.512704:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4458 00002000:00100000:3.0:1746144910.512714:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (9437184->10485759) req@ffff880093854e00 x1830965175445248/t4294968092(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.512722:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854e00 with x1830965175445248 ext(9437184->10485759) 00002000:00010000:3.0:1746144910.512727:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093854e00 00000100:00100000:3.0:1746144910.515012:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.515299:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175445504 00000100:00100000:2.0:1746144910.515307:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175445504 00002000:00100000:2.0:1746144910.515337:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (9437184->10485759) req@ffff880093855880 x1830965175445504/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.515345:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093855880 with x1830965175445504 ext(9437184->10485759) 00002000:00010000:2.0:1746144910.515350:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093855880 00000100:00100000:2.0:1746144910.515371:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4459 00000100:00100000:2.0:1746144910.515377:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+23:1985:x1830965175445504:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144910.523026:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+25:1985:x1830965175445504:12345-192.168.202.16@tcp:4:dd.0 Request processed in 7641us (8011us total) trans 4294968601 rc 0/0 00000100:00100000:2.0:1746144910.523036:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4459 00002000:00100000:2.0:1746144910.523045:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (9437184->10485759) req@ffff880093855880 x1830965175445504/t4294968601(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.523052:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093855880 with x1830965175445504 ext(9437184->10485759) 00002000:00010000:2.0:1746144910.523057:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093855880 00000001:00080000:3.0:1746144910.523609:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968595 is committed 00000001:00080000:3.0:1746144910.523628:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968596 is committed 00010000:00010000:2.0:1746144910.526091:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b467e00/0x4076af6727516201 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.526109:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b467e00/0x4076af6727516201 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.526116:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b467e00/0x4076af6727516201 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.526121:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b467e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144910.526125:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b467e00/0x4076af6727516201 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.526136:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b467e00/0x4076af6727516201 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.526153:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b467e00/0x4076af6727516201 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.526159:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b467e00/0x4076af6727516201 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144910.526352:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1982:x1830965175443584:12345-192.168.202.16@tcp:4:dd.0 Request processed in 78661us (78871us total) trans 4294968596 rc 0/0 00000100:00100000:2.0:1746144910.526362:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4451 00000100:00100000:0.0:1746144910.527670:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.527755:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175445760 00000100:00100000:0.0:1746144910.527781:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175445760 00002000:00100000:0.0:1746144910.527824:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1c:0x0] (10485760->11534335) req@ffff880093f45180 x1830965175445760/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144910.527838:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f45180 with x1830965175445760 ext(10485760->11534335) 00002000:00010000:0.0:1746144910.527842:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f45180 00000100:00100000:0.0:1746144910.527858:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4460 00000100:00100000:0.0:1746144910.527865:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+47:1984:x1830965175445760:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144910.539891:0:3308:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2566f13b-362a-4e88-b0dd-c558bbe87895:3308:1830965172544896:0@lo:400:kworker.0 00000100:00100000:1.0:1746144910.539907:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172545280:0@lo:400:kworker.0 00000100:00100000:3.0:1746144910.539957:0:3309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1830965172545024:0@lo:400:kworker.0 00000100:00100000:2.0:1746144910.540000:0:3308:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144910.540005:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144910.540033:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172545280 00000100:00100000:1.0:1746144910.540039:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172545280 00000100:00100000:1.0:1746144910.540079:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1746144910.540086:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172545280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746144910.540120:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1830965172545280:12345-0@lo:400:kworker.0 Request processed in 34us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144910.540125:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1746144910.540157:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1830965172545280:0@lo:400:kworker.0 00000100:00100000:1.0:1746144910.540179:0:3307:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746144910.540183:0:3307:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1830965172545152:0@lo:400:kworker.0 00000100:00100000:1.0:1746144910.540199:0:3307:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746144910.540216:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172545152 00000100:00100000:1.0:1746144910.540218:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172545152 00000100:00100000:1.0:1746144910.540236:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1746144910.540240:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1830965172545152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746144910.540260:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1830965172545152:12345-0@lo:400:kworker.0 Request processed in 20us (61us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144910.540264:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1746144910.540279:0:3307:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1830965172545152:0@lo:400:kworker.0 00000100:00100000:2.0:1746144910.540323:0:3308:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1830965172545408:0@lo:400:kworker.0 00000100:00100000:2.0:1746144910.540344:0:3308:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144910.540369:0:3309:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144910.540382:0:3309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012d365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172545536:0@lo:400:kworker.0 00000100:00100000:3.0:1746144910.540396:0:3309:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144910.540413:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172544896 00000100:00100000:3.0:1746144910.540416:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172544896 00000100:00100000:3.0:1746144910.540433:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1746144910.540437:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2566f13b-362a-4e88-b0dd-c558bbe87895+18:3308:x1830965172544896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746144910.540458:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2566f13b-362a-4e88-b0dd-c558bbe87895+18:3308:x1830965172544896:12345-0@lo:400:kworker.0 Request processed in 21us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144910.540463:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1746144910.540467:0:3308:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2566f13b-362a-4e88-b0dd-c558bbe87895:3308:1830965172544896:0@lo:400:kworker.0 00000100:00080000:3.0:1746144910.540483:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1746144910.540486:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746144910.541057:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.541074:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175446016 00000100:00100000:2.0:1746144910.541077:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175446016 00002000:00100000:2.0:1746144910.541100:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (10485760->11534335) req@ffff880093254a80 x1830965175446016/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.541108:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254a80 with x1830965175446016 ext(10485760->11534335) 00002000:00010000:2.0:1746144910.541113:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093254a80 00000100:00100000:2.0:1746144910.541123:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4461 00000100:00100000:2.0:1746144910.541128:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+17:1984:x1830965175446016:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144910.541314:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172545408 00000100:00100000:1.0:1746144910.541319:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172545408 00000100:00100000:1.0:1746144910.541340:0:21076:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172545024 00000100:00100000:1.0:1746144910.541342:0:21076:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172545024 00000100:00100000:1.0:1746144910.541353:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1746144910.541358:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1830965172545408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746144910.541387:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1830965172545408:12345-0@lo:400:kworker.0 Request processed in 29us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144910.541391:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1746144910.541400:0:21076:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1746144910.541404:0:21076:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1830965172545024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746144910.541423:0:21076:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093856680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1830965172545024:12345-0@lo:400:kworker.0 Request processed in 20us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144910.541428:0:21076:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1746144910.541444:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172545536 00000100:00100000:1.0:1746144910.541446:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172545536 00000100:00100000:1.0:1746144910.541459:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1746144910.541463:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1830965172545536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746144910.541479:0:3309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1830965172545024:0@lo:400:kworker.0 00000100:00100000:1.0:1746144910.541483:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1830965172545536:12345-0@lo:400:kworker.0 Request processed in 20us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144910.541488:0:3309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172545536:0@lo:400:kworker.0 00000100:00100000:1.0:1746144910.541488:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00080000:1.0:1746144910.541498:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746144910.541500:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746144910.541548:0:3308:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012d366a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1830965172545408:0@lo:400:kworker.0 00000100:00100000:0.0:1746144910.544344:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+49:1984:x1830965175445760:12345-192.168.202.16@tcp:4:dd.0 Request processed in 16474us (16673us total) trans 4294968093 rc 0/0 00000100:00100000:0.0:1746144910.544354:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4460 00002000:00100000:0.0:1746144910.544362:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1c:0x0] (10485760->11534335) req@ffff880093f45180 x1830965175445760/t4294968093(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144910.544371:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093f45180 with x1830965175445760 ext(10485760->11534335) 00002000:00010000:0.0:1746144910.544376:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093f45180 00000100:00100000:3.0:1746144910.551075:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+19:1984:x1830965175446016:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9940us (10013us total) trans 4294968602 rc 0/0 00000100:00100000:3.0:1746144910.551084:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4461 00002000:00100000:3.0:1746144910.551093:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (10485760->11534335) req@ffff880093254a80 x1830965175446016/t4294968602(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.551101:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093254a80 with x1830965175446016 ext(10485760->11534335) 00002000:00010000:3.0:1746144910.551106:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880093254a80 00000100:00100000:1.0:1746144910.555451:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.555610:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175446272 00000100:00100000:3.0:1746144910.555618:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175446272 00002000:00100000:3.0:1746144910.555652:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (11534336->12582911) req@ffff88012d364700 x1830965175446272/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.555660:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d364700 with x1830965175446272 ext(11534336->12582911) 00002000:00010000:3.0:1746144910.555664:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d364700 00000100:00100000:3.0:1746144910.555684:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4462 00000100:00100000:3.0:1746144910.555690:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+49:1985:x1830965175446272:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144910.564466:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.564719:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175446528 00000100:00100000:1.0:1746144910.564726:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175446528 00002000:00100000:1.0:1746144910.564758:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1d:0x0] (11534336->12582911) req@ffff88012d364e00 x1830965175446528/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144910.564797:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d364e00 with x1830965175446528 ext(11534336->12582911) 00002000:00010000:1.0:1746144910.564801:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d364e00 00000100:00100000:1.0:1746144910.564819:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4463 00000100:00100000:1.0:1746144910.564826:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+19:1985:x1830965175446528:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144910.566317:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+51:1985:x1830965175446272:12345-192.168.202.16@tcp:4:dd.0 Request processed in 10623us (10867us total) trans 4294968094 rc 0/0 00000100:00100000:3.0:1746144910.566325:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4462 00002000:00100000:3.0:1746144910.566333:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (11534336->12582911) req@ffff88012d364700 x1830965175446272/t4294968094(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144910.566341:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d364700 with x1830965175446272 ext(11534336->12582911) 00002000:00010000:3.0:1746144910.566345:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012d364700 00000100:00100000:2.0:1746144910.574192:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+21:1985:x1830965175446528:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9358us (9724us total) trans 4294968603 rc 0/0 00000100:00100000:2.0:1746144910.574202:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4463 00002000:00100000:2.0:1746144910.574212:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1d:0x0] (11534336->12582911) req@ffff88012d364e00 x1830965175446528/t4294968603(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144910.574220:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d364e00 with x1830965175446528 ext(11534336->12582911) 00002000:00010000:2.0:1746144910.574225:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d364e00 00000100:00100000:3.0:1746144910.577858:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.577896:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.577966:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175447040 00000100:00100000:0.0:1746144910.577969:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175446784 00000100:00100000:0.0:1746144910.577974:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175446784 00000100:00100000:1.0:1746144910.577975:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175447040 00002000:00100000:0.0:1746144910.578006:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1c:0x0] (12582912->13631487) req@ffff880093854700 x1830965175446784/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/0 e 0 to 0 dl 1746144921 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144910.578015:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854700 with x1830965175446784 ext(12582912->13631487) 00000100:00100000:1.0:1746144910.578019:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 172 00002000:00010000:0.0:1746144910.578019:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093854700 00000100:00100000:1.0:1746144910.578025:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a621c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1128:x1830965175447040:12345-192.168.202.16@tcp:35:dd.0 00000100:00100000:0.0:1746144910.578031:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4464 00000100:00100000:0.0:1746144910.578036:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+51:1984:x1830965175446784:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144910.578153:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a621c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+21:1128:x1830965175447040:12345-192.168.202.16@tcp:35:dd.0 Request processed in 127us (255us total) trans 4294987541 rc 0/0 00000100:00100000:1.0:1746144910.578158:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 172 00000100:00100000:3.0:1746144910.581979:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.584022:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175447296 00000100:00100000:1.0:1746144910.584030:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175447296 00000100:00100000:1.0:1746144910.584097:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 173 00000100:00100000:1.0:1746144910.584105:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+21:1128:x1830965175447296:12345-192.168.202.16@tcp:35:dd.0 00000001:00080000:1.0:1746144910.584299:0:19321:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294987542 00000100:00100000:1.0:1746144910.584898:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093857b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+23:1128:x1830965175447296:12345-192.168.202.16@tcp:35:dd.0 Request processed in 793us (2923us total) trans 4294987543 rc 0/0 00000100:00100000:1.0:1746144910.584906:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 173 00000020:00080000:1.0:1746144910.584910:0:19321:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746144910.584956:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093854700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1984:x1830965175446784:12345-192.168.202.16@tcp:4:dd.0 Request processed in 6918us (7102us total) trans 4294968095 rc 0/0 00000100:00100000:0.0:1746144910.584963:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4464 00002000:00100000:0.0:1746144910.584971:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1c:0x0] (12582912->13631487) req@ffff880093854700 x1830965175446784/t4294968095(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:551/0 lens 488/448 e 0 to 0 dl 1746144921 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144910.584979:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880093854700 with x1830965175446784 ext(12582912->13631487) 00002000:00010000:0.0:1746144910.584984:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880093854700 00000001:00080000:3.0:1746144910.587468:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968599 is committed 00000001:00080000:3.0:1746144910.587482:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968600 is committed 00010000:00010000:2.0:1746144910.587494:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727516208 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1746144910.587495:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968601 is committed 00000001:00080000:3.0:1746144910.587500:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968597 is committed 00010000:00010000:2.0:1746144910.587503:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727516208 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.587510:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727516208 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.587517:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b466400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144910.587520:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727516208 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.587527:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727516208 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.587541:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727516208 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.587547:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b466400/0x4076af6727516208 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144910.587728:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175443328:12345-192.168.202.16@tcp:4:dd.0 Request processed in 139860us (140214us total) trans 4294968597 rc 0/0 00000100:00100000:2.0:1746144910.587735:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4452 00000100:00100000:0.0:1746144910.587894:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880093254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965172545664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746144910.587934:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144910.588059:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172545664 00000100:00100000:3.0:1746144910.588065:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172545664 00000100:00100000:3.0:1746144910.588088:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1746144910.588093:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1830965172545664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746144910.588108:0:8435:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 1703936 granted 166789120 pending 3407872 free 3809476608 avail 3786407936 00000100:00100000:3.0:1746144910.588131:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1830965172545664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144910.588136:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1746144910.588151:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880093254380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965172545664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746144910.589917:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.589945:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175447680 00000100:00100000:2.0:1746144910.589950:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175447680 00000100:00100000:1.0:1746144910.589950:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.589990:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175447808 00000100:00100000:2.0:1746144910.589993:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175447808 00000100:00100000:0.0:1746144910.590001:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4465 00000100:00100000:0.0:1746144910.590008:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d367b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175447680:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:2.0:1746144910.590011:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4466 00000100:00100000:2.0:1746144910.590015:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175447808:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:2.0:1746144910.590030:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727516216 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.590030:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094377000/0x4076af672751620f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.590042:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.590042:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144910.590043:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.590043:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144910.590048:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727516216 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.590048:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094377000/0x4076af672751620f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.590058:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727516216 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.590058:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094377000/0x4076af672751620f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.600943:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727516216 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.600956:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727516216 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.600963:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727516216 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.600969:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099501a00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144910.600973:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727516216 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.600979:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727516216 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.600995:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727516216 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.601002:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099501a00/0x4076af6727516216 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144910.601066:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175447808:12345-192.168.202.16@tcp:3:dd.0 Request processed in 11046us (11111us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144910.601076:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4466 00010000:00010000:1.0:1746144910.601179:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880094377000/0x4076af672751620f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.601191:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094377000/0x4076af672751620f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.601197:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094377000/0x4076af672751620f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.601201:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094377000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.601204:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094377000/0x4076af672751620f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.601209:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094377000/0x4076af672751620f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.601218:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094377000/0x4076af672751620f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.601224:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094377000/0x4076af672751620f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.601263:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d367b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175447680:12345-192.168.202.16@tcp:3:dd.0 Request processed in 11256us (11352us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144910.601269:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4465 00000100:00100000:3.0:1746144910.604913:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.604934:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175448064 00000100:00100000:1.0:1746144910.604942:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175448064 00000100:00100000:3.0:1746144910.604948:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.605109:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175448192 00000100:00100000:1.0:1746144910.605112:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175448192 00000100:00100000:2.0:1746144910.605114:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4467 00000100:00100000:2.0:1746144910.605123:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175448064:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144910.605130:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4468 00000100:00100000:1.0:1746144910.605134:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175448192:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:2.0:1746144910.605159:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 26214400, mtime: 0x68140e8e, atime: 0x0, ctime: 0x68140e8e, blocks: 0xc80b 00010000:00010000:2.0:1746144910.605231:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af672751621d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.605244:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144910.605246:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144910.605250:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af672751621d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.605261:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af672751621d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.605335:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b467200/0x4076af6727516224 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.605343:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.605344:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.605347:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b467200/0x4076af6727516224 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.605354:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b467200/0x4076af6727516224 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.640075:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1746144910.650664:0:31840:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb mtime from disk: 1746144910 -> 1746144911 00002000:00010000:1.0:1746144910.650670:0:31840:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1c:0x0] updating lvb ctime from disk: 1746144910 -> 1746144911 00010000:00010000:3.0:1746144910.650733:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af672751621d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.650744:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af672751621d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.650751:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af672751621d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.650757:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009966c000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144910.650779:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af672751621d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.650803:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af672751621d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.650816:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af672751621d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.650854:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b467200/0x4076af6727516224 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.650861:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b467200/0x4076af6727516224 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.650867:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b467200/0x4076af6727516224 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.650871:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b467200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.650874:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b467200/0x4076af6727516224 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.650879:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b467200/0x4076af6727516224 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.650888:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b467200/0x4076af6727516224 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.650893:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b467200/0x4076af6727516224 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.651099:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af672751621d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.651167:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1982:x1830965175448192:12345-192.168.202.16@tcp:4:dd.0 Request processed in 46026us (46212us total) trans 4294968604 rc 0/0 00000100:00100000:1.0:1746144910.651176:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4468 00000100:00100000:3.0:1746144910.651243:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1983:x1830965175448064:12345-192.168.202.16@tcp:4:dd.0 Request processed in 46120us (46336us total) trans 4294968605 rc 0/0 00000100:00100000:3.0:1746144910.651248:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4467 00000001:00080000:3.0:1746144910.651265:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968604 is committed 00000001:00080000:3.0:1746144910.651274:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968603 is committed 00000001:00080000:3.0:1746144910.651285:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968605 is committed 00000100:00100000:3.0:1746144910.655981:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.656017:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.656103:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175448576 00000100:00100000:1.0:1746144910.656111:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175448576 00000100:00100000:0.0:1746144910.656128:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175448832 00000100:00100000:0.0:1746144910.656132:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175448832 00000100:00100000:1.0:1746144910.656157:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4469 00000100:00100000:1.0:1746144910.656164:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175448576:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144910.656177:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4470 00000100:00100000:0.0:1746144910.656183:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175448832:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:1.0:1746144910.656190:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091a5ec00/0x4076af672751622b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.656198:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a5dc00/0x4076af6727516232 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.656202:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.656203:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.656206:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.656207:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5ec00/0x4076af672751622b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.656207:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.656210:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5dc00/0x4076af6727516232 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.656218:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5ec00/0x4076af672751622b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.656218:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a5dc00/0x4076af6727516232 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.667063:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a5dc00/0x4076af6727516232 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.667084:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5dc00/0x4076af6727516232 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.667092:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a5dc00/0x4076af6727516232 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.667098:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5dc00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144910.667103:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5dc00/0x4076af6727516232 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.667111:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5dc00/0x4076af6727516232 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.667130:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a5dc00/0x4076af6727516232 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.667136:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a5dc00/0x4076af6727516232 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144910.667219:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175448832:12345-192.168.202.16@tcp:3:dd.0 Request processed in 11030us (11195us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144910.667229:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4470 00010000:00010000:1.0:1746144910.668421:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091a5ec00/0x4076af672751622b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.668437:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5ec00/0x4076af672751622b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.668443:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091a5ec00/0x4076af672751622b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.668448:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5ec00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.668450:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a5ec00/0x4076af672751622b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.668456:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a5ec00/0x4076af672751622b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.668467:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091a5ec00/0x4076af672751622b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.668471:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5ec00/0x4076af672751622b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.668732:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175448576:12345-192.168.202.16@tcp:3:dd.0 Request processed in 12565us (12757us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144910.668738:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4469 00000100:00100000:3.0:1746144910.671644:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.671731:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.671984:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175449088 00000100:00100000:1.0:1746144910.671997:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175449088 00000100:00100000:1.0:1746144910.672061:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175449216 00000100:00100000:1.0:1746144910.672064:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175449216 00000100:00100000:1.0:1746144910.672091:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4471 00000100:00100000:1.0:1746144910.672099:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175449088:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:1.0:1746144910.672150:0:31840:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 26214400, mtime: 0x68140e8f, atime: 0x0, ctime: 0x68140e8f, blocks: 0xc80b 00010000:00010000:1.0:1746144910.672158:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727516239 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.672171:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.672173:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.672179:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727516239 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.672192:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727516239 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144910.672378:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4472 00000100:00100000:0.0:1746144910.672387:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175449216:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:0.0:1746144910.672403:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af6727516240 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.672410:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.672411:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.672413:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af6727516240 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.672420:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af6727516240 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.703492:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727516239 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.703508:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727516239 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.703515:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727516239 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.703522:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5f400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.703525:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727516239 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.703532:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727516239 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.703557:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727516239 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.703563:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a5f400/0x4076af6727516239 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.703650:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+13:1983:x1830965175449088:12345-192.168.202.16@tcp:4:dd.0 Request processed in 31545us (32007us total) trans 4294968606 rc 0/0 00000100:00100000:1.0:1746144910.703662:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4471 00000001:00080000:2.0:1746144910.704580:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968606 is committed 00000001:00080000:2.0:1746144910.723978:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968607 is committed 00010000:00010000:1.0:1746144910.724076:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af6727516240 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.724088:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af6727516240 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.724138:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af6727516240 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.724144:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5da00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.724186:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af6727516240 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.724194:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af6727516240 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.724210:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af6727516240 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.724220:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af6727516240 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.724384:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175449216:12345-192.168.202.16@tcp:4:dd.0 Request processed in 51994us (52649us total) trans 4294968607 rc 0/0 00000100:00100000:1.0:1746144910.724393:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4472 00000100:00100000:3.0:1746144910.726446:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.726493:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.726548:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175449600 00000100:00100000:0.0:1746144910.726555:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175449600 00000100:00100000:0.0:1746144910.726596:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175449856 00000100:00100000:0.0:1746144910.726598:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175449856 00000100:00100000:0.0:1746144910.726627:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4473 00000100:00100000:0.0:1746144910.726634:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175449600:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:1.0:1746144910.726644:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4474 00000100:00100000:1.0:1746144910.726650:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175449856:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:0.0:1746144910.726661:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727516247 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.726663:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5321800/0x4076af672751624e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.726673:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.726673:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.726674:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.726674:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.726678:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5321800/0x4076af672751624e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.726678:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727516247 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.726688:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a5321800/0x4076af672751624e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.726688:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727516247 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.738247:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800a5321800/0x4076af672751624e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.738261:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a5321800/0x4076af672751624e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.738269:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a5321800/0x4076af672751624e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.738275:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5321800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.738279:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5321800/0x4076af672751624e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.738285:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a5321800/0x4076af672751624e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.738299:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a5321800/0x4076af672751624e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.738305:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a5321800/0x4076af672751624e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.738821:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175449856:12345-192.168.202.16@tcp:3:dd.0 Request processed in 12057us (12213us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144910.738830:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4474 00010000:00010000:0.0:1746144910.739129:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727516247 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.739137:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727516247 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.739143:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727516247 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.739148:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5d600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144910.739150:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727516247 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.739156:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727516247 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.739165:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727516247 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.739170:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5d600/0x4076af6727516247 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144910.739199:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a095880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175449600:12345-192.168.202.16@tcp:3:dd.0 Request processed in 12565us (12759us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144910.739204:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4473 00000100:00100000:1.0:1746144910.742388:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.742426:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.742482:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175450240 00000100:00100000:2.0:1746144910.742490:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175450240 00000100:00100000:0.0:1746144910.742493:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175450112 00000100:00100000:0.0:1746144910.742495:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175450112 00000100:00100000:0.0:1746144910.742542:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4475 00000100:00100000:2.0:1746144910.742546:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4476 00000100:00100000:0.0:1746144910.742548:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175450112:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144910.742550:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175450240:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:2.0:1746144910.742592:0:8437:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 26214400, mtime: 0x68140e8f, atime: 0x0, ctime: 0x68140e8f, blocks: 0xc80b 00010000:00010000:2.0:1746144910.742611:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af6727516255 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.742622:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.742622:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af672751625c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.742624:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144910.742627:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af6727516255 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.742637:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144910.742638:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af6727516255 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.742638:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.742640:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af672751625c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.742646:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af672751625c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1746144910.772396:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968608 is committed 00010000:00010000:3.0:1746144910.772433:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af6727516255 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.772445:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af6727516255 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.772456:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af6727516255 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.772462:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091cea000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144910.772465:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af6727516255 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.772472:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af6727516255 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.772489:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af6727516255 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.772494:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091cea000/0x4076af6727516255 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144910.772618:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1982:x1830965175450240:12345-192.168.202.16@tcp:4:dd.0 Request processed in 30062us (30232us total) trans 4294968608 rc 0/0 00000100:00100000:3.0:1746144910.772627:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4476 00010000:00010000:1.0:1746144910.799824:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af672751625c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.799836:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af672751625c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.799843:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af672751625c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.799852:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5da00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.799855:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af672751625c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.799862:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af672751625c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.799876:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af672751625c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.799882:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a5da00/0x4076af672751625c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.799951:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175450112:12345-192.168.202.16@tcp:4:dd.0 Request processed in 57399us (57520us total) trans 4294968609 rc 0/0 00000100:00100000:1.0:1746144910.799960:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4475 00000001:00080000:3.0:1746144910.800030:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968609 is committed 00000100:00100000:2.0:1746144910.805352:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.805394:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.805617:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175450624 00000100:00100000:1.0:1746144910.805625:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175450624 00000100:00100000:3.0:1746144910.805657:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175450880 00000100:00100000:3.0:1746144910.805661:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175450880 00000100:00100000:1.0:1746144910.805672:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4477 00000100:00100000:1.0:1746144910.805677:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175450624:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:1.0:1746144910.805698:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d35a600/0x4076af6727516263 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.805707:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.805708:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.805712:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012d35a600/0x4076af6727516263 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.805723:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012d35a600/0x4076af6727516263 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144910.805832:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4478 00000100:00100000:3.0:1746144910.805838:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175450880:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:3.0:1746144910.805944:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092553c00/0x4076af672751626a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.805958:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144910.805959:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144910.805962:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092553c00/0x4076af672751626a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.805971:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092553c00/0x4076af672751626a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.818225:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012d35a600/0x4076af6727516263 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.818241:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012d35a600/0x4076af6727516263 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.818248:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012d35a600/0x4076af6727516263 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.818254:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d35a600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.818258:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d35a600/0x4076af6727516263 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.818265:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012d35a600/0x4076af6727516263 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.818279:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012d35a600/0x4076af6727516263 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.818284:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012d35a600/0x4076af6727516263 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.818371:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093255c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175450624:12345-192.168.202.16@tcp:3:dd.0 Request processed in 12689us (13186us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144910.818383:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4477 00010000:00010000:3.0:1746144910.819507:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092553c00/0x4076af672751626a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.819517:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092553c00/0x4076af672751626a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.819523:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092553c00/0x4076af672751626a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.819528:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092553c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144910.819531:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092553c00/0x4076af672751626a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.819536:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092553c00/0x4076af672751626a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.819548:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092553c00/0x4076af672751626a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.819554:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092553c00/0x4076af672751626a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144910.819599:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175450880:12345-192.168.202.16@tcp:3:dd.0 Request processed in 13761us (14204us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144910.819606:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4478 00000100:00100000:3.0:1746144910.825077:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.825438:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175451136 00000100:00100000:0.0:1746144910.825451:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175451136 00000100:00100000:1.0:1746144910.825565:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4479 00000100:00100000:1.0:1746144910.825575:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175451136:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:1.0:1746144910.825613:0:31840:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 26214400, mtime: 0x68140e8f, atime: 0x0, ctime: 0x68140e8f, blocks: 0xc80b 00010000:00010000:1.0:1746144910.825620:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d35a000/0x4076af6727516271 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.825632:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.825634:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.825638:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d35a000/0x4076af6727516271 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.825648:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d35a000/0x4076af6727516271 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144910.825865:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.825901:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175451264 00000100:00100000:1.0:1746144910.825905:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175451264 00000100:00100000:1.0:1746144910.826076:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4480 00000100:00100000:1.0:1746144910.826082:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175451264:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:1.0:1746144910.826096:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516278 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.826103:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.826104:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.826107:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516278 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.826118:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516278 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1746144910.859396:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968610 is committed 00010000:00010000:1.0:1746144910.860059:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012d35a000/0x4076af6727516271 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.860071:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d35a000/0x4076af6727516271 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.860078:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d35a000/0x4076af6727516271 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.860084:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d35a000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.860088:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d35a000/0x4076af6727516271 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.860095:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d35a000/0x4076af6727516271 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.860111:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d35a000/0x4076af6727516271 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.860116:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d35a000/0x4076af6727516271 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.860178:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a096d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1983:x1830965175451136:12345-192.168.202.16@tcp:4:dd.0 Request processed in 34602us (35105us total) trans 4294968610 rc 0/0 00000100:00100000:1.0:1746144910.860190:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4479 00000001:00080000:2.0:1746144910.879956:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968611 is committed 00010000:00010000:1.0:1746144910.880089:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516278 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.880100:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516278 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.880108:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516278 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.880113:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0d0000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.880117:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516278 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.880123:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516278 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.880138:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516278 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.880143:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516278 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.880214:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175451264:12345-192.168.202.16@tcp:4:dd.0 Request processed in 54128us (54345us total) trans 4294968611 rc 0/0 00000100:00100000:1.0:1746144910.880223:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4480 00000100:00100000:2.0:1746144910.883107:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.883148:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175451776 00000100:00100000:1.0:1746144910.883156:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175451776 00000100:00100000:1.0:1746144910.883215:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4481 00000100:00100000:1.0:1746144910.883222:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175451776:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:1.0:1746144910.883248:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ad30e00/0x4076af672751627f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.883260:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.883262:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.883266:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad30e00/0x4076af672751627f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.883278:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad30e00/0x4076af672751627f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144910.884398:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.884452:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175451904 00000100:00100000:3.0:1746144910.884458:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175451904 00000100:00100000:3.0:1746144910.884488:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4482 00000100:00100000:3.0:1746144910.884493:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175451904:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:3.0:1746144910.884515:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092fea200/0x4076af6727516286 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.884524:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144910.884526:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144910.884529:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880092fea200/0x4076af6727516286 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.884539:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880092fea200/0x4076af6727516286 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.897857:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ad30e00/0x4076af672751627f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.897872:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad30e00/0x4076af672751627f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.897880:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ad30e00/0x4076af672751627f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.897886:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad30e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.897889:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ad30e00/0x4076af672751627f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.897896:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ad30e00/0x4076af672751627f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.897916:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ad30e00/0x4076af672751627f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.897921:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad30e00/0x4076af672751627f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.897996:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093257800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175451776:12345-192.168.202.16@tcp:3:dd.0 Request processed in 14769us (14891us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144910.898004:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4481 00010000:00010000:3.0:1746144910.898489:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880092fea200/0x4076af6727516286 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.898497:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880092fea200/0x4076af6727516286 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.898503:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880092fea200/0x4076af6727516286 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.898508:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092fea200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144910.898511:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880092fea200/0x4076af6727516286 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.898517:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880092fea200/0x4076af6727516286 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.898527:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880092fea200/0x4076af6727516286 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.898532:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092fea200/0x4076af6727516286 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144910.898637:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175451904:12345-192.168.202.16@tcp:3:dd.0 Request processed in 14141us (14242us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144910.898643:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4482 00000100:00100000:2.0:1746144910.903859:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.903913:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144910.904083:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175452160 00000100:00100000:3.0:1746144910.904091:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175452160 00000100:00100000:3.0:1746144910.904138:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175452288 00000100:00100000:3.0:1746144910.904141:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175452288 00000100:00100000:3.0:1746144910.904155:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4483 00000100:00100000:3.0:1746144910.904161:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175452160:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:3.0:1746144910.904197:0:31840:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 26214400, mtime: 0x68140e8f, atime: 0x0, ctime: 0x68140e8f, blocks: 0xc80b 00010000:00010000:3.0:1746144910.904203:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af672751628d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.904219:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144910.904221:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144910.904225:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af672751628d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144910.904236:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af672751628d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.904443:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4484 00000100:00100000:1.0:1746144910.904450:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1983:x1830965175452288:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:1.0:1746144910.904463:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727516294 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.904469:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.904471:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.904473:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727516294 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.904480:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727516294 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1746144910.938346:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968612 is committed 00010000:00010000:1.0:1746144910.938450:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af672751628d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.938461:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af672751628d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.938469:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af672751628d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.938476:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092553200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.938479:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af672751628d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.938486:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af672751628d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.938501:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af672751628d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.938506:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092553200/0x4076af672751628d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.938568:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093254380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1983:x1830965175452160:12345-192.168.202.16@tcp:4:dd.0 Request processed in 34404us (34713us total) trans 4294968612 rc 0/0 00000100:00100000:1.0:1746144910.938577:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4483 00000001:00080000:3.0:1746144910.961639:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968613 is committed 00010000:00010000:1.0:1746144910.961693:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727516294 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.961703:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727516294 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.961712:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727516294 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.961722:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad30c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.961725:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727516294 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.961732:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727516294 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.961811:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727516294 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.961818:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad30c00/0x4076af6727516294 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [13631488->14680063] (req 13631488->14680063) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.961885:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b058000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175452288:12345-192.168.202.16@tcp:4:dd.0 Request processed in 57432us (57967us total) trans 4294968613 rc 0/0 00000100:00100000:1.0:1746144910.961893:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4484 00000100:00100000:3.0:1746144910.965738:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.965811:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175452800 00000100:00100000:1.0:1746144910.965819:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175452800 00000100:00100000:3.0:1746144910.965829:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144910.965868:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175452928 00000100:00100000:1.0:1746144910.965871:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175452928 00000100:00100000:1.0:1746144910.965887:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4485 00000100:00100000:1.0:1746144910.965893:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175452800:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:0.0:1746144910.965897:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4486 00000100:00100000:0.0:1746144910.965905:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136380000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175452928:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:1.0:1746144910.965921:0:8437:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751629b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.965923:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.965933:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.965933:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.965935:0:8437:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.965935:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144910.965938:0:8437:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751629b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.965938:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.965948:0:8437:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751629b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.965948:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.973285:0:8437:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751629b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.973300:0:8437:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751629b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.973306:0:8437:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751629b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.973312:0:8437:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bb68000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144910.973315:0:8437:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751629b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.973322:0:8437:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751629b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.973349:0:8437:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751629b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144910.973355:0:8437:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68000/0x4076af672751629b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144910.973420:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a094a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175452800:12345-192.168.202.16@tcp:3:dd.0 Request processed in 7522us (7683us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144910.973430:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4485 00010000:00010000:0.0:1746144910.975125:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.975137:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.975144:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.975149:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b466600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144910.975152:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.975158:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.975169:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144910.975175:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [7340032->8388607] (req 7340032->8388607) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144910.975214:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136380000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175452928:12345-192.168.202.16@tcp:3:dd.0 Request processed in 9308us (9384us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144910.975221:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4486 00000100:00100000:3.0:1746144910.982659:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144910.982693:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175453184 00000100:00100000:0.0:1746144910.982701:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175453184 00000100:00100000:0.0:1746144910.982757:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4487 00000100:00100000:0.0:1746144910.982787:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136380380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175453184:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144910.982789:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144910.982810:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175453312 00000100:00100000:2.0:1746144910.982814:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175453312 00002000:00010000:0.0:1746144910.982834:0:31840:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 26214400, mtime: 0x68140e8f, atime: 0x0, ctime: 0x68140e8f, blocks: 0xc80b 00000100:00100000:2.0:1746144910.982841:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4488 00010000:00010000:0.0:1746144910.982841:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144910.982845:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136380700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175453312:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:0.0:1746144910.982852:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.982854:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.982858:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.982859:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092704800/0x4076af67275162b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.982868:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144910.982868:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.982869:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144910.982871:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092704800/0x4076af67275162b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144910.982879:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092704800/0x4076af67275162b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1746144911.019650:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968614 is committed 00010000:00010000:2.0:1746144911.019866:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880092704800/0x4076af67275162b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.019877:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092704800/0x4076af67275162b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.019885:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092704800/0x4076af67275162b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.019895:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092704800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144911.019899:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092704800/0x4076af67275162b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.019906:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092704800/0x4076af67275162b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.019921:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092704800/0x4076af67275162b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.019925:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092704800/0x4076af67275162b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [15728640->16777215] (req 15728640->16777215) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144911.020934:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136380700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1985:x1830965175453312:12345-192.168.202.16@tcp:4:dd.0 Request processed in 38082us (38165us total) trans 4294968614 rc 0/0 00000100:00100000:2.0:1746144911.020943:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4488 00000001:00080000:3.0:1746144911.045649:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968615 is committed 00010000:00010000:1.0:1746144911.045816:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.045826:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.045832:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.045837:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b466600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144911.045840:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.045846:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.045859:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.045864:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b466600/0x4076af67275162a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [14680064->15728639] (req 14680064->15728639) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144911.045940:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136380380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175453184:12345-192.168.202.16@tcp:4:dd.0 Request processed in 63172us (63284us total) trans 4294968615 rc 0/0 00000100:00100000:1.0:1746144911.045948:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4487 00000100:00100000:3.0:1746144911.052050:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144911.052331:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.052492:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175453824 00000100:00100000:1.0:1746144911.052501:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175453824 00000100:00100000:1.0:1746144911.052655:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175453952 00000100:00100000:1.0:1746144911.052658:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175453952 00000100:00100000:2.0:1746144911.052721:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4489 00000100:00100000:2.0:1746144911.052730:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136380a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175453824:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:2.0:1746144911.052758:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af67275162b7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.052798:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144911.052799:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144911.052804:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af67275162b7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.052814:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af67275162b7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144911.053710:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4490 00000100:00100000:1.0:1746144911.053718:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175453952:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:1.0:1746144911.053736:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275162be lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.053745:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144911.053746:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144911.053748:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275162be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.053757:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275162be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.069954:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af67275162b7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.069969:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af67275162b7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.069976:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af67275162b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.069982:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092fea600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144911.069985:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af67275162b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.069991:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af67275162b7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.070006:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af67275162b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.070012:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880092fea600/0x4076af67275162b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.070162:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275162be lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.070169:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275162be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.070175:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275162be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.070179:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bb69600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144911.070182:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275162be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.070186:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275162be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.070197:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275162be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.070202:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb69600/0x4076af67275162be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [8388608->9437183] (req 8388608->9437183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144911.070261:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136380e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175453952:12345-192.168.202.16@tcp:3:dd.0 Request processed in 16539us (17924us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.070269:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4490 00000100:00100000:0.0:1746144911.070421:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136380a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175453824:12345-192.168.202.16@tcp:3:dd.0 Request processed in 17693us (18378us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.070427:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4489 00000100:00100000:3.0:1746144911.076234:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144911.076280:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.076341:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175454208 00000100:00100000:0.0:1746144911.076349:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175454208 00000100:00100000:0.0:1746144911.076404:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175454336 00000100:00100000:0.0:1746144911.076406:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175454336 00000100:00100000:0.0:1746144911.076422:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4491 00000100:00100000:0.0:1746144911.076429:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175454208:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:0.0:1746144911.076468:0:1854:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 26214400, mtime: 0x68140e8f, atime: 0x0, ctime: 0x68140e8f, blocks: 0xc80b 00010000:00010000:0.0:1746144911.076475:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af67275162c5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.076486:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144911.076488:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144911.076493:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af67275162c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.076503:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af67275162c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144911.076613:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4492 00000100:00100000:0.0:1746144911.076619:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175454336:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:0.0:1746144911.076634:0:25064:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af67275162cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.076641:0:25064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144911.076642:0:25064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144911.076644:0:25064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af67275162cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.076651:0:25064:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af67275162cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1746144911.115653:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968616 is committed 00010000:00010000:1.0:1746144911.116001:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af67275162c5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.116011:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af67275162c5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.116019:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af67275162c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.116024:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094377800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144911.116027:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af67275162c5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.116034:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af67275162c5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.116048:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af67275162c5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.116057:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094377800/0x4076af67275162c5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [16777216->17825791] (req 16777216->17825791) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144911.116139:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136381180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1985:x1830965175454208:12345-192.168.202.16@tcp:4:dd.0 Request processed in 39696us (39898us total) trans 4294968616 rc 0/0 00000100:00100000:1.0:1746144911.116148:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4491 00000001:00080000:3.0:1746144911.142920:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968617 is committed 00010000:00010000:2.0:1746144911.142994:0:25064:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af67275162cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.143006:0:25064:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af67275162cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.143013:0:25064:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af67275162cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.143019:0:25064:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880094376600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144911.143022:0:25064:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af67275162cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.143030:0:25064:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af67275162cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.143045:0:25064:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af67275162cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.143051:0:25064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094376600/0x4076af67275162cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [17825792->18874367] (req 17825792->18874367) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144911.143123:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136381500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175454336:12345-192.168.202.16@tcp:4:dd.0 Request processed in 66499us (66838us total) trans 4294968617 rc 0/0 00000100:00100000:2.0:1746144911.143132:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4492 00000100:00100000:3.0:1746144911.146199:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144911.146297:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.146451:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175454976 00000100:00100000:2.0:1746144911.146459:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175454976 00000100:00100000:2.0:1746144911.146512:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175454848 00000100:00100000:2.0:1746144911.146515:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175454848 00000100:00100000:2.0:1746144911.146547:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4493 00000100:00100000:2.0:1746144911.146553:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136381880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175454976:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:2.0:1746144911.146581:0:25064:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a5cc00/0x4076af67275162d3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.146593:0:25064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144911.146595:0:25064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144911.146599:0:25064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5cc00/0x4076af67275162d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.146609:0:25064:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a5cc00/0x4076af67275162d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144911.146748:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4494 00000100:00100000:0.0:1746144911.146757:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175454848:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:0.0:1746144911.146807:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800927d0c00/0x4076af67275162da lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.146816:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144911.146817:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144911.146822:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800927d0c00/0x4076af67275162da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.146830:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800927d0c00/0x4076af67275162da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.156994:0:25064:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a5cc00/0x4076af67275162d3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.157009:0:25064:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5cc00/0x4076af67275162d3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.157017:0:25064:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a5cc00/0x4076af67275162d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.157023:0:25064:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5cc00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144911.157027:0:25064:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5cc00/0x4076af67275162d3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.157035:0:25064:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5cc00/0x4076af67275162d3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.157049:0:25064:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a5cc00/0x4076af67275162d3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.157054:0:25064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a5cc00/0x4076af67275162d3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144911.157126:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136381880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175454976:12345-192.168.202.16@tcp:3:dd.0 Request processed in 10567us (10929us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144911.157135:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4493 00010000:00010000:0.0:1746144911.159821:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800927d0c00/0x4076af67275162da lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.159834:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800927d0c00/0x4076af67275162da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.159842:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800927d0c00/0x4076af67275162da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.159848:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927d0c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144911.159851:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800927d0c00/0x4076af67275162da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.159857:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800927d0c00/0x4076af67275162da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.159870:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800927d0c00/0x4076af67275162da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.159874:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800927d0c00/0x4076af67275162da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [9437184->10485759] (req 9437184->10485759) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144911.159940:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136381c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175454848:12345-192.168.202.16@tcp:3:dd.0 Request processed in 13181us (13639us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.159948:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4494 00000100:00100000:3.0:1746144911.167061:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144911.167106:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.167109:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175455360 00000100:00100000:2.0:1746144911.167148:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175455232 00000100:00100000:2.0:1746144911.167153:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175455232 00000100:00100000:2.0:1746144911.167214:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4495 00000100:00100000:2.0:1746144911.167221:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136382300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175455232:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:2.0:1746144911.167263:0:25064:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 26214400, mtime: 0x68140e8f, atime: 0x0, ctime: 0x68140e8f, blocks: 0xc80b 00010000:00010000:2.0:1746144911.167269:0:25064:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b76ee00/0x4076af67275162e1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.167280:0:25064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144911.167282:0:25064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144911.167287:0:25064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b76ee00/0x4076af67275162e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.167299:0:25064:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b76ee00/0x4076af67275162e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144911.167429:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175455360 00000100:00100000:0.0:1746144911.167452:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4496 00000100:00100000:0.0:1746144911.167457:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175455360:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:0.0:1746144911.167468:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800927d1600/0x4076af67275162e8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.167479:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144911.167480:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144911.167532:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800927d1600/0x4076af67275162e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.167540:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800927d1600/0x4076af67275162e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.201361:0:25064:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b76ee00/0x4076af67275162e1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.201373:0:25064:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b76ee00/0x4076af67275162e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.201381:0:25064:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b76ee00/0x4076af67275162e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.201387:0:25064:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b76ee00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144911.201390:0:25064:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b76ee00/0x4076af67275162e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.201397:0:25064:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b76ee00/0x4076af67275162e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.201411:0:25064:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b76ee00/0x4076af67275162e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.201416:0:25064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b76ee00/0x4076af67275162e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [18874368->19922943] (req 18874368->19922943) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144911.201475:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136382300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+13:1982:x1830965175455232:12345-192.168.202.16@tcp:4:dd.0 Request processed in 34251us (34365us total) trans 4294968618 rc 0/0 00000100:00100000:2.0:1746144911.201484:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4495 00000001:00080000:3.0:1746144911.201670:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968618 is committed 00000001:00080000:3.0:1746144911.224346:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968619 is committed 00010000:00010000:0.0:1746144911.224400:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800927d1600/0x4076af67275162e8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.224411:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800927d1600/0x4076af67275162e8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.224417:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800927d1600/0x4076af67275162e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.224423:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800927d1600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144911.224426:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800927d1600/0x4076af67275162e8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.224433:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800927d1600/0x4076af67275162e8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.224448:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800927d1600/0x4076af67275162e8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.224454:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800927d1600/0x4076af67275162e8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [19922944->20971519] (req 19922944->20971519) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144911.224608:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136381f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175455360:12345-192.168.202.16@tcp:4:dd.0 Request processed in 57145us (57550us total) trans 4294968619 rc 0/0 00000100:00100000:0.0:1746144911.224617:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4496 00000100:00100000:3.0:1746144911.227110:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144911.227158:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.227223:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175455744 00000100:00100000:0.0:1746144911.227230:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175455744 00000100:00100000:2.0:1746144911.227264:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175456000 00000100:00100000:2.0:1746144911.227267:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175456000 00000100:00100000:0.0:1746144911.227278:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4497 00000100:00100000:0.0:1746144911.227284:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175455744:12345-192.168.202.16@tcp:3:dd.0 00000100:00100000:2.0:1746144911.227303:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4498 00000100:00100000:2.0:1746144911.227308:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175456000:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:0.0:1746144911.227311:0:31840:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5097e00/0x4076af67275162ef lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.227321:0:25064:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d0d8800/0x4076af67275162f6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.227322:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144911.227323:0:31840:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144911.227327:0:25064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144911.227328:0:25064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144911.227328:0:31840:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5097e00/0x4076af67275162ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.227330:0:25064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0d8800/0x4076af67275162f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.227337:0:25064:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d0d8800/0x4076af67275162f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.227337:0:31840:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a5097e00/0x4076af67275162ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.236949:0:31840:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800a5097e00/0x4076af67275162ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.236964:0:31840:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a5097e00/0x4076af67275162ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.236971:0:31840:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a5097e00/0x4076af67275162ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.236982:0:31840:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a5097e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144911.236985:0:31840:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5097e00/0x4076af67275162ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.236996:0:31840:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a5097e00/0x4076af67275162ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.237011:0:31840:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a5097e00/0x4076af67275162ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.237017:0:31840:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a5097e00/0x4076af67275162ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31840 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144911.237072:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136382680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175455744:12345-192.168.202.16@tcp:3:dd.0 Request processed in 9784us (9966us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.237081:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4497 00010000:00010000:2.0:1746144911.238155:0:25064:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012d0d8800/0x4076af67275162f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.238168:0:25064:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012d0d8800/0x4076af67275162f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.238175:0:25064:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012d0d8800/0x4076af67275162f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.238180:0:25064:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012d0d8800 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144911.238183:0:25064:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d0d8800/0x4076af67275162f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.238190:0:25064:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012d0d8800/0x4076af67275162f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.238202:0:25064:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012d0d8800/0x4076af67275162f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.238207:0:25064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d0d8800/0x4076af67275162f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [10485760->11534335] (req 10485760->11534335) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144911.238253:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136382a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175456000:12345-192.168.202.16@tcp:3:dd.0 Request processed in 10944us (11093us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144911.238260:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4498 00000100:00100000:3.0:1746144911.242191:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144911.242312:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.242425:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175456256 00000100:00100000:2.0:1746144911.242433:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175456256 00000100:00100000:2.0:1746144911.242479:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175456384 00000100:00100000:2.0:1746144911.242482:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175456384 00000100:00100000:2.0:1746144911.242510:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4499 00000100:00100000:2.0:1746144911.242516:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175456256:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144911.242541:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4500 00000100:00100000:1.0:1746144911.242547:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175456384:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:2.0:1746144911.242557:0:25064:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 26214400, mtime: 0x68140e8f, atime: 0x0, ctime: 0x68140e8f, blocks: 0xc80b 00010000:00010000:1.0:1746144911.242573:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727516304 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.242585:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144911.242587:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144911.242591:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727516304 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.242603:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727516304 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.242655:0:25064:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af67275162fd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.242664:0:25064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144911.242665:0:25064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144911.242667:0:25064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af67275162fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.242679:0:25064:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af67275162fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1746144911.273509:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968620 is committed 00010000:00010000:1.0:1746144911.273595:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727516304 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.273606:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727516304 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.273613:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727516304 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.273619:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091751e00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144911.273622:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727516304 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.273628:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727516304 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.273642:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727516304 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.273646:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091751e00/0x4076af6727516304 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [22020096->23068671] (req 22020096->23068671) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144911.273707:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136383100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1985:x1830965175456384:12345-192.168.202.16@tcp:4:dd.0 Request processed in 31156us (31390us total) trans 4294968620 rc 0/0 00000100:00100000:1.0:1746144911.273715:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4500 00000001:00080000:2.0:1746144911.298837:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968621 is committed 00010000:00010000:1.0:1746144911.299070:0:25064:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af67275162fd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.299084:0:25064:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af67275162fd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.299091:0:25064:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af67275162fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.299096:0:25064:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091709400 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144911.299101:0:25064:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af67275162fd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.299108:0:25064:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af67275162fd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.299123:0:25064:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af67275162fd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.299128:0:25064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091709400/0x4076af67275162fd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [20971520->22020095] (req 20971520->22020095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144911.299209:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136382d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175456256:12345-192.168.202.16@tcp:4:dd.0 Request processed in 56688us (57021us total) trans 4294968621 rc 0/0 00000100:00100000:1.0:1746144911.299218:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4499 00000100:00100000:0.0:1746144911.305006:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.305072:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175456768 00000100:00100000:1.0:1746144911.305081:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175456768 00000100:00100000:1.0:1746144911.305147:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4501 00000100:00100000:1.0:1746144911.305156:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175456768:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:1.0:1746144911.305183:0:25064:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751630b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.305196:0:25064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144911.305197:0:25064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144911.305201:0:25064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751630b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.305213:0:25064:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751630b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144911.305900:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.305945:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175457024 00000100:00100000:2.0:1746144911.305950:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175457024 00000100:00100000:2.0:1746144911.305982:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4502 00000100:00100000:2.0:1746144911.305988:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175457024:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:2.0:1746144911.306005:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e907c00/0x4076af6727516312 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.306013:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144911.306015:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144911.306018:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e907c00/0x4076af6727516312 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.306026:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e907c00/0x4076af6727516312 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.314032:0:25064:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751630b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.314046:0:25064:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751630b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.314053:0:25064:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751630b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.314058:0:25064:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0d0000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144911.314061:0:25064:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751630b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.314068:0:25064:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751630b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.314083:0:25064:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751630b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.314088:0:25064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0000/0x4076af672751630b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144911.314144:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175456768:12345-192.168.202.16@tcp:3:dd.0 Request processed in 8986us (9139us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.314152:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4501 00010000:00010000:2.0:1746144911.317237:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012e907c00/0x4076af6727516312 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.317250:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e907c00/0x4076af6727516312 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.317257:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e907c00/0x4076af6727516312 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.317267:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e907c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144911.317271:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e907c00/0x4076af6727516312 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.317276:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e907c00/0x4076af6727516312 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.317291:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e907c00/0x4076af6727516312 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.317295:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e907c00/0x4076af6727516312 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [11534336->12582911] (req 11534336->12582911) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144911.317350:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136383480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175457024:12345-192.168.202.16@tcp:3:dd.0 Request processed in 11358us (11447us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144911.317359:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4502 00000100:00100000:3.0:1746144911.322224:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144911.322272:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.322513:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175457280 00000100:00100000:1.0:1746144911.322520:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175457280 00000100:00100000:1.0:1746144911.322706:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175457408 00000100:00100000:1.0:1746144911.322709:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175457408 00000100:00100000:1.0:1746144911.322734:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4503 00000100:00100000:1.0:1746144911.322741:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1983:x1830965175457280:12345-192.168.202.16@tcp:4:dd.0 00002000:00010000:1.0:1746144911.322814:0:25064:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 26214400, mtime: 0x68140e8f, atime: 0x0, ctime: 0x68140e8f, blocks: 0xc80b 00010000:00010000:1.0:1746144911.322822:0:25064:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0200/0x4076af6727516319 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.322834:0:25064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144911.322836:0:25064:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144911.322841:0:25064:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0200/0x4076af6727516319 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.322852:0:25064:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0200/0x4076af6727516319 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144911.322879:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4504 00000100:00100000:2.0:1746144911.322888:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136383b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175457408:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:2.0:1746144911.322904:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e907200/0x4076af6727516320 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.322912:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144911.322914:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144911.322916:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012e907200/0x4076af6727516320 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.322929:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012e907200/0x4076af6727516320 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1746144911.356787:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968622 is committed 00010000:00010000:1.0:1746144911.357055:0:25064:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0200/0x4076af6727516319 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.357067:0:25064:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0200/0x4076af6727516319 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.357074:0:25064:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0200/0x4076af6727516319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.357080:0:25064:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0d0200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144911.357083:0:25064:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0200/0x4076af6727516319 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.357094:0:25064:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0200/0x4076af6727516319 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.357108:0:25064:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0200/0x4076af6727516319 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.357114:0:25064:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0200/0x4076af6727516319 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [23068672->24117247] (req 23068672->24117247) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25064 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144911.357184:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136383800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1983:x1830965175457280:12345-192.168.202.16@tcp:4:dd.0 Request processed in 34439us (34964us total) trans 4294968622 rc 0/0 00000100:00100000:1.0:1746144911.357193:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4503 00000001:00080000:2.0:1746144911.376543:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968623 is committed 00010000:00010000:0.0:1746144911.376572:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012e907200/0x4076af6727516320 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.376583:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012e907200/0x4076af6727516320 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.376590:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012e907200/0x4076af6727516320 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.376595:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e907200 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144911.376600:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e907200/0x4076af6727516320 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.376607:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012e907200/0x4076af6727516320 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.376621:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012e907200/0x4076af6727516320 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.376627:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012e907200/0x4076af6727516320 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [24117248->25165823] (req 24117248->25165823) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144911.376702:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136383b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1982:x1830965175457408:12345-192.168.202.16@tcp:4:dd.0 Request processed in 53812us (54425us total) trans 4294968623 rc 0/0 00000100:00100000:0.0:1746144911.376710:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4504 00000100:00100000:0.0:1746144911.380597:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.381165:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175457792 00000100:00100000:2.0:1746144911.381172:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175457792 00000100:00100000:2.0:1746144911.381343:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4505 00000100:00100000:2.0:1746144911.381350:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175457792:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:2.0:1746144911.381377:0:1854:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516327 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.381389:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144911.381391:0:1854:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144911.381394:0:1854:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516327 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.381405:0:1854:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516327 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.389228:0:1854:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516327 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.389242:0:1854:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516327 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.389249:0:1854:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516327 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.389260:0:1854:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e907c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144911.389264:0:1854:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516327 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.389270:0:1854:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516327 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.389285:0:1854:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516327 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144911.389290:0:1854:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516327 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [12582912->13631487] (req 12582912->13631487) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1854 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144911.389344:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093f46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175457792:12345-192.168.202.16@tcp:3:dd.0 Request processed in 7991us (8750us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144911.389352:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4505 00000100:00100000:3.0:1746144911.392334:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.393004:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175457920 00000100:00100000:1.0:1746144911.393012:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175457920 00000100:00100000:1.0:1746144911.393097:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5895 00000100:00100000:1.0:1746144911.393108:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1127:x1830965175457920:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1746144911.393124:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144911.393139:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af672751632e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af956d8 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144911.393158:0:8430:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 26214400, mtime: 0x68140e8f, atime: 0x0, ctime: 0x68140e8f, blocks: 0xc80b 00010000:00010000:1.0:1746144911.393175:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144911.393177:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144911.393183:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af672751632e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 25165824->26214399) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956d8 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.393201:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009966c000/0x4076af672751632e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 25165824->26214399) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956d8 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.393209:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009966c000, rc 0) 00000100:00100000:1.0:1746144911.393643:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131988000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1127:x1830965175457920:12345-192.168.202.16@tcp:101:dd.0 Request processed in 538us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144911.393649:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5895 00000100:00100000:0.0:1746144911.406543:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.406612:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175458176 00000100:00100000:2.0:1746144911.406621:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175458176 00002000:00100000:2.0:1746144911.406656:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1c:0x0] (25165824->26214399) req@ffff880132754000 x1830965175458176/t0(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144911.406812:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132754000 with x1830965175458176 ext(25165824->26214399) 00002000:00010000:2.0:1746144911.406818:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132754000 00000100:00100000:2.0:1746144911.406954:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4506 00000100:00100000:2.0:1746144911.406961:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175458176:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144911.414096:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132754000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965175458176:12345-192.168.202.16@tcp:4:dd.0 Request processed in 7127us (7554us total) trans 4294968624 rc 0/0 00000100:00100000:2.0:1746144911.414106:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4506 00002000:00100000:2.0:1746144911.414116:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1c:0x0] (25165824->26214399) req@ffff880132754000 x1830965175458176/t4294968624(0) o4->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/448 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144911.414124:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132754000 with x1830965175458176 ext(25165824->26214399) 00002000:00010000:2.0:1746144911.414128:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132754000 00000100:00100000:0.0:1746144911.415607:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.415670:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175458304 00000100:00100000:1.0:1746144911.415677:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175458304 00000100:00100000:1.0:1746144911.415883:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5896 00000100:00100000:1.0:1746144911.415891:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175458304:12345-192.168.202.16@tcp:16:dd.0 00000001:00080000:2.0:1746144911.434012:0:9875:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 4294968624 is committed 00000100:00100000:1.0:1746144911.434096:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132754380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175458304:12345-192.168.202.16@tcp:16:dd.0 Request processed in 18202us (18488us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144911.434103:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5896 00000100:00100000:3.0:1746144911.436939:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.437062:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175458560 00000100:00100000:1.0:1746144911.437069:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175458560 00000100:00100000:1.0:1746144911.437129:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 174 00000100:00080000:2.0:1746144911.437135:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746144911.437136:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+29:1127:x1830965175458560:12345-192.168.202.16@tcp:35:dd.0 00000100:00100000:1.0:1746144911.437342:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1127:x1830965175458560:12345-192.168.202.16@tcp:35:dd.0 Request processed in 205us (410us total) trans 4294987544 rc 0/0 00000100:00100000:1.0:1746144911.437348:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 174 00000100:00100000:2.0:1746144911.445051:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.446404:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175458688 00000100:00100000:1.0:1746144911.446413:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175458688 00000100:00100000:1.0:1746144911.446454:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48280 00000100:00100000:1.0:1746144911.446462:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+30:1132:x1830965175458688:12345-192.168.202.16@tcp:101:checkstat.0 00010000:00010000:1.0:1746144911.446481:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144911.446497:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466e00/0x4076af6727516335 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af956df expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.446544:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af672751633c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144911.446554:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af672751633c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144911.446565:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af672751633c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:1.0:1746144911.446609:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:1.0:1746144911.446613:0:7111:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144911.446626:0:7111:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af672751633c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144911.446643:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466e00/0x4076af6727516335 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956df expref: 32 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.446658:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af672751633c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956df expref: 31 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.446664:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:1.0:1746144911.446667:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746144911.446669:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b466600, rc 0) 00000100:00100000:1.0:1746144911.446723:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b058380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1132:x1830965175458688:12345-192.168.202.16@tcp:101:checkstat.0 Request processed in 261us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144911.446729:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48280 00000100:00100000:1.0:1746144911.450449:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.450637:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144911.451045:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175458816 00000100:00100000:3.0:1746144911.451052:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175458816 00000100:00100000:3.0:1746144911.451085:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48281 00000100:00100000:3.0:1746144911.451092:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1132:x1830965175458816:12345-192.168.202.16@tcp:101:checkstat.0 00010000:00010000:3.0:1746144911.451106:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144911.451120:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c400/0x4076af6727516343 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af956e6 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144911.451167:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5ce00/0x4076af672751634a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451177:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5ce00/0x4076af672751634a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451186:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5ce00/0x4076af672751634a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451196:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727516351 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451202:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727516351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451206:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727516351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451277:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c600/0x4076af6727516358 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451284:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c600/0x4076af6727516358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451289:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c600/0x4076af6727516358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:3.0:1746144911.451311:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 26214400 00000004:00200000:3.0:1746144911.451314:0:7113:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1746144911.451326:0:7113:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c600/0x4076af6727516358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451333:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c600/0x4076af6727516358 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451338:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5ce00/0x4076af672751634a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451342:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5ce00/0x4076af672751634a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451347:0:7113:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5ce00/0x4076af672751634a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451351:0:7113:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5ce00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144911.451354:0:7113:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5ce00/0x4076af672751634a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451359:0:7113:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5ce00/0x4076af672751634a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451366:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:3.0:1746144911.451368:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144911.451371:0:7113:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5ce00/0x4076af672751634a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451375:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5ce00/0x4076af672751634a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451382:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727516351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451385:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727516351 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451389:0:7113:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727516351 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451392:0:7113:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5c200 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144911.451394:0:7113:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727516351 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451398:0:7113:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727516351 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451403:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff88009a8b7700) 00010000:00010000:3.0:1746144911.451404:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144911.451406:0:7113:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727516351 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451410:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c200/0x4076af6727516351 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144911.451429:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c400/0x4076af6727516343 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956e6 expref: 33 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144911.451439:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c600/0x4076af6727516358 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956e6 expref: 32 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144911.451445:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff88009a8b7e00) 00010000:00010000:3.0:1746144911.451446:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144911.451448:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c600, rc 0) 00000100:00100000:3.0:1746144911.451481:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1132:x1830965175458816:12345-192.168.202.16@tcp:101:checkstat.0 Request processed in 390us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144911.451486:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48281 00000100:00100000:0.0:1746144911.451548:0:7117:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175458944 00000100:00100000:0.0:1746144911.451552:0:7117:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175458944 00000100:00100000:0.0:1746144911.451570:0:7117:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:0.0:1746144911.451575:0:7117:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1983:x1830965175458944:12345-192.168.202.16@tcp:63:ll_sa.0 00010000:00010000:0.0:1746144911.451591:0:7117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144911.451597:0:7117:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fb600/0x4076af672751635f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af956ed expref: -99 pid: 7117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.451615:0:7117:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800916faa00/0x4076af6727516366 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451625:0:7117:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800916faa00/0x4076af6727516366 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451630:0:7117:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800916faa00/0x4076af6727516366 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451637:0:7117:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fbc00/0x4076af672751636d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451641:0:7117:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fbc00/0x4076af672751636d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451646:0:7117:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fbc00/0x4076af672751636d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451663:0:7117:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800916faa00/0x4076af6727516366 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451667:0:7117:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800916faa00/0x4076af6727516366 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451671:0:7117:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800916faa00/0x4076af6727516366 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451674:0:7117:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800916faa00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144911.451676:0:7117:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800916faa00/0x4076af6727516366 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451680:0:7117:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800916faa00/0x4076af6727516366 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451684:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:0.0:1746144911.451686:0:7117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144911.451688:0:7117:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800916faa00/0x4076af6727516366 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451692:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800916faa00/0x4076af6727516366 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451699:0:7117:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fbc00/0x4076af672751636d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451703:0:7117:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fbc00/0x4076af672751636d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451706:0:7117:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fbc00/0x4076af672751636d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451709:0:7117:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800916fbc00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144911.451711:0:7117:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fbc00/0x4076af672751636d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451715:0:7117:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fbc00/0x4076af672751636d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451719:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfe6ecf (ffff880093f4c800) 00010000:00010000:0.0:1746144911.451720:0:7117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144911.451721:0:7117:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fbc00/0x4076af672751636d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451725:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fbc00/0x4076af672751636d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7117 initiator: MDT0 00010000:00010000:0.0:1746144911.451745:0:7117:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fb600/0x4076af672751635f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956ed expref: 33 pid: 7117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.451751:0:7117:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:0.0:1746144911.451753:0:7117:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746144911.451755:0:7117:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800916fb600/0x4076af672751635f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956ed expref: 33 pid: 7117 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.451773:0:7117:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800916fb600, rc -2) 00000100:00100000:0.0:1746144911.451803:0:7117:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1983:x1830965175458944:12345-192.168.202.16@tcp:63:ll_sa.0 Request processed in 227us (1165us total) trans 0 rc -2/-2 00000100:00100000:0.0:1746144911.451808:0:7117:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 7 00000100:00100000:1.0:1746144911.454099:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.454198:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144911.454438:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175459072 00000100:00100000:3.0:1746144911.454446:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175459072 00000100:00100000:3.0:1746144911.454495:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 297 00000100:00100000:3.0:1746144911.454501:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1984:x1830965175459072:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144911.454512:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144911.454531:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5c600/0x4076af6727516358 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956e6 expref: 32 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144911.454545:0:9812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff88009a8b7e00) 00010000:00010000:3.0:1746144911.454549:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144911.454592:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1984:x1830965175459072:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 91us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144911.454598:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 297 00000100:00100000:1.0:1746144911.454841:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.454892:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175459200 00000100:00100000:0.0:1746144911.454895:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175459200 00000100:00100000:0.0:1746144911.454920:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175459328 00000100:00100000:0.0:1746144911.454921:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175459328 00000100:00100000:2.0:1746144911.454931:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5897 00000100:00100000:2.0:1746144911.454939:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175459200:12345-192.168.202.16@tcp:101:checkstat.0 00000100:00100000:0.0:1746144911.454942:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5898 00000100:00100000:0.0:1746144911.454947:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175459328:12345-192.168.202.16@tcp:101:checkstat.0 00010000:00010000:2.0:1746144911.454951:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144911.454955:0:8430:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144911.454962:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5fe00/0x4076af6727516374 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af956f4 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.454964:0:8430:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0200/0x4076af672751637b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af956fb expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144911.454997:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b058700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172545920:192.168.202.16@tcp:106: 00000100:00100000:0.0:1746144911.454997:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132754700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172545792:192.168.202.16@tcp:106: 00000100:00100000:2.0:1746144911.455040:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4691c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746144911.455128:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a893b40 going to sleep for 11 seconds 00002000:00010000:2.0:1746144911.458520:0:10401:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb size: 0 -> 13631488 00002000:00010000:2.0:1746144911.458527:0:10401:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb mtime: 0 -> 1746144911 00002000:00010000:2.0:1746144911.458529:0:10401:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb atime: 0 -> 1746144910 00002000:00010000:2.0:1746144911.458530:0:10401:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x1c:0x0] updating lvb ctime: 0 -> 1746144911 00000100:00100000:2.0:1746144911.458549:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b058700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172545920:192.168.202.16@tcp:106: 00010000:00010000:2.0:1746144911.458576:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5fe00/0x4076af6727516374 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956f4 expref: 8 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144911.458594:0:10401:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5fe00/0x4076af6727516374 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956f4 expref: 8 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144911.458617:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5fe00, rc 0) 00002000:00010000:0.0:1746144911.458629:0:8430:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb size: 0 -> 12582912 00002000:00010000:0.0:1746144911.458632:0:8430:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb mtime: 0 -> 1746144911 00002000:00010000:0.0:1746144911.458634:0:8430:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb atime: 0 -> 1746144910 00002000:00010000:0.0:1746144911.458636:0:8430:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb ctime: 0 -> 1746144911 00002000:00010000:0.0:1746144911.458637:0:8430:0:(ofd_lvb.c:282:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb blocks: 1 -> 20487 00002000:00010000:0.0:1746144911.458646:0:8430:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1d:0x0] updating lvb blocks from disk: 20487 -> 24585 00000100:00100000:0.0:1746144911.458651:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132754700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172545792:192.168.202.16@tcp:106: 00000100:00100000:2.0:1746144911.458661:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d367480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1983:x1830965175459200:12345-192.168.202.16@tcp:101:checkstat.0 Request processed in 3722us (4462us total) trans 0 rc 301/301 00010000:00010000:0.0:1746144911.458667:0:8430:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0200/0x4076af672751637b lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956fb expref: 9 pid: 8430 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746144911.458668:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5897 00010000:00010000:0.0:1746144911.458677:0:8430:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0200/0x4076af672751637b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956fb expref: 9 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144911.458685:0:8430:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d0200, rc 0) 00000100:00100000:0.0:1746144911.458704:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175459328:12345-192.168.202.16@tcp:101:checkstat.0 Request processed in 3756us (3862us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144911.458709:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5898 00000100:00100000:0.0:1746144911.466083:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.466172:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175459456 00000100:00100000:1.0:1746144911.466180:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175459456 00000100:00100000:1.0:1746144911.466215:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48282 00000100:00100000:1.0:1746144911.466222:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+23:1134:x1830965175459456:12345-192.168.202.16@tcp:101:checkstat.0 00010000:00010000:1.0:1746144911.466239:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144911.466253:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467200/0x4076af6727516382 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95702 expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.466298:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727516389 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144911.466308:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727516389 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144911.466317:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727516389 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:1.0:1746144911.466361:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:1.0:1746144911.466365:0:7111:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144911.466377:0:7111:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727516389 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144911.466394:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467200/0x4076af6727516382 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95702 expref: 25 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.466412:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727516389 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95702 expref: 24 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.467000:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:1.0:1746144911.467003:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746144911.467005:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b467c00, rc 0) 00000100:00100000:1.0:1746144911.467058:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132754700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+24:1134:x1830965175459456:12345-192.168.202.16@tcp:101:checkstat.0 Request processed in 835us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144911.467064:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48282 00000100:00100000:3.0:1746144911.472292:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.472444:0:7116:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175459584 00000100:00100000:0.0:1746144911.472453:0:7116:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175459584 00000100:00100000:0.0:1746144911.472497:0:7116:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:0.0:1746144911.472505:0:7116:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+24:1983:x1830965175459584:12345-192.168.202.16@tcp:63:ll_sa.0 00010000:00010000:0.0:1746144911.472535:0:7116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144911.472548:0:7116:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0400/0x4076af6727516390 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95709 expref: -99 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.472592:0:7116:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d1a00/0x4076af6727516397 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472602:0:7116:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d1a00/0x4076af6727516397 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472611:0:7116:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d1a00/0x4076af6727516397 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472619:0:7116:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0200/0x4076af672751639e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472624:0:7116:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0200/0x4076af672751639e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472627:0:7116:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0200/0x4076af672751639e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472670:0:7116:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d1a00/0x4076af6727516397 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472674:0:7116:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d1a00/0x4076af6727516397 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472677:0:7116:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d1a00/0x4076af6727516397 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472681:0:7116:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0d1a00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144911.472683:0:7116:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d1a00/0x4076af6727516397 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472686:0:7116:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d1a00/0x4076af6727516397 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472692:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:0.0:1746144911.472694:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144911.472696:0:7116:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d1a00/0x4076af6727516397 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472698:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d1a00/0x4076af6727516397 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472716:0:7116:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0200/0x4076af672751639e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472720:0:7116:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0200/0x4076af672751639e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472725:0:7116:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0200/0x4076af672751639e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472729:0:7116:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009b0d0200 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144911.472731:0:7116:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0200/0x4076af672751639e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472735:0:7116:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0200/0x4076af672751639e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472740:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce70cf (ffff880093f4c100) 00010000:00010000:0.0:1746144911.472742:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144911.472744:0:7116:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0200/0x4076af672751639e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472749:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0200/0x4076af672751639e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.472815:0:7116:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0400/0x4076af6727516390 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95709 expref: 25 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.472824:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:0.0:1746144911.472826:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746144911.472828:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0400/0x4076af6727516390 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95709 expref: 25 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.472838:0:7116:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d0400, rc -2) 00000100:00100000:1.0:1746144911.472905:0:7116:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131988700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+24:1983:x1830965175459584:12345-192.168.202.16@tcp:63:ll_sa.0 Request processed in 400us (619us total) trans 0 rc -2/-2 00000100:00100000:1.0:1746144911.472912:0:7116:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 8 00000100:00100000:2.0:1746144911.481361:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.481458:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175459840 00000100:00100000:1.0:1746144911.481466:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175459840 00000100:00100000:1.0:1746144911.481516:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48283 00000100:00100000:1.0:1746144911.481523:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1137:x1830965175459840:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:1.0:1746144911.481538:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144911.481552:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466400/0x4076af67275163a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95741 expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.481625:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466e00/0x4076af67275163ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144911.481636:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466e00/0x4076af67275163ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144911.481645:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466e00/0x4076af67275163ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:1.0:1746144911.481653:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 26214400 00010000:00010000:1.0:1746144911.481742:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466400/0x4076af67275163a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95741 expref: 34 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.481807:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466e00/0x4076af67275163ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95741 expref: 33 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.481813:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff88009a8b7e00) 00010000:00010000:1.0:1746144911.481815:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144911.481817:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b466e00, rc 0) 00000100:00100000:1.0:1746144911.481863:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b058700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1137:x1830965175459840:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 340us (510us total) trans 4294987545 rc 0/0 00000100:00100000:1.0:1746144911.481869:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48283 00000100:00100000:0.0:1746144911.484394:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.484818:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.484863:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144911.484875:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175459968 00000100:00100000:3.0:1746144911.484883:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175459968 00000100:00100000:3.0:1746144911.484912:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175460096 00000100:00100000:3.0:1746144911.484915:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175460096 00000100:00100000:3.0:1746144911.484930:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5899 00000100:00100000:1.0:1746144911.484932:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175460224 00000100:00100000:3.0:1746144911.484936:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175459968:12345-192.168.202.16@tcp:101:cmp.0 00000100:00100000:1.0:1746144911.484936:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175460224 00010000:00010000:3.0:1746144911.484949:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144911.484961:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275163ba lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95748 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144911.484970:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 298 00000100:00100000:1.0:1746144911.484975:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132755180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1983:x1830965175460224:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144911.484984:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144911.485000:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466e00/0x4076af67275163ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95741 expref: 33 pid: 7111 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144911.485001:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880131988a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172546048:192.168.202.16@tcp:106: 00010000:00010000:1.0:1746144911.485017:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff88009a8b7e00) 00010000:00010000:1.0:1746144911.485021:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144911.485075:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5900 00000100:00100000:0.0:1746144911.485082:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175460096:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:0.0:1746144911.485089:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144911.485103:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880094377400/0x4076af67275163c1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9574f expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144911.485127:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132755500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172546176:192.168.202.16@tcp:106: 00000100:00100000:3.0:1746144911.485184:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4139300 going to sleep for 11 seconds 00000100:00100000:1.0:1746144911.485245:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132755180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1983:x1830965175460224:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 268us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144911.485251:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 298 00000100:00100000:0.0:1746144911.485345:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a893b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746144911.487467:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880131988a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10401:1830965172546048:192.168.202.16@tcp:106: 00010000:00010000:0.0:1746144911.487490:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275163ba lrc: 1/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95748 expref: 8 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144911.487501:0:10401:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a5c200/0x4076af67275163ba lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95748 expref: 8 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144911.487616:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5c200, rc 0) 00000100:00100000:0.0:1746144911.487650:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132754a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1984:x1830965175459968:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 2714us (3263us total) trans 0 rc 301/301 00000100:00100000:0.0:1746144911.487656:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5899 00000100:00100000:1.0:1746144911.487691:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132755500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172546176:192.168.202.16@tcp:106: 00010000:00010000:1.0:1746144911.487706:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880094377400/0x4076af67275163c1 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9574f expref: 9 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144911.487719:0:8432:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880094377400/0x4076af67275163c1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9574f expref: 9 pid: 8432 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144911.487726:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094377400, rc 0) 00000100:00100000:1.0:1746144911.487755:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132754e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175460096:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 2674us (2937us total) trans 0 rc 301/301 00000100:00100000:1.0:1746144911.487760:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5900 00000100:00100000:3.0:1746144911.496168:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.496270:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175460352 00000100:00100000:1.0:1746144911.496280:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175460352 00000100:00100000:1.0:1746144911.496336:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5901 00000100:00100000:1.0:1746144911.496345:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1137:x1830965175460352:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:1.0:1746144911.496366:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144911.496384:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b467200/0x4076af67275163c8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95756 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.496419:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275161d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956ca expref: 52 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.496431:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144911.496434:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144911.496437:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b467200/0x4076af67275163c8 lrc: 4/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95756 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.496470:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275161d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956ca expref: 52 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.496488:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275161d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956ca expref: 52 pid: 8430 timeout: 605 lvb_type: 0 00000100:00100000:1.0:1746144911.496500:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172546304:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144911.496591:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135add240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144911.498552:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172546304:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144911.498575:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b467200/0x4076af67275163c8 lrc: 3/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95756 expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.498589:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b467200, rc 0) 00000100:00100000:1.0:1746144911.498628:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131988e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1137:x1830965175460352:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 2285us (2472us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144911.498635:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5901 00000100:00100000:2.0:1746144911.505250:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.505397:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175460480 00000100:00100000:1.0:1746144911.505407:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175460480 00010000:00010000:1.0:1746144911.505456:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275161d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956ca expref: 53 pid: 8430 timeout: 605 lvb_type: 0 00000100:00100000:1.0:1746144911.505487:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11295 00000100:00100000:1.0:1746144911.505495:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b058a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1985:x1830965175460480:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144911.505511:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144911.505535:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275161d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956ca expref: 53 pid: 8430 timeout: 605 lvb_type: 0 00010000:00010000:1.0:1746144911.505552:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275161d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956ca expref: 53 pid: 8430 timeout: 605 lvb_type: 0 00010000:00010000:1.0:1746144911.505577:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880092553a00/0x4076af67275161d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956ca expref: 53 pid: 8430 timeout: 605 lvb_type: 0 00010000:00010000:1.0:1746144911.505614:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144911.505616:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144911.505624:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009b467200/0x4076af67275163c8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95756 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.505633:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b467200/0x4076af67275163c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95756 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.505668:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009b467200/0x4076af67275163c8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95756 expref: 7 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144911.505681:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172546432:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144911.505757:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135add240 going to sleep for 11 seconds 00000100:00080000:2.0:1746144911.505923:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746144911.508037:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9812:1830965172546432:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144911.508059:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144911.508110:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b058a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+52:1985:x1830965175460480:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2614us (2869us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144911.508120:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11295 00000100:00100000:3.0:1746144911.510308:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.510511:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175460736 00000100:00100000:2.0:1746144911.510519:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175460736 00002000:00100000:2.0:1746144911.510563:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (0->1048575) req@ffff880131989180 x1830965175460736/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144911.510572:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131989180 with x1830965175460736 ext(0->1048575) 00002000:00010000:2.0:1746144911.510578:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131989180 00000100:00100000:2.0:1746144911.510606:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4507 00000100:00100000:2.0:1746144911.510613:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175460736:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144911.520903:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131989180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175460736:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 10281us (10595us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.520914:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4507 00002000:00100000:0.0:1746144911.520925:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (0->1048575) req@ffff880131989180 x1830965175460736/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.520933:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131989180 with x1830965175460736 ext(0->1048575) 00002000:00010000:0.0:1746144911.520940:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880131989180 00000100:00100000:3.0:1746144911.527672:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.527728:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175460864 00000100:00100000:1.0:1746144911.527741:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175460864 00000100:00100000:1.0:1746144911.527840:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5902 00000100:00100000:1.0:1746144911.527849:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1137:x1830965175460864:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:1.0:1746144911.527869:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144911.527888:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b466200/0x4076af67275163cf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9575d expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.527922:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a91ce00/0x4076af67275161ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956d1 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.527929:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144911.527931:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746144911.527934:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b466200/0x4076af67275163cf lrc: 4/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9575d expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.527965:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a91ce00/0x4076af67275161ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956d1 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.527976:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a91ce00/0x4076af67275161ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956d1 expref: 8 pid: 8430 timeout: 605 lvb_type: 0 00000100:00100000:1.0:1746144911.527987:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172546560:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144911.528481:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135add240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144911.529364:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8432:1830965172546560:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144911.531573:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b466200/0x4076af67275163cf lrc: 3/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9575d expref: 9 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.531596:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b466200, rc 0) 00000100:00100000:1.0:1746144911.531653:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131989500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1137:x1830965175460864:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 3804us (3986us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144911.531660:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5902 00000100:00100000:2.0:1746144911.538495:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.539205:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175460992 00000100:00100000:1.0:1746144911.539214:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175460992 00000100:00080000:2.0:1746144911.539239:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746144911.539251:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a91ce00/0x4076af67275161ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956d1 expref: 9 pid: 8430 timeout: 605 lvb_type: 0 00000100:00100000:1.0:1746144911.539274:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11296 00000100:00100000:1.0:1746144911.539281:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b058e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1984:x1830965175460992:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144911.539293:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144911.539311:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a91ce00/0x4076af67275161ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956d1 expref: 9 pid: 8430 timeout: 605 lvb_type: 0 00010000:00010000:1.0:1746144911.539322:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a91ce00/0x4076af67275161ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956d1 expref: 9 pid: 8430 timeout: 605 lvb_type: 0 00010000:00010000:1.0:1746144911.539341:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a91ce00/0x4076af67275161ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956d1 expref: 9 pid: 8430 timeout: 605 lvb_type: 0 00010000:00010000:1.0:1746144911.539458:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144911.539459:0:9812:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144911.539465:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b466200/0x4076af67275163cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9575d expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.539476:0:9812:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b466200/0x4076af67275163cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9575d expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.539500:0:9812:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009b466200/0x4076af67275163cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9575d expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144911.539509:0:9812:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965172546688:192.168.202.16@tcp:105: 00000100:00100000:1.0:1746144911.539565:0:9812:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135add240 going to sleep for 11 seconds 00000100:00100000:1.0:1746144911.542091:0:9812:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9812:1830965172546688:192.168.202.16@tcp:105: 00010000:00010000:1.0:1746144911.542107:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144911.542149:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b058e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1984:x1830965175460992:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 2868us (3662us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144911.542159:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11296 00000100:00100000:2.0:1746144911.545840:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.545864:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.545880:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175461248 00000100:00100000:0.0:1746144911.545888:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175461248 00000100:00100000:2.0:1746144911.545903:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00002000:00100000:0.0:1746144911.545927:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (0->1048575) req@ffff88009b059180 x1830965175461248/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.545936:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b059180 with x1830965175461248 ext(0->1048575) 00002000:00010000:0.0:1746144911.545940:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b059180 00000100:00100000:0.0:1746144911.545966:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175461504 00000100:00100000:0.0:1746144911.545968:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175461504 00002000:00100000:0.0:1746144911.545980:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (1048576->2097151) req@ffff88009b059500 x1830965175461504/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.545987:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b059500 with x1830965175461504 ext(1048576->2097151) 00002000:00010000:0.0:1746144911.545989:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b059500 00000100:00100000:0.0:1746144911.545997:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175461760 00000100:00100000:0.0:1746144911.545999:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175461760 00002000:00100000:0.0:1746144911.546008:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (1048576->2097151) req@ffff88009b059880 x1830965175461760/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.546015:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b059880 with x1830965175461760 ext(1048576->2097151) 00002000:00010000:0.0:1746144911.546023:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b059880 00000100:00100000:0.0:1746144911.546035:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4508 00000100:00100000:0.0:1746144911.546040:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b059180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965175461248:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144911.546051:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4509 00000100:00100000:1.0:1746144911.546059:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965175461504:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144911.546099:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4510 00000100:00100000:0.0:1746144911.546104:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b059880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175461760:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144911.555091:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b059880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175461760:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 8776us (8976us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.555105:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4510 00002000:00100000:0.0:1746144911.555116:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1c:0x0] (1048576->2097151) req@ffff88009b059880 x1830965175461760/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.555124:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b059880 with x1830965175461760 ext(1048576->2097151) 00002000:00010000:0.0:1746144911.555129:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b059880 00000100:00100000:1.0:1746144911.559972:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b059500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1984:x1830965175461504:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 13906us (14098us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.559982:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4509 00002000:00100000:1.0:1746144911.559995:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1d:0x0] (1048576->2097151) req@ffff88009b059500 x1830965175461504/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.560003:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b059500 with x1830965175461504 ext(1048576->2097151) 00002000:00010000:1.0:1746144911.560008:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b059500 00000100:00100000:0.0:1746144911.561681:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b059180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175461248:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 15636us (15847us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.561690:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4508 00002000:00100000:0.0:1746144911.561703:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (0->1048575) req@ffff88009b059180 x1830965175461248/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.561710:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b059180 with x1830965175461248 ext(0->1048575) 00002000:00010000:0.0:1746144911.561714:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b059180 00000100:00100000:2.0:1746144911.582845:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.582869:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175462016 00000100:00100000:0.0:1746144911.582877:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175462016 00002000:00100000:0.0:1746144911.582911:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (2097152->3145727) req@ffff88009b059c00 x1830965175462016/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.582921:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b059c00 with x1830965175462016 ext(2097152->3145727) 00002000:00010000:0.0:1746144911.582925:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b059c00 00000100:00100000:0.0:1746144911.582951:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4511 00000100:00100000:0.0:1746144911.582957:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175462016:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144911.585024:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144911.585331:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.585725:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175462272 00000100:00100000:1.0:1746144911.585733:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175462272 00002000:00100000:1.0:1746144911.585790:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x240000400:0x1c:0x0] (3145728->4194303) req@ffff88009b059f80 x1830965175462272/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.585798:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b059f80 with x1830965175462272 ext(3145728->4194303) 00002000:00010000:1.0:1746144911.585802:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b059f80 00000100:00100000:1.0:1746144911.585819:0:25064:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175462528 00000100:00100000:1.0:1746144911.585821:0:25064:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175462528 00002000:00100000:1.0:1746144911.585834:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1d:0x0] (2097152->3145727) req@ffff880131989880 x1830965175462528/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.585840:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131989880 with x1830965175462528 ext(2097152->3145727) 00000100:00100000:3.0:1746144911.585843:0:25029:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4512 00002000:00010000:1.0:1746144911.585844:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131989880 00000100:00100000:3.0:1746144911.585850:0:25029:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b059f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965175462272:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144911.585853:0:25064:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4513 00000100:00100000:1.0:1746144911.585857:0:25064:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175462528:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144911.587138:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.587900:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175462784 00000100:00100000:0.0:1746144911.587907:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175462784 00002000:00100000:0.0:1746144911.587932:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1d:0x0] (3145728->4194303) req@ffff880131989c00 x1830965175462784/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.587946:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131989c00 with x1830965175462784 ext(3145728->4194303) 00002000:00010000:0.0:1746144911.587954:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131989c00 00000100:00100000:0.0:1746144911.587990:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4514 00000100:00100000:0.0:1746144911.588000:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1984:x1830965175462784:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144911.589703:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b059c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175462016:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 6740us (6860us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.589712:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4511 00002000:00100000:0.0:1746144911.589719:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (2097152->3145727) req@ffff88009b059c00 x1830965175462016/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.589726:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b059c00 with x1830965175462016 ext(2097152->3145727) 00002000:00010000:0.0:1746144911.589731:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b059c00 00000100:00100000:1.0:1746144911.599480:0:25064:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131989880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1985:x1830965175462528:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 13613us (14141us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.599490:0:25064:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4513 00002000:00100000:1.0:1746144911.599499:0:25064:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1d:0x0] (2097152->3145727) req@ffff880131989880 x1830965175462528/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.599509:0:25064:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131989880 with x1830965175462528 ext(2097152->3145727) 00002000:00010000:1.0:1746144911.599514:0:25064:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131989880 00000100:00100000:0.0:1746144911.600493:0:25029:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b059f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175462272:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 14640us (15469us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.600500:0:25029:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4512 00002000:00100000:0.0:1746144911.600506:0:25029:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1c:0x0] (3145728->4194303) req@ffff88009b059f80 x1830965175462272/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.600514:0:25029:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b059f80 with x1830965175462272 ext(3145728->4194303) 00002000:00010000:0.0:1746144911.600517:0:25029:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b059f80 00000100:00100000:0.0:1746144911.603107:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131989c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175462784:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 15103us (15965us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.603116:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4514 00002000:00100000:0.0:1746144911.603124:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1d:0x0] (3145728->4194303) req@ffff880131989c00 x1830965175462784/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.603134:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131989c00 with x1830965175462784 ext(3145728->4194303) 00002000:00010000:0.0:1746144911.603139:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131989c00 00000100:00100000:2.0:1746144911.616369:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.616399:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.616429:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.616457:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.616515:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175463040 00000100:00100000:0.0:1746144911.616523:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175463040 00002000:00100000:0.0:1746144911.616558:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1c:0x0] (4194304->5242879) req@ffff88009b05a300 x1830965175463040/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.616566:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b05a300 with x1830965175463040 ext(4194304->5242879) 00002000:00010000:0.0:1746144911.616571:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b05a300 00000100:00100000:0.0:1746144911.616584:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175463296 00000100:00100000:0.0:1746144911.616585:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175463296 00002000:00100000:0.0:1746144911.616594:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1c:0x0] (5242880->6291455) req@ffff88009b05a680 x1830965175463296/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.616600:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b05a680 with x1830965175463296 ext(5242880->6291455) 00002000:00010000:0.0:1746144911.616602:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b05a680 00000100:00100000:0.0:1746144911.616622:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175463552 00000100:00100000:0.0:1746144911.616624:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175463552 00002000:00100000:0.0:1746144911.616634:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1d:0x0] (4194304->5242879) req@ffff88009b05aa00 x1830965175463552/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.616640:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b05aa00 with x1830965175463552 ext(4194304->5242879) 00002000:00010000:0.0:1746144911.616642:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b05aa00 00000100:00100000:0.0:1746144911.616649:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175463808 00000100:00100000:0.0:1746144911.616651:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175463808 00002000:00100000:0.0:1746144911.616658:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1d:0x0] (5242880->6291455) req@ffff88009b05ad80 x1830965175463808/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.616664:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b05ad80 with x1830965175463808 ext(5242880->6291455) 00002000:00010000:0.0:1746144911.616666:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b05ad80 00000100:00100000:0.0:1746144911.616676:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4515 00000100:00100000:0.0:1746144911.616683:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b05a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175463040:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144911.617109:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4516 00000100:00100000:0.0:1746144911.617115:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b05a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175463296:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144911.617428:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4517 00000100:00100000:0.0:1746144911.617434:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b05aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1984:x1830965175463552:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144911.618036:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4518 00000100:00100000:0.0:1746144911.618042:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b05ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1984:x1830965175463808:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144911.630360:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b05a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175463296:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 13236us (13950us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.630369:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4516 00002000:00100000:1.0:1746144911.630379:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (5242880->6291455) req@ffff88009b05a680 x1830965175463296/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.630394:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b05a680 with x1830965175463296 ext(5242880->6291455) 00002000:00010000:1.0:1746144911.630399:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b05a680 00000100:00100000:0.0:1746144911.631351:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b05a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175463040:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 14664us (14986us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.631359:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4515 00002000:00100000:0.0:1746144911.631364:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1c:0x0] (4194304->5242879) req@ffff88009b05a300 x1830965175463040/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.631372:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b05a300 with x1830965175463040 ext(4194304->5242879) 00002000:00010000:0.0:1746144911.631376:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b05a300 00000100:00100000:0.0:1746144911.634953:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b05aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1984:x1830965175463552:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 17512us (18515us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.634962:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4517 00002000:00100000:0.0:1746144911.634970:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1d:0x0] (4194304->5242879) req@ffff88009b05aa00 x1830965175463552/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.634978:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b05aa00 with x1830965175463552 ext(4194304->5242879) 00002000:00010000:0.0:1746144911.634983:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b05aa00 00000100:00100000:1.0:1746144911.640098:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b05ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175463808:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 22044us (23627us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.640109:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4518 00002000:00100000:1.0:1746144911.640119:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1d:0x0] (5242880->6291455) req@ffff88009b05ad80 x1830965175463808/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.640128:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b05ad80 with x1830965175463808 ext(5242880->6291455) 00002000:00010000:1.0:1746144911.640133:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b05ad80 00010000:00010000:3.0:1746144911.642442:0:7101:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746144911.643514:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.643651:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175464064 00000100:00100000:1.0:1746144911.643659:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175464064 00002000:00100000:1.0:1746144911.643696:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1c:0x0] (6291456->7340031) req@ffff88009b05b100 x1830965175464064/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.643705:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b05b100 with x1830965175464064 ext(6291456->7340031) 00002000:00010000:1.0:1746144911.643709:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b05b100 00000100:00100000:1.0:1746144911.643916:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4519 00000100:00100000:1.0:1746144911.643924:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b05b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175464064:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144911.651096:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b05b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175464064:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 7164us (7578us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.651107:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4519 00002000:00100000:1.0:1746144911.651117:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1c:0x0] (6291456->7340031) req@ffff88009b05b100 x1830965175464064/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.651126:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b05b100 with x1830965175464064 ext(6291456->7340031) 00002000:00010000:1.0:1746144911.651132:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b05b100 00000100:00100000:2.0:1746144911.660362:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.660402:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.660426:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.660428:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175464448 00000100:00100000:1.0:1746144911.660436:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175464448 00002000:00100000:1.0:1746144911.660482:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1d:0x0] (6291456->7340031) req@ffff88009b05b480 x1830965175464448/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.660491:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b05b480 with x1830965175464448 ext(6291456->7340031) 00002000:00010000:1.0:1746144911.660496:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b05b480 00000100:00100000:1.0:1746144911.660510:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175464576 00000100:00100000:1.0:1746144911.660513:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175464576 00002000:00100000:1.0:1746144911.660524:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1d:0x0] (7340032->8388607) req@ffff88009b05b800 x1830965175464576/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.660530:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b05b800 with x1830965175464576 ext(7340032->8388607) 00002000:00010000:1.0:1746144911.660532:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b05b800 00000100:00100000:1.0:1746144911.660557:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175464832 00000100:00100000:1.0:1746144911.660559:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175464832 00002000:00100000:1.0:1746144911.660569:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1c:0x0] (7340032->8388607) req@ffff88009b05bb80 x1830965175464832/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.660576:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b05bb80 with x1830965175464832 ext(7340032->8388607) 00002000:00010000:1.0:1746144911.660578:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b05bb80 00000100:00100000:1.0:1746144911.660590:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4520 00000100:00100000:1.0:1746144911.660597:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b05b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1983:x1830965175464448:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144911.660675:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4521 00000100:00100000:0.0:1746144911.660684:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b05b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1982:x1830965175464576:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144911.660688:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4522 00000100:00100000:3.0:1746144911.660694:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b05bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175464832:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144911.669899:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b05bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175464832:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 9196us (9462us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144911.669909:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4522 00002000:00100000:3.0:1746144911.669919:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c:0x0] (7340032->8388607) req@ffff88009b05bb80 x1830965175464832/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144911.669928:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b05bb80 with x1830965175464832 ext(7340032->8388607) 00002000:00010000:3.0:1746144911.669934:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b05bb80 00000100:00100000:1.0:1746144911.674449:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b05b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1983:x1830965175464448:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 13843us (14086us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.674460:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4520 00002000:00100000:1.0:1746144911.674470:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1d:0x0] (6291456->7340031) req@ffff88009b05b480 x1830965175464448/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.674503:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b05b480 with x1830965175464448 ext(6291456->7340031) 00002000:00010000:1.0:1746144911.674508:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b05b480 00000100:00100000:0.0:1746144911.675258:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b05b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175464576:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 14572us (14851us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.675265:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4521 00002000:00100000:0.0:1746144911.675271:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1d:0x0] (7340032->8388607) req@ffff88009b05b800 x1830965175464576/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.675277:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b05b800 with x1830965175464576 ext(7340032->8388607) 00002000:00010000:0.0:1746144911.675281:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b05b800 00000100:00100000:2.0:1746144911.683084:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.683144:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175465088 00000100:00100000:0.0:1746144911.683152:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175465088 00002000:00100000:0.0:1746144911.683185:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (8388608->9437183) req@ffff880135250000 x1830965175465088/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.683193:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135250000 with x1830965175465088 ext(8388608->9437183) 00002000:00010000:0.0:1746144911.683198:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135250000 00000100:00100000:0.0:1746144911.683228:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4523 00000100:00100000:0.0:1746144911.683235:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175465088:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144911.690231:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.690601:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175465344 00000100:00100000:1.0:1746144911.690609:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175465344 00002000:00100000:1.0:1746144911.690640:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1d:0x0] (8388608->9437183) req@ffff880135250380 x1830965175465344/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.690649:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135250380 with x1830965175465344 ext(8388608->9437183) 00002000:00010000:1.0:1746144911.690654:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135250380 00000100:00100000:1.0:1746144911.690681:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4524 00000100:00100000:1.0:1746144911.690687:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175465344:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144911.695513:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135250000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175465088:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 12270us (12429us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.695522:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4523 00002000:00100000:1.0:1746144911.695530:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (8388608->9437183) req@ffff880135250000 x1830965175465088/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.695539:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135250000 with x1830965175465088 ext(8388608->9437183) 00002000:00010000:1.0:1746144911.695544:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135250000 00000100:00100000:1.0:1746144911.704315:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135250380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175465344:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 13617us (14081us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.704325:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4524 00002000:00100000:1.0:1746144911.704335:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1d:0x0] (8388608->9437183) req@ffff880135250380 x1830965175465344/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.704344:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135250380 with x1830965175465344 ext(8388608->9437183) 00002000:00010000:1.0:1746144911.704350:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135250380 00000100:00100000:2.0:1746144911.713222:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.714375:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.714481:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175465600 00000100:00100000:0.0:1746144911.714489:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175465600 00002000:00100000:0.0:1746144911.714527:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (9437184->10485759) req@ffff880135250700 x1830965175465600/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.714537:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135250700 with x1830965175465600 ext(9437184->10485759) 00002000:00010000:0.0:1746144911.714541:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135250700 00000100:00100000:0.0:1746144911.714634:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175465856 00000100:00100000:0.0:1746144911.714637:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175465856 00002000:00100000:0.0:1746144911.714650:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1d:0x0] (9437184->10485759) req@ffff880135250a80 x1830965175465856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.714657:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135250a80 with x1830965175465856 ext(9437184->10485759) 00002000:00010000:0.0:1746144911.714660:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135250a80 00000100:00100000:0.0:1746144911.714941:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4525 00000100:00100000:0.0:1746144911.714949:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175465600:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144911.715632:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4526 00000100:00100000:1.0:1746144911.715640:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175465856:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144911.728298:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135250700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175465600:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 13340us (15074us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.728308:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4525 00002000:00100000:0.0:1746144911.728317:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (9437184->10485759) req@ffff880135250700 x1830965175465600/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.728326:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135250700 with x1830965175465600 ext(9437184->10485759) 00002000:00010000:0.0:1746144911.728331:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135250700 00000100:00100000:1.0:1746144911.729942:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135250a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175465856:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 14298us (15565us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.729950:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4526 00002000:00100000:1.0:1746144911.729957:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1d:0x0] (9437184->10485759) req@ffff880135250a80 x1830965175465856/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.729964:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135250a80 with x1830965175465856 ext(9437184->10485759) 00002000:00010000:1.0:1746144911.729969:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135250a80 00000100:00100000:2.0:1746144911.736316:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.736363:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.736434:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175466240 00000100:00100000:1.0:1746144911.736442:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175466240 00002000:00100000:1.0:1746144911.736475:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1d:0x0] (10485760->11534335) req@ffff880135250e00 x1830965175466240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.736483:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135250e00 with x1830965175466240 ext(10485760->11534335) 00002000:00010000:1.0:1746144911.736487:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135250e00 00000100:00100000:1.0:1746144911.736499:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175466368 00000100:00100000:1.0:1746144911.736500:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175466368 00002000:00100000:1.0:1746144911.736509:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1c:0x0] (10485760->11534335) req@ffff880135251180 x1830965175466368/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.736515:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135251180 with x1830965175466368 ext(10485760->11534335) 00002000:00010000:1.0:1746144911.736518:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135251180 00000100:00100000:1.0:1746144911.736541:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4527 00000100:00100000:1.0:1746144911.736547:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175466240:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144911.736818:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4528 00000100:00100000:0.0:1746144911.736827:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175466368:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144911.745813:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.745900:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175466624 00000100:00100000:0.0:1746144911.745910:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175466624 00002000:00100000:0.0:1746144911.745944:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (11534336->12582911) req@ffff880135251500 x1830965175466624/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.745954:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135251500 with x1830965175466624 ext(11534336->12582911) 00002000:00010000:0.0:1746144911.745958:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135251500 00000100:00100000:0.0:1746144911.745989:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4529 00000100:00100000:0.0:1746144911.745996:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175466624:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144911.747235:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135251180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175466368:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 10403us (10864us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.747244:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4528 00002000:00100000:1.0:1746144911.747251:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (10485760->11534335) req@ffff880135251180 x1830965175466368/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.747258:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135251180 with x1830965175466368 ext(10485760->11534335) 00002000:00010000:1.0:1746144911.747261:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135251180 00000100:00100000:0.0:1746144911.750816:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135250e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175466240:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 14260us (14498us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.750825:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4527 00002000:00100000:0.0:1746144911.750836:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1d:0x0] (10485760->11534335) req@ffff880135250e00 x1830965175466240/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.750843:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135250e00 with x1830965175466240 ext(10485760->11534335) 00002000:00010000:0.0:1746144911.750849:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135250e00 00000100:00100000:0.0:1746144911.755316:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135251500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175466624:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 9311us (9546us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.755326:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4529 00002000:00100000:0.0:1746144911.755336:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (11534336->12582911) req@ffff880135251500 x1830965175466624/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.755345:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135251500 with x1830965175466624 ext(11534336->12582911) 00002000:00010000:0.0:1746144911.755350:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135251500 00000100:00100000:1.0:1746144911.761076:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.761164:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175466880 00000100:00100000:0.0:1746144911.761172:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175466880 00002000:00100000:0.0:1746144911.761213:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (11534336->12582911) req@ffff880135ea5c00 x1830965175466880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.761221:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5c00 with x1830965175466880 ext(11534336->12582911) 00002000:00010000:0.0:1746144911.761226:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ea5c00 00000100:00100000:0.0:1746144911.761287:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4530 00000100:00100000:0.0:1746144911.761293:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175466880:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144911.768674:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175466880:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 7370us (7594us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746144911.768685:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4530 00002000:00100000:2.0:1746144911.768696:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_013: refresh rw locks for [0x280000400:0x1d:0x0] (11534336->12582911) req@ffff880135ea5c00 x1830965175466880/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:2.0:1746144911.768705:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135ea5c00 with x1830965175466880 ext(11534336->12582911) 00002000:00010000:2.0:1746144911.768710:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135ea5c00 00000100:00100000:2.0:1746144911.773697:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.773790:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175467136 00000100:00100000:0.0:1746144911.773797:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175467136 00002000:00100000:0.0:1746144911.773834:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (12582912->13631487) req@ffff880135251880 x1830965175467136/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.773843:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135251880 with x1830965175467136 ext(12582912->13631487) 00002000:00010000:0.0:1746144911.773848:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135251880 00000100:00100000:0.0:1746144911.773864:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4531 00000100:00100000:0.0:1746144911.773870:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175467136:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144911.781922:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135251880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1982:x1830965175467136:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 8044us (8223us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.781933:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4531 00002000:00100000:0.0:1746144911.781942:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (12582912->13631487) req@ffff880135251880 x1830965175467136/t0(0) o3->9d7af19e-38f7-44a8-82cf-031a58749c81@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.781951:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135251880 with x1830965175467136 ext(12582912->13631487) 00002000:00010000:0.0:1746144911.781956:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135251880 00000100:00100000:3.0:1746144911.787593:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.787919:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175467392 00000100:00100000:1.0:1746144911.787927:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175467392 00000100:00100000:1.0:1746144911.787976:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 175 00000100:00100000:1.0:1746144911.787982:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1137:x1830965175467392:12345-192.168.202.16@tcp:35:cmp.0 00000100:00100000:1.0:1746144911.788234:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1137:x1830965175467392:12345-192.168.202.16@tcp:35:cmp.0 Request processed in 252us (648us total) trans 4294987546 rc 0/0 00000100:00100000:1.0:1746144911.788240:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 175 00000100:00100000:2.0:1746144911.800915:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.800943:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.801053:0:7116:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175467776 00000100:00100000:1.0:1746144911.801062:0:7116:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175467776 00000100:00100000:1.0:1746144911.801100:0:7116:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 9 00000100:00100000:1.0:1746144911.801107:0:7116:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+24:1985:x1830965175467776:12345-192.168.202.16@tcp:63:ll_sa.0 00010000:00010000:1.0:1746144911.801205:0:7116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144911.801219:0:7116:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf22800/0x4076af67275163d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9576b expref: -99 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.801258:0:7116:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23000/0x4076af67275163dd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801273:0:7116:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23000/0x4076af67275163dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801282:0:7116:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23000/0x4076af67275163dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801292:0:7116:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23600/0x4076af67275163e4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801297:0:7116:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23600/0x4076af67275163e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801301:0:7116:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23600/0x4076af67275163e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7116 initiator: MDT0 00000100:00100000:0.0:1746144911.801331:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175467648 00000100:00100000:0.0:1746144911.801335:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175467648 00010000:00010000:1.0:1746144911.801350:0:7116:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23000/0x4076af67275163dd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801356:0:7116:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23000/0x4076af67275163dd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801362:0:7116:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23000/0x4076af67275163dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801366:0:7116:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf23000 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144911.801370:0:7116:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23000/0x4076af67275163dd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801375:0:7116:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23000/0x4076af67275163dd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801383:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00000100:00100000:0.0:1746144911.801383:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48284 00010000:00010000:1.0:1746144911.801385:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1746144911.801388:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1138:x1830965175467648:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:1.0:1746144911.801389:0:7116:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23000/0x4076af67275163dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801393:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23000/0x4076af67275163dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.801396:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144911.801403:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60600/0x4076af67275163eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95764 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.801408:0:7116:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23600/0x4076af67275163e4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801413:0:7116:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23600/0x4076af67275163e4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801417:0:7116:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23600/0x4076af67275163e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801421:0:7116:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bf23600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144911.801423:0:7116:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23600/0x4076af67275163e4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801427:0:7116:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23600/0x4076af67275163e4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801431:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce70cf (ffff88009bbca100) 00010000:00010000:1.0:1746144911.801433:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144911.801435:0:7116:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23600/0x4076af67275163e4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.801439:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf23600/0x4076af67275163e4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144911.801458:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136442000/0x4076af67275163f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144911.801465:0:7116:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf22800/0x4076af67275163d6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9576b expref: 27 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.801467:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136442000/0x4076af67275163f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144911.801472:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:0.0:1746144911.801473:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136442000/0x4076af67275163f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144911.801475:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746144911.801477:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf22800/0x4076af67275163d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9576b expref: 27 pid: 7116 timeout: 0 lvb_type: 0 00000004:00200000:0.0:1746144911.801480:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 26214400 00010000:00010000:1.0:1746144911.801485:0:7116:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf22800, rc -2) 00000100:00100000:1.0:1746144911.801525:0:7116:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135251f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+27:1985:x1830965175467776:12345-192.168.202.16@tcp:63:ll_sa.0 Request processed in 418us (580us total) trans 0 rc -2/-2 00000100:00100000:1.0:1746144911.801532:0:7116:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 9 00010000:00010000:3.0:1746144911.802192:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60600/0x4076af67275163eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95764 expref: 27 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144911.802220:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136442000/0x4076af67275163f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95764 expref: 26 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144911.802227:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca000) 00010000:00010000:3.0:1746144911.802228:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144911.802230:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136442000, rc 0) 00000100:00100000:3.0:1746144911.802260:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135251c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1138:x1830965175467648:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 870us (1352us total) trans 4294987547 rc 0/0 00000100:00100000:3.0:1746144911.802266:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48284 00000100:00100000:3.0:1746144911.805857:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.805913:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175467904 00000100:00100000:1.0:1746144911.805921:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175467904 00000100:00100000:1.0:1746144911.805968:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 299 00000100:00100000:1.0:1746144911.805975:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013198a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1985:x1830965175467904:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144911.805998:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144911.806016:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136442000/0x4076af67275163f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95764 expref: 26 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.806040:0:9812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca000) 00010000:00010000:1.0:1746144911.806043:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144911.806074:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013198a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+25:1985:x1830965175467904:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 100us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144911.806080:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 299 00000100:00100000:2.0:1746144911.807102:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.807233:0:7116:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175468288 00000100:00100000:1.0:1746144911.807237:0:7116:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175468288 00000100:00100000:1.0:1746144911.807272:0:7116:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:1.0:1746144911.807278:0:7116:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880130905c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+25:1984:x1830965175468288:12345-192.168.202.16@tcp:63:ll_sa.0 00010000:00010000:1.0:1746144911.807304:0:7116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144911.807314:0:7116:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516400 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af957a3 expref: -99 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.807351:0:7116:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af6727516407 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807359:0:7116:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af6727516407 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807366:0:7116:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af6727516407 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807376:0:7116:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af672751640e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807381:0:7116:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af672751640e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807385:0:7116:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af672751640e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807430:0:7116:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af6727516407 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807435:0:7116:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af6727516407 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807440:0:7116:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af6727516407 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807444:0:7116:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099a61a00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144911.807447:0:7116:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af6727516407 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807452:0:7116:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af6727516407 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807462:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:1.0:1746144911.807465:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144911.807467:0:7116:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af6727516407 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807471:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af6727516407 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807481:0:7116:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af672751640e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807485:0:7116:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af672751640e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807489:0:7116:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af672751640e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807493:0:7116:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099a60e00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144911.807495:0:7116:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af672751640e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807498:0:7116:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af672751640e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807503:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbfe6ecf (ffff88009bbca900) 00010000:00010000:1.0:1746144911.807505:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144911.807507:0:7116:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af672751640e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807511:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af672751640e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbfe6ecf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:1.0:1746144911.807535:0:7116:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516400 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af957a3 expref: 26 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.807542:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:1.0:1746144911.807544:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1746144911.807547:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516400 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af957a3 expref: 26 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.807554:0:7116:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099a60000, rc -2) 00000100:00100000:1.0:1746144911.807590:0:7116:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880130905c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+25:1984:x1830965175468288:12345-192.168.202.16@tcp:63:ll_sa.0 Request processed in 312us (490us total) trans 0 rc -2/-2 00000100:00100000:1.0:1746144911.807597:0:7116:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 10 00000100:00100000:3.0:1746144911.807676:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.808405:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175468160 00000100:00100000:0.0:1746144911.808410:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175468160 00000100:00100000:0.0:1746144911.808958:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48285 00000100:00100000:0.0:1746144911.808965:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013198a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+25:1138:x1830965175468160:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:0.0:1746144911.808976:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144911.808985:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d1a00/0x4076af6727516415 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9579c expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.809044:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0200/0x4076af672751641c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144911.809053:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0200/0x4076af672751641c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144911.809060:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0200/0x4076af672751641c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:0.0:1746144911.809069:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 26214400 00010000:00010000:0.0:1746144911.809158:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d1a00/0x4076af6727516415 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9579c expref: 28 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.809353:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0200/0x4076af672751641c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9579c expref: 27 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.809365:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff88009a8b7e00) 00010000:00010000:0.0:1746144911.809367:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746144911.809369:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d0200, rc 0) 00000100:00100000:1.0:1746144911.809508:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013198a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+27:1138:x1830965175468160:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 542us (1830us total) trans 4294987548 rc 0/0 00000100:00100000:1.0:1746144911.809515:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48285 00000100:00100000:3.0:1746144911.813273:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144911.813294:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144911.813336:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.813408:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175468672 00000100:00100000:1.0:1746144911.813415:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175468672 00000100:00100000:1.0:1746144911.813465:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 300 00000100:00100000:1.0:1746144911.813472:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013198aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+27:1983:x1830965175468672:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144911.813484:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144911.813504:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b0d0200/0x4076af672751641c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9579c expref: 27 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144911.813517:0:9812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff88009a8b7e00) 00010000:00010000:1.0:1746144911.813521:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144911.813555:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013198aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1983:x1830965175468672:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 84us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144911.813561:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 300 00000100:00100000:0.0:1746144911.813616:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175468416 00000100:00100000:0.0:1746144911.813620:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175468416 00000100:00100000:0.0:1746144911.813637:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175468544 00000100:00100000:0.0:1746144911.813638:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175468544 00000100:00100000:0.0:1746144911.813649:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5903 00000100:00100000:0.0:1746144911.813653:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013198ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+52:1985:x1830965175468416:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:0.0:1746144911.813663:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144911.813673:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0400/0x4076af672751642a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af957e2 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.813686:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144911.813688:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144911.813694:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0400/0x4076af672751642a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af957e2 expref: 53 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144911.813704:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009b0d0400/0x4076af672751642a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af957e2 expref: 53 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144911.813712:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d0400, rc 0) 00000100:00100000:0.0:1746144911.813726:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013198ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1985:x1830965175468416:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 73us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144911.813730:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5903 00000100:00100000:0.0:1746144911.813738:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5904 00000100:00100000:0.0:1746144911.813742:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013198b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+8:1984:x1830965175468544:12345-192.168.202.16@tcp:101:cmp.0 00010000:00010000:0.0:1746144911.813747:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144911.813753:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516431 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af957e9 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144911.813789:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144911.813791:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144911.813794:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af957e9 expref: 9 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144911.813802:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af957e9 expref: 9 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144911.813808:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009b0d0000, rc 0) 00000100:00100000:0.0:1746144911.813820:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013198b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1984:x1830965175468544:12345-192.168.202.16@tcp:101:cmp.0 Request processed in 78us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144911.813824:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5904 00000100:00100000:2.0:1746144911.843378:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.843430:0:1854:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175468928 00000100:00100000:0.0:1746144911.843439:0:1854:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175468928 00002000:00100000:0.0:1746144911.843476:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (0->1048575) req@ffff880135252300 x1830965175468928/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.843485:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135252300 with x1830965175468928 ext(0->1048575) 00002000:00010000:0.0:1746144911.843490:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135252300 00000100:00100000:0.0:1746144911.843521:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4532 00000100:00100000:0.0:1746144911.843528:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1982:x1830965175468928:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144911.843881:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.843962:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.843992:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144911.844213:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175469184 00000100:00100000:3.0:1746144911.844217:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175469184 00000100:00100000:3.0:1746144911.844224:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175469568 00000100:00100000:3.0:1746144911.844226:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175469568 00002000:00100000:3.0:1746144911.844242:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (1048576->2097151) req@ffff880135252a00 x1830965175469568/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144911.844293:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135252a00 with x1830965175469568 ext(1048576->2097151) 00002000:00010000:3.0:1746144911.844296:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135252a00 00000100:00100000:3.0:1746144911.844312:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175469440 00000100:00100000:3.0:1746144911.844315:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175469440 00002000:00100000:3.0:1746144911.844325:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (0->1048575) req@ffff880135252d80 x1830965175469440/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144911.844331:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135252d80 with x1830965175469440 ext(0->1048575) 00002000:00010000:3.0:1746144911.844333:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135252d80 00000100:00100000:3.0:1746144911.844347:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4533 00000100:00100000:3.0:1746144911.844352:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1982:x1830965175469568:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144911.844533:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4534 00000100:00100000:0.0:1746144911.844541:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1982:x1830965175469440:12345-192.168.202.16@tcp:3:cmp.0 00002000:00100000:3.0:1746144911.845179:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1c:0x0] (1048576->2097151) req@ffff880135252680 x1830965175469184/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144911.845186:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135252680 with x1830965175469184 ext(1048576->2097151) 00002000:00010000:3.0:1746144911.845190:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135252680 00000100:00100000:3.0:1746144911.845209:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4535 00000100:00100000:3.0:1746144911.845215:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+55:1982:x1830965175469184:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144911.854705:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135252a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+11:1982:x1830965175469568:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 10344us (10733us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.854714:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4533 00002000:00100000:0.0:1746144911.854724:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (1048576->2097151) req@ffff880135252a00 x1830965175469568/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.854731:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135252a00 with x1830965175469568 ext(1048576->2097151) 00002000:00010000:0.0:1746144911.854737:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135252a00 00000100:00100000:0.0:1746144911.858594:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135252d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1982:x1830965175469440:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 14044us (14591us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.858604:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4534 00002000:00100000:0.0:1746144911.858612:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1d:0x0] (0->1048575) req@ffff880135252d80 x1830965175469440/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.858620:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135252d80 with x1830965175469440 ext(0->1048575) 00002000:00010000:0.0:1746144911.858625:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135252d80 00000100:00100000:0.0:1746144911.861314:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135252300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+55:1982:x1830965175468928:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 17777us (18041us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.861324:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4532 00002000:00100000:0.0:1746144911.861334:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (0->1048575) req@ffff880135252300 x1830965175468928/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.861342:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135252300 with x1830965175468928 ext(0->1048575) 00002000:00010000:0.0:1746144911.861346:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135252300 00000100:00100000:0.0:1746144911.861979:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135252680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1982:x1830965175469184:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 16762us (18098us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.861986:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4535 00002000:00100000:0.0:1746144911.861991:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1c:0x0] (1048576->2097151) req@ffff880135252680 x1830965175469184/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.861998:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135252680 with x1830965175469184 ext(1048576->2097151) 00002000:00010000:0.0:1746144911.862001:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135252680 00000100:00100000:3.0:1746144911.882388:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.882695:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175469952 00000100:00100000:0.0:1746144911.882704:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175469952 00002000:00100000:0.0:1746144911.882740:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1c:0x0] (2097152->3145727) req@ffff88013198b480 x1830965175469952/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.882748:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013198b480 with x1830965175469952 ext(2097152->3145727) 00002000:00010000:0.0:1746144911.882752:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013198b480 00000100:00100000:2.0:1746144911.882915:0:1854:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4536 00000100:00100000:2.0:1746144911.882924:0:1854:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013198b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1982:x1830965175469952:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144911.883115:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144911.883129:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.883289:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175470336 00000100:00100000:0.0:1746144911.883292:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175470336 00002000:00100000:0.0:1746144911.883308:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1d:0x0] (2097152->3145727) req@ffff88013198b800 x1830965175470336/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.883315:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013198b800 with x1830965175470336 ext(2097152->3145727) 00002000:00010000:0.0:1746144911.883318:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013198b800 00000100:00100000:0.0:1746144911.883327:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175470464 00000100:00100000:0.0:1746144911.883329:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175470464 00002000:00100000:0.0:1746144911.883337:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1c:0x0] (3145728->4194303) req@ffff88013198bb80 x1830965175470464/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.883344:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013198bb80 with x1830965175470464 ext(3145728->4194303) 00002000:00010000:0.0:1746144911.883346:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013198bb80 00000100:00100000:0.0:1746144911.883364:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4537 00000100:00100000:0.0:1746144911.883370:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013198b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1982:x1830965175470336:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144911.884047:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144911.884069:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175470592 00000100:00100000:3.0:1746144911.884073:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175470592 00002000:00100000:3.0:1746144911.884090:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1d:0x0] (3145728->4194303) req@ffff880131988700 x1830965175470592/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144911.884104:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131988700 with x1830965175470592 ext(3145728->4194303) 00002000:00010000:3.0:1746144911.884107:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131988700 00000100:00100000:3.0:1746144911.884117:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4538 00000100:00100000:3.0:1746144911.884121:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013198bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+55:1983:x1830965175470464:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144911.884183:0:25029:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4539 00000100:00100000:1.0:1746144911.884191:0:25029:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1982:x1830965175470592:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144911.896390:0:1854:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013198b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_013:7454cbaf-97e3-4716-92c6-77cd48a94a90+55:1982:x1830965175469952:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 13461us (14003us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.896400:0:1854:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4536 00002000:00100000:0.0:1746144911.896411:0:1854:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_013: refresh rw locks for [0x240000400:0x1c:0x0] (2097152->3145727) req@ffff88013198b480 x1830965175469952/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.896419:0:1854:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013198b480 with x1830965175469952 ext(2097152->3145727) 00002000:00010000:0.0:1746144911.896424:0:1854:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013198b480 00000100:00100000:1.0:1746144911.896430:0:25029:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131988700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:7454cbaf-97e3-4716-92c6-77cd48a94a90+11:1982:x1830965175470592:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 12240us (12383us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.896435:0:25029:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4539 00002000:00100000:1.0:1746144911.896439:0:25029:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x1d:0x0] (3145728->4194303) req@ffff880131988700 x1830965175470592/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.896445:0:25029:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880131988700 with x1830965175470592 ext(3145728->4194303) 00002000:00010000:1.0:1746144911.896448:0:25029:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880131988700 00000100:00100000:3.0:1746144911.902408:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013198bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1983:x1830965175470464:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 18277us (19269us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144911.902416:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4538 00002000:00100000:3.0:1746144911.902426:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1c:0x0] (3145728->4194303) req@ffff88013198bb80 x1830965175470464/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144911.902434:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013198bb80 with x1830965175470464 ext(3145728->4194303) 00002000:00010000:3.0:1746144911.902439:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013198bb80 00000100:00100000:0.0:1746144911.903710:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013198b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1982:x1830965175470336:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 20335us (20591us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.903719:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4537 00002000:00100000:0.0:1746144911.903726:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1d:0x0] (2097152->3145727) req@ffff88013198b800 x1830965175470336/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.903733:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013198b800 with x1830965175470336 ext(2097152->3145727) 00002000:00010000:0.0:1746144911.903737:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013198b800 00000100:00100000:2.0:1746144911.924564:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.924589:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.924617:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.924653:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.924673:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175471104 00000100:00100000:0.0:1746144911.924680:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175471104 00002000:00100000:0.0:1746144911.924716:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1c:0x0] (4194304->5242879) req@ffff880135253100 x1830965175471104/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.924724:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135253100 with x1830965175471104 ext(4194304->5242879) 00002000:00010000:0.0:1746144911.924729:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135253100 00000100:00100000:0.0:1746144911.924742:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175471232 00000100:00100000:0.0:1746144911.924745:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175471232 00002000:00100000:0.0:1746144911.924754:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1c:0x0] (5242880->6291455) req@ffff880135253480 x1830965175471232/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.924793:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135253480 with x1830965175471232 ext(5242880->6291455) 00002000:00010000:0.0:1746144911.924795:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135253480 00000100:00100000:0.0:1746144911.924805:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175471616 00000100:00100000:0.0:1746144911.924808:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175471616 00002000:00100000:0.0:1746144911.924820:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1d:0x0] (5242880->6291455) req@ffff880135253800 x1830965175471616/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.924825:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135253800 with x1830965175471616 ext(5242880->6291455) 00002000:00010000:0.0:1746144911.924827:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135253800 00000100:00100000:0.0:1746144911.924838:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175471488 00000100:00100000:0.0:1746144911.924840:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175471488 00002000:00100000:0.0:1746144911.924849:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1d:0x0] (4194304->5242879) req@ffff880135253b80 x1830965175471488/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.924854:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135253b80 with x1830965175471488 ext(4194304->5242879) 00002000:00010000:0.0:1746144911.924857:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135253b80 00000100:00100000:0.0:1746144911.924867:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4540 00000100:00100000:1.0:1746144911.924874:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4541 00000100:00100000:0.0:1746144911.924874:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+54:1985:x1830965175471104:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144911.924883:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+54:1985:x1830965175471232:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144911.925253:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4542 00000100:00100000:0.0:1746144911.925259:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1985:x1830965175471616:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144911.925269:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4543 00000100:00100000:1.0:1746144911.925276:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1985:x1830965175471488:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144911.935699:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135253100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+55:1985:x1830965175471104:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 10816us (11135us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.935709:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4540 00002000:00100000:1.0:1746144911.935718:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1c:0x0] (4194304->5242879) req@ffff880135253100 x1830965175471104/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.935726:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135253100 with x1830965175471104 ext(4194304->5242879) 00002000:00010000:1.0:1746144911.935730:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135253100 00000100:00100000:1.0:1746144911.941053:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135253480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1985:x1830965175471232:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 16164us (16455us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.941064:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4541 00002000:00100000:1.0:1746144911.941074:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (5242880->6291455) req@ffff880135253480 x1830965175471232/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.941083:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135253480 with x1830965175471232 ext(5242880->6291455) 00002000:00010000:1.0:1746144911.941088:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135253480 00000100:00100000:0.0:1746144911.944039:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135253800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+11:1985:x1830965175471616:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 18772us (19413us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.944048:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4542 00002000:00100000:0.0:1746144911.944056:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (5242880->6291455) req@ffff880135253800 x1830965175471616/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.944070:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135253800 with x1830965175471616 ext(5242880->6291455) 00002000:00010000:0.0:1746144911.944074:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135253800 00000100:00100000:1.0:1746144911.944550:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135253b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1985:x1830965175471488:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 19274us (19895us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.944556:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4543 00002000:00100000:1.0:1746144911.944560:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1d:0x0] (4194304->5242879) req@ffff880135253b80 x1830965175471488/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.944566:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135253b80 with x1830965175471488 ext(4194304->5242879) 00002000:00010000:1.0:1746144911.944569:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135253b80 00000100:00100000:2.0:1746144911.951061:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.951346:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175472000 00000100:00100000:1.0:1746144911.951355:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175472000 00002000:00100000:1.0:1746144911.951392:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1c:0x0] (6291456->7340031) req@ffff880135251f80 x1830965175472000/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.951401:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135251f80 with x1830965175472000 ext(6291456->7340031) 00002000:00010000:1.0:1746144911.951405:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135251f80 00000100:00100000:1.0:1746144911.951433:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4544 00000100:00100000:1.0:1746144911.951439:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1984:x1830965175472000:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144911.958748:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135251f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1984:x1830965175472000:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 7302us (7688us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.958757:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4544 00002000:00100000:1.0:1746144911.958865:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1c:0x0] (6291456->7340031) req@ffff880135251f80 x1830965175472000/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.958880:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135251f80 with x1830965175472000 ext(6291456->7340031) 00002000:00010000:1.0:1746144911.958885:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135251f80 00000100:00100000:0.0:1746144911.968158:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.968255:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175472256 00000100:00100000:1.0:1746144911.968263:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175472256 00002000:00100000:1.0:1746144911.968303:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1d:0x0] (6291456->7340031) req@ffff880132755880 x1830965175472256/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.968312:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132755880 with x1830965175472256 ext(6291456->7340031) 00002000:00010000:1.0:1746144911.968317:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132755880 00000100:00100000:1.0:1746144911.969326:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4545 00000100:00100000:1.0:1746144911.969336:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1985:x1830965175472256:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144911.969760:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144911.969823:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.969871:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175472512 00000100:00100000:0.0:1746144911.969876:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175472512 00002000:00100000:0.0:1746144911.969899:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (7340032->8388607) req@ffff8800a4c7c000 x1830965175472512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.969905:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7c000 with x1830965175472512 ext(7340032->8388607) 00002000:00010000:0.0:1746144911.969909:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4c7c000 00000100:00100000:0.0:1746144911.969929:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175472768 00000100:00100000:0.0:1746144911.969932:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175472768 00002000:00100000:0.0:1746144911.969943:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c:0x0] (7340032->8388607) req@ffff8800a4c7c380 x1830965175472768/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.969948:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7c380 with x1830965175472768 ext(7340032->8388607) 00002000:00010000:0.0:1746144911.969951:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c7c380 00000100:00100000:0.0:1746144911.969970:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4546 00000100:00100000:0.0:1746144911.969975:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+11:1984:x1830965175472512:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144911.969987:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4547 00000100:00100000:1.0:1746144911.969992:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1984:x1830965175472768:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144911.979087:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132755880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+11:1985:x1830965175472256:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 9745us (10926us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144911.979098:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4545 00002000:00100000:1.0:1746144911.979108:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1d:0x0] (6291456->7340031) req@ffff880132755880 x1830965175472256/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.979116:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132755880 with x1830965175472256 ext(6291456->7340031) 00002000:00010000:1.0:1746144911.979121:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132755880 00000100:00100000:1.0:1746144911.986047:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1984:x1830965175472768:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 16045us (16214us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.986047:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1984:x1830965175472512:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 16061us (16278us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144911.986056:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4546 00002000:00100000:0.0:1746144911.986066:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (7340032->8388607) req@ffff8800a4c7c000 x1830965175472512/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.986075:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7c000 with x1830965175472512 ext(7340032->8388607) 00002000:00010000:0.0:1746144911.986081:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4c7c000 00000100:00100000:1.0:1746144911.986255:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4547 00002000:00100000:1.0:1746144911.986262:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (7340032->8388607) req@ffff8800a4c7c380 x1830965175472768/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.986269:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7c380 with x1830965175472768 ext(7340032->8388607) 00002000:00010000:1.0:1746144911.986273:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c7c380 00000100:00100000:2.0:1746144911.991080:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144911.991984:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175473024 00000100:00100000:1.0:1746144911.991993:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175473024 00002000:00100000:1.0:1746144911.992031:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (8388608->9437183) req@ffff8800a4c7c700 x1830965175473024/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144911.992040:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7c700 with x1830965175473024 ext(8388608->9437183) 00002000:00010000:1.0:1746144911.992044:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c7c700 00000100:00100000:1.0:1746144911.992070:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4548 00000100:00100000:1.0:1746144911.992076:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1984:x1830965175473024:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144911.997050:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144911.997439:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175473280 00000100:00100000:0.0:1746144911.997524:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175473280 00002000:00100000:0.0:1746144911.997564:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (8388608->9437183) req@ffff8800a4c7ca80 x1830965175473280/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/0 e 0 to 0 dl 1746144922 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144911.997573:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7ca80 with x1830965175473280 ext(8388608->9437183) 00002000:00010000:0.0:1746144911.997577:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4c7ca80 00000100:00100000:0.0:1746144911.998485:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4549 00000100:00100000:0.0:1746144911.998495:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1984:x1830965175473280:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:1.0:1746144912.007258:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1984:x1830965175473024:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 13376us (14379us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144912.007272:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4548 00002000:00100000:1.0:1746144912.007282:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (8388608->9437183) req@ffff8800a4c7c700 x1830965175473024/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.007291:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7c700 with x1830965175473024 ext(8388608->9437183) 00002000:00010000:1.0:1746144912.007297:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c7c700 00000100:00100000:0.0:1746144912.007640:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1984:x1830965175473280:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 9147us (10597us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144912.007646:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4549 00002000:00100000:0.0:1746144912.007651:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (8388608->9437183) req@ffff8800a4c7ca80 x1830965175473280/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:552/0 lens 488/440 e 0 to 0 dl 1746144922 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.007657:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7ca80 with x1830965175473280 ext(8388608->9437183) 00002000:00010000:0.0:1746144912.007661:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4c7ca80 00000100:00100000:2.0:1746144912.015327:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144912.015360:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144912.015414:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175473664 00000100:00100000:0.0:1746144912.015422:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175473792 00000100:00100000:1.0:1746144912.015423:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175473664 00000100:00100000:0.0:1746144912.015425:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175473792 00002000:00100000:0.0:1746144912.015457:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (9437184->10485759) req@ffff8800a4c7d180 x1830965175473792/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.015466:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7d180 with x1830965175473792 ext(9437184->10485759) 00002000:00010000:0.0:1746144912.015470:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4c7d180 00000100:00100000:0.0:1746144912.015496:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4550 00000100:00100000:0.0:1746144912.015503:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1985:x1830965175473792:12345-192.168.202.16@tcp:3:cmp.0 00002000:00100000:1.0:1746144912.015971:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (9437184->10485759) req@ffff8800a4c7ce00 x1830965175473664/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.015978:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7ce00 with x1830965175473664 ext(9437184->10485759) 00002000:00010000:1.0:1746144912.015982:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c7ce00 00000100:00100000:1.0:1746144912.016402:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4551 00000100:00100000:1.0:1746144912.016408:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1985:x1830965175473664:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144912.028041:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1985:x1830965175473792:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 12530us (12672us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144912.028050:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4550 00002000:00100000:0.0:1746144912.028059:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (9437184->10485759) req@ffff8800a4c7d180 x1830965175473792/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/440 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.028068:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7d180 with x1830965175473792 ext(9437184->10485759) 00002000:00010000:0.0:1746144912.028073:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4c7d180 00000100:00100000:1.0:1746144912.031857:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1985:x1830965175473664:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 15440us (16529us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144912.031866:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4551 00002000:00100000:1.0:1746144912.031875:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (9437184->10485759) req@ffff8800a4c7ce00 x1830965175473664/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/440 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.031884:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7ce00 with x1830965175473664 ext(9437184->10485759) 00002000:00010000:1.0:1746144912.031889:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c7ce00 00000100:00100000:2.0:1746144912.039047:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144912.039096:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144912.039368:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175474048 00000100:00100000:1.0:1746144912.039380:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175474048 00000100:00100000:0.0:1746144912.039425:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175474304 00000100:00100000:0.0:1746144912.039429:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175474304 00002000:00100000:0.0:1746144912.039450:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (10485760->11534335) req@ffff8800a4c7d880 x1830965175474304/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.039460:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7d880 with x1830965175474304 ext(10485760->11534335) 00002000:00010000:0.0:1746144912.039464:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4c7d880 00000100:00100000:0.0:1746144912.039497:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4552 00000100:00100000:0.0:1746144912.039504:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1985:x1830965175474304:12345-192.168.202.16@tcp:3:cmp.0 00002000:00100000:1.0:1746144912.040234:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (10485760->11534335) req@ffff8800a4c7d500 x1830965175474048/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.040241:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7d500 with x1830965175474048 ext(10485760->11534335) 00002000:00010000:1.0:1746144912.040244:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c7d500 00000100:00100000:1.0:1746144912.040258:0:8436:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4553 00000100:00100000:1.0:1746144912.040264:0:8436:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1984:x1830965175474048:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:2.0:1746144912.049053:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144912.049288:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175474560 00000100:00100000:3.0:1746144912.049296:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175474560 00002000:00100000:3.0:1746144912.049331:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1c:0x0] (11534336->12582911) req@ffff8800a4c7dc00 x1830965175474560/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144912.049341:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7dc00 with x1830965175474560 ext(11534336->12582911) 00002000:00010000:3.0:1746144912.049345:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c7dc00 00000100:00100000:3.0:1746144912.049370:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4554 00000100:00100000:3.0:1746144912.049376:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+55:1984:x1830965175474560:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:0.0:1746144912.054089:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1985:x1830965175474304:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 14576us (14983us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144912.054098:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4552 00002000:00100000:0.0:1746144912.054108:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1d:0x0] (10485760->11534335) req@ffff8800a4c7d880 x1830965175474304/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/440 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.054116:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7d880 with x1830965175474304 ext(10485760->11534335) 00002000:00010000:0.0:1746144912.054121:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4c7d880 00000100:00100000:1.0:1746144912.058642:0:8436:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+55:1984:x1830965175474048:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 18369us (19594us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144912.058652:0:8436:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4553 00002000:00100000:1.0:1746144912.058661:0:8436:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1c:0x0] (10485760->11534335) req@ffff8800a4c7d500 x1830965175474048/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/440 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.058674:0:8436:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7d500 with x1830965175474048 ext(10485760->11534335) 00002000:00010000:1.0:1746144912.058679:0:8436:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c7d500 00000100:00100000:3.0:1746144912.064059:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1984:x1830965175474560:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 14673us (15004us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144912.064069:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4554 00002000:00100000:3.0:1746144912.064080:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1c:0x0] (11534336->12582911) req@ffff8800a4c7dc00 x1830965175474560/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/440 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144912.064088:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7dc00 with x1830965175474560 ext(11534336->12582911) 00002000:00010000:3.0:1746144912.064093:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c7dc00 00000100:00100000:2.0:1746144912.076492:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144912.076594:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175474816 00000100:00100000:3.0:1746144912.076602:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175474816 00002000:00100000:3.0:1746144912.076638:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1d:0x0] (11534336->12582911) req@ffff8800a4c7df80 x1830965175474816/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144912.076645:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7df80 with x1830965175474816 ext(11534336->12582911) 00002000:00010000:3.0:1746144912.076650:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4c7df80 00000100:00100000:3.0:1746144912.076721:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4555 00000100:00100000:3.0:1746144912.076728:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1984:x1830965175474816:12345-192.168.202.16@tcp:3:cmp.0 00000100:00100000:3.0:1746144912.086276:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1984:x1830965175474816:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 9540us (9783us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746144912.086287:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4555 00002000:00100000:3.0:1746144912.086296:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1d:0x0] (11534336->12582911) req@ffff8800a4c7df80 x1830965175474816/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/440 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:3.0:1746144912.086306:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7df80 with x1830965175474816 ext(11534336->12582911) 00002000:00010000:3.0:1746144912.086311:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4c7df80 00000100:00100000:2.0:1746144912.091746:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000004:00080000:1.0:1746144912.091881:0:8650:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 506239117284ns, next at 507239115820ns, rc = 0 00000100:00100000:1.0:1746144912.091905:0:3306:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746144912.091918:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965172546816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746144912.091957:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144912.092103:0:8435:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172546816 00000100:00100000:3.0:1746144912.092110:0:8435:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172546816 00000100:00080000:2.0:1746144912.092142:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746144912.092156:0:8435:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1746144912.092163:0:8435:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1830965172546816:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746144912.092299:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175475072 00000100:00100000:0.0:1746144912.092303:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175475072 00002000:00100000:0.0:1746144912.092329:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1c:0x0] (12582912->13631487) req@ffff8800a4c7e300 x1830965175475072/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.092336:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7e300 with x1830965175475072 ext(12582912->13631487) 00002000:00010000:0.0:1746144912.092340:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c7e300 00000100:00100000:0.0:1746144912.092365:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4556 00000100:00100000:0.0:1746144912.092370:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1985:x1830965175475072:12345-192.168.202.16@tcp:3:cmp.0 00002000:00000024:3.0:1746144912.092822:0:8435:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 482017280 pending 37486592 free 3838836736 avail 3836739584 00000100:00100000:3.0:1746144912.092864:0:8435:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1830965172546816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 701us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144912.092869:0:8435:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1746144912.094030:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965172546816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746144912.099066:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1985:x1830965175475072:12345-192.168.202.16@tcp:3:cmp.0 Request processed in 6688us (7319us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746144912.099076:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4556 00002000:00100000:0.0:1746144912.099086:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1c:0x0] (12582912->13631487) req@ffff8800a4c7e300 x1830965175475072/t0(0) o3->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/440 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cmp.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.099094:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4c7e300 with x1830965175475072 ext(12582912->13631487) 00002000:00010000:0.0:1746144912.099098:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4c7e300 00000100:00100000:2.0:1746144912.105833:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144912.105887:0:7114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175475328 00000100:00100000:3.0:1746144912.105898:0:7114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175475328 00000100:00100000:3.0:1746144912.105957:0:7114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 176 00000100:00100000:3.0:1746144912.105965:0:7114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1138:x1830965175475328:12345-192.168.202.16@tcp:35:cmp.0 00000100:00080000:2.0:1746144912.106001:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746144912.106150:0:7114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+27:1138:x1830965175475328:12345-192.168.202.16@tcp:35:cmp.0 Request processed in 185us (322us total) trans 4294987549 rc 0/0 00000100:00100000:3.0:1746144912.106324:0:7114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 176 00000100:00100000:2.0:1746144912.108413:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144912.108461:0:7114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175475584 00000100:00100000:3.0:1746144912.108466:0:7114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175475584 00000100:00100000:1.0:1746144912.108529:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 177 00000100:00100000:1.0:1746144912.108538:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+27:1138:x1830965175475584:12345-192.168.202.16@tcp:35:cmp.0 00000100:00100000:1.0:1746144912.108683:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+28:1138:x1830965175475584:12345-192.168.202.16@tcp:35:cmp.0 Request processed in 147us (275us total) trans 4294987550 rc 0/0 00000100:00100000:1.0:1746144912.108688:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 177 00000100:00100000:0.0:1746144912.120540:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144912.120605:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175475968 00000100:00100000:1.0:1746144912.120615:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175475968 00000100:00100000:1.0:1746144912.120676:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48286 00000100:00100000:1.0:1746144912.120683:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1142:x1830965175475968:12345-192.168.202.16@tcp:36:rm.0 00010000:00010000:1.0:1746144912.120727:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1746144912.120751:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009930a400/0x4076af672751617c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95676 expref: 33 pid: 7117 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.120820:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800931b3200/0x4076af672751611a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9565a expref: 32 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.120832:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff88009a8b7e00) 00010000:00010000:1.0:1746144912.120839:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b466600/0x4076af672751633c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956df expref: 31 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.120847:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:1.0:1746144912.120849:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144912.120866:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144912.120877:0:7113:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727516389 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95702 expref: 27 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.120883:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144912.120909:0:7113:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727516389 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95702 expref: 27 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.120924:0:7113:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727516389 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95702 expref: 27 pid: 7111 timeout: 606 lvb_type: 0 00000100:00100000:1.0:1746144912.120935:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7113:1830965172546944:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144912.121450:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144912.121469:0:7116:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175475712 00000100:00100000:2.0:1746144912.121474:0:7116:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175475712 00000100:00100000:2.0:1746144912.121505:0:7116:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:2.0:1746144912.121510:0:7116:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1982:x1830965175475712:12345-192.168.202.16@tcp:63:ll_sa.0 00010000:00010000:2.0:1746144912.121527:0:7116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144912.121534:0:7116:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e33d600/0x4076af672751643f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af957f0 expref: -99 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144912.121560:0:7116:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e33cc00/0x4076af6727516446 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.121567:0:7116:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e33cc00/0x4076af6727516446 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.121574:0:7116:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e33cc00/0x4076af6727516446 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.121584:0:7116:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af672751644d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.121588:0:7116:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af672751644d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.121593:0:7116:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af672751644d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.121637:0:7116:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e33cc00/0x4076af6727516446 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.121642:0:7116:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e33cc00/0x4076af6727516446 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.121647:0:7116:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e33cc00/0x4076af6727516446 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.121654:0:7116:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e33cc00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144912.121657:0:7116:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e33cc00/0x4076af6727516446 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.121662:0:7116:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e33cc00/0x4076af6727516446 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.121668:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:2.0:1746144912.121670:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144912.121672:0:7116:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.121677:0:7116:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e33cc00/0x4076af6727516446 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.121680:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e33cc00/0x4076af6727516446 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00000100:00100000:1.0:1746144912.122325:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135add9c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746144912.122498:0:7116:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af672751644d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.122504:0:7116:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af672751644d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.122510:0:7116:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af672751644d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.122514:0:7116:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091750200 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144912.122516:0:7116:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af672751644d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.122521:0:7116:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af672751644d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.122532:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce70cf (ffff8800a47e0f00) 00010000:00010000:2.0:1746144912.122535:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144912.122537:0:7116:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af672751644d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.122541:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af672751644d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:2.0:1746144912.122577:0:7116:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e33d600/0x4076af672751643f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af957f0 expref: 32 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144912.122584:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:2.0:1746144912.122586:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1746144912.122588:0:7116:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.122595:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e33d600/0x4076af672751643f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af957f0 expref: 32 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144912.122602:0:7116:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e33d600, rc -2) 00000100:00100000:2.0:1746144912.122886:0:7116:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132755f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1982:x1830965175475712:12345-192.168.202.16@tcp:63:ll_sa.0 Request processed in 1374us (1436us total) trans 0 rc -2/-2 00000100:00100000:2.0:1746144912.122893:0:7116:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11 00000100:00100000:1.0:1746144912.126128:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7113:1830965172546944:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144912.126147:0:7113:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000100:00100000:0.0:1746144912.126293:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144912.126716:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175476096 00000100:00100000:2.0:1746144912.126723:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175476096 00010000:00010000:2.0:1746144912.126750:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727516389 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95702 expref: 28 pid: 7111 timeout: 606 lvb_type: 0 00000100:00100000:2.0:1746144912.126814:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11297 00000100:00100000:2.0:1746144912.126821:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132756300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+28:1984:x1830965175476096:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144912.126831:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144912.126836:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727516389 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95702 expref: 28 pid: 7111 timeout: 606 lvb_type: 0 00010000:00010000:2.0:1746144912.126845:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727516389 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95702 expref: 28 pid: 7111 timeout: 606 lvb_type: 0 00010000:00010000:2.0:1746144912.126914:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009b467c00/0x4076af6727516389 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95702 expref: 28 pid: 7111 timeout: 606 lvb_type: 0 00010000:00010000:2.0:1746144912.126928:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:2.0:1746144912.126932:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.126939:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.126944:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.126958:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144912.127110:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132756300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+27:1984:x1830965175476096:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 288us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144912.127116:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11297 00010000:00010000:1.0:1746144912.127465:0:7113:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144912.127473:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144912.127492:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af6727516454 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144912.127499:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af6727516454 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144912.127505:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af6727516454 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144912.127591:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af672751645b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144912.127599:0:7113:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880092553e00/0x4076af67275161ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956b5 expref: 26 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.127606:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af672751645b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144912.127624:0:7113:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880092553e00/0x4076af67275161ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956b5 expref: 26 pid: 21076 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.127634:0:7113:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880092553e00/0x4076af67275161ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956b5 expref: 26 pid: 21076 timeout: 606 lvb_type: 0 00000100:00100000:1.0:1746144912.127644:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7113:1830965172547072:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144912.127716:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135add9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746144912.130298:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7113:1830965172547072:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144912.130317:0:7113:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af672751645b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000100:00100000:3.0:1746144912.133131:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144912.133383:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175476224 00000100:00100000:2.0:1746144912.133390:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175476224 00010000:00010000:2.0:1746144912.133417:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092553e00/0x4076af67275161ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956b5 expref: 27 pid: 21076 timeout: 606 lvb_type: 0 00000100:00100000:2.0:1746144912.133457:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11298 00000100:00100000:2.0:1746144912.133464:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+27:1984:x1830965175476224:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144912.133475:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144912.133479:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880092553e00/0x4076af67275161ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956b5 expref: 27 pid: 21076 timeout: 606 lvb_type: 0 00010000:00010000:2.0:1746144912.133490:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880092553e00/0x4076af67275161ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956b5 expref: 27 pid: 21076 timeout: 606 lvb_type: 0 00010000:00010000:2.0:1746144912.133507:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092553e00/0x4076af67275161ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af956b5 expref: 27 pid: 21076 timeout: 606 lvb_type: 0 00010000:00010000:2.0:1746144912.133520:0:7097:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff88009a8b7e00) 00010000:00010000:2.0:1746144912.133524:0:7097:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af672751645b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.133532:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af672751645b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.133537:0:7097:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af672751645b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.133570:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144912.133606:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1984:x1830965175476224:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 143us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144912.133612:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11298 00010000:00010000:0.0:1746144912.133976:0:7113:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af672751645b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.133982:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af672751645b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000040:00080000:0.0:1746144912.134550:0:7113:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x3:0x0].15, 64 off9152 00000040:00080000:0.0:1746144912.134564:0:7113:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x6:0x0].14, 64 off9088 00000004:00080000:0.0:1746144912.134569:0:7113:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 506281805833ns, next at 507281804534ns, rc = 0 00010000:00010000:0.0:1746144912.134621:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516462 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134630:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134637:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516462 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134642:0:7113:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516462 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134646:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516462 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134652:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516462 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134664:0:7113:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1746144912.134679:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af672751645b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134682:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af672751645b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134687:0:7113:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af672751645b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134692:0:7113:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099a61a00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144912.134694:0:7113:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af672751645b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134699:0:7113:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af672751645b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134709:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff88009a8b7e00) 00010000:00010000:0.0:1746144912.134712:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746144912.134714:0:7113:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af672751645b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134718:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af672751645b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134820:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134825:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134830:0:7113:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134833:0:7113:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099a60000 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144912.134836:0:7113:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134840:0:7113:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134846:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009bbca500) 00010000:00010000:0.0:1746144912.134848:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144912.134850:0:7113:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.134854:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af6727516438 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00000004:00010000:0.0:1746144912.134865:0:7113:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880132755c00 reply state ffff88009a8a6000 transno 4294987551 ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af6727516454 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000100:00100000:0.0:1746144912.134871:0:7113:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746144912.134907:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132755c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1142:x1830965175475968:12345-192.168.202.16@tcp:36:rm.0 Request processed in 14225us (14374us total) trans 4294987551 rc 0/0 00000100:00100000:0.0:1746144912.134913:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48286 00010000:00010000:2.0:1746144912.135239:0:8446:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1746144912.135243:0:8446:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516462 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.135247:0:8446:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e906600 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:2.0:1746144912.135249:0:8446:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516462 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.135252:0:8446:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516462 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.135257:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff88009a8b7e00) 00010000:00010000:2.0:1746144912.135259:0:8446:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1746144912.135260:0:8446:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516462 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.135262:0:8446:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516462 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.135270:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746144912.135271:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746144912.135272:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746144912.139360:0:3292:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af6727516454 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144912.139373:0:3292:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af6727516454 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144912.139379:0:3292:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af6727516454 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144912.139384:0:3292:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099a60e00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144912.139388:0:3292:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af6727516454 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144912.139393:0:3292:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af6727516454 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144912.139406:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff88009bbca900) 00010000:00010000:3.0:1746144912.139409:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144912.139412:0:3292:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af6727516454 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:3.0:1746144912.139417:0:3292:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af6727516454 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00000100:00100000:3.0:1746144912.181931:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.181987:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175476352 00000100:00100000:0.0:1746144912.181995:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175476352 00000100:00100000:0.0:1746144912.182035:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48287 00000100:00100000:0.0:1746144912.182041:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+31:1145:x1830965175476352:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:0.0:1746144912.182059:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144912.182075:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907200/0x4076af6727516469 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95828 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.182117:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907c00/0x4076af6727516470 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.182126:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907c00/0x4076af6727516470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.182134:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907c00/0x4076af6727516470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:0.0:1746144912.182173:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:0.0:1746144912.182176:0:7113:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 28 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144912.182187:0:7113:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907c00/0x4076af6727516470 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.182201:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907200/0x4076af6727516469 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95828 expref: 33 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.182230:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907c00/0x4076af6727516470 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95828 expref: 32 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.182237:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880093f4c100) 00010000:00010000:0.0:1746144912.182239:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746144912.182241:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012e907c00, rc 0) 00000100:00100000:0.0:1746144912.182284:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131988a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1145:x1830965175476352:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 243us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144912.182289:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48287 00000100:00100000:0.0:1746144912.185426:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144912.185509:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175476608 00000100:00100000:3.0:1746144912.185516:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175476608 00000100:00100000:3.0:1746144912.185550:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48288 00000100:00100000:3.0:1746144912.185557:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+32:1145:x1830965175476608:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:3.0:1746144912.185571:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746144912.185574:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746144912.185594:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907c00/0x4076af6727516470 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95828 expref: 32 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144912.185721:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880093f4c100) 00010000:00010000:3.0:1746144912.185732:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746144912.185742:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb68000/0x4076af6727516477 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9582f expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144912.185984:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69c00/0x4076af672751647e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144912.186044:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69c00/0x4076af672751647e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144912.186052:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69c00/0x4076af672751647e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144912.186062:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69800/0x4076af6727516485 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144912.186070:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69800/0x4076af6727516485 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144912.186075:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69800/0x4076af6727516485 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144912.186392:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a73c00/0x4076af672751648c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144912.186398:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099a73c00/0x4076af672751648c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144912.186858:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a73c00/0x4076af672751648c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:3.0:1746144912.186867:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x50:0x0]: returning size 0 00010000:00010000:3.0:1746144912.186884:0:7111:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69c00/0x4076af672751647e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144912.186889:0:7111:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69c00/0x4076af672751647e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144912.186894:0:7111:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69c00/0x4076af672751647e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144912.186898:0:7111:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bb69c00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:3.0:1746144912.186901:0:7111:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69c00/0x4076af672751647e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144912.186906:0:7111:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69c00/0x4076af672751647e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144912.186913:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88009a8b7c00) 00010000:00010000:3.0:1746144912.186915:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746144912.186918:0:7111:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69c00/0x4076af672751647e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:3.0:1746144912.186921:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69c00/0x4076af672751647e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00000004:00010000:3.0:1746144912.186930:0:7111:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880132756680 reply state ffff88009aeb2000 transno 4294987552 ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69800/0x4076af6727516485 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000100:00100000:3.0:1746144912.186935:0:7111:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1746144912.186953:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb68000/0x4076af6727516477 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9582f expref: 34 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144912.186966:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a73c00/0x4076af672751648c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9582f expref: 33 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144912.186971:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff88009a8b7200) 00010000:00010000:3.0:1746144912.186973:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746144912.186975:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099a73c00, rc 0) 00000100:00100000:3.0:1746144912.187167:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132756680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1145:x1830965175476608:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 1609us (1746us total) trans 4294987552 rc 0/0 00000100:00100000:3.0:1746144912.187173:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48288 00010000:00010000:2.0:1746144912.189248:0:3293:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69800/0x4076af6727516485 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144912.189259:0:3293:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69800/0x4076af6727516485 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144912.189264:0:3293:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69800/0x4076af6727516485 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144912.189269:0:3293:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009bb69800 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144912.189273:0:3293:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69800/0x4076af6727516485 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144912.189278:0:3293:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69800/0x4076af6727516485 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144912.189290:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff88009a8b7600) 00010000:00010000:2.0:1746144912.189293:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746144912.189296:0:3293:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69800/0x4076af6727516485 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:2.0:1746144912.189300:0:3293:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bb69800/0x4076af6727516485 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00000100:00100000:2.0:1746144912.189521:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.189634:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175476864 00000100:00100000:0.0:1746144912.189641:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175476864 00000100:00100000:1.0:1746144912.189827:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48289 00000100:00100000:1.0:1746144912.189835:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1145:x1830965175476864:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:1.0:1746144912.189852:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144912.189864:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60600/0x4076af672751649a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95836 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.189925:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60400/0x4076af67275164a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144912.189934:0:7113:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a73c00/0x4076af672751648c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9582f expref: 34 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.189940:0:7113:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60400/0x4076af67275164a1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144912.189964:0:7113:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099a73c00/0x4076af672751648c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9582f expref: 34 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.189973:0:7113:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a73c00/0x4076af672751648c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9582f expref: 34 pid: 7111 timeout: 606 lvb_type: 0 00000100:00100000:1.0:1746144912.189981:0:7113:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135ea6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7113:1830965172547200:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144912.190060:0:7113:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135add9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746144912.192529:0:7113:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135ea6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7113:1830965172547200:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144912.192548:0:7113:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60400/0x4076af67275164a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000100:00100000:2.0:1746144912.193463:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144912.193523:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175476992 00000100:00100000:1.0:1746144912.193528:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175476992 00010000:00010000:1.0:1746144912.193550:0:9812:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099a73c00/0x4076af672751648c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9582f expref: 35 pid: 7111 timeout: 606 lvb_type: 0 00000100:00100000:1.0:1746144912.193575:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11299 00000100:00100000:1.0:1746144912.193581:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1985:x1830965175476992:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144912.193591:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144912.193596:0:9812:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099a73c00/0x4076af672751648c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9582f expref: 35 pid: 7111 timeout: 606 lvb_type: 0 00010000:00010000:1.0:1746144912.193605:0:9812:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099a73c00/0x4076af672751648c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9582f expref: 35 pid: 7111 timeout: 606 lvb_type: 0 00010000:00010000:1.0:1746144912.193620:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a73c00/0x4076af672751648c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9582f expref: 35 pid: 7111 timeout: 606 lvb_type: 0 00010000:00010000:1.0:1746144912.193732:0:9812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff88009a8b7200) 00010000:00010000:1.0:1746144912.193736:0:9812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60400/0x4076af67275164a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144912.193743:0:9812:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60400/0x4076af67275164a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144912.193749:0:9812:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60400/0x4076af67275164a1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144912.193913:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144912.193947:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1985:x1830965175476992:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 361us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144912.193954:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11299 00010000:00010000:2.0:1746144912.193998:0:7113:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60400/0x4076af67275164a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.194004:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60400/0x4076af67275164a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:2.0:1746144912.194017:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x50:0x0]: returning size 0 00000004:00080000:2.0:1746144912.194454:0:7113:0:(osp_object.c:1637:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e:0x0], index 1: 0 00000004:00080000:2.0:1746144912.194460:0:7113:0:(osp_object.c:1637:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d:0x0], index 0: 0 00010000:00010000:2.0:1746144912.194554:0:7113:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60400/0x4076af67275164a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.194560:0:7113:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60400/0x4076af67275164a1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.194565:0:7113:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60400/0x4076af67275164a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.194573:0:7113:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a4a60400 already unused, calling callback (ffffffffa136a690) 00010000:00010000:2.0:1746144912.194576:0:7113:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60400/0x4076af67275164a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.194580:0:7113:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60400/0x4076af67275164a1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.194587:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff88009a8b7200) 00010000:00010000:2.0:1746144912.194590:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144912.194592:0:7113:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60400/0x4076af67275164a1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.194596:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60400/0x4076af67275164a1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.194646:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60600/0x4076af672751649a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95836 expref: 34 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144912.194652:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60600/0x4076af672751649a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95836 expref: 34 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144912.194661:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a60600, rc 0) 00000100:00100000:2.0:1746144912.194927:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1145:x1830965175476864:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 5092us (5407us total) trans 4294987553 rc 301/301 00000100:00100000:2.0:1746144912.194933:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48289 00000100:00100000:2.0:1746144912.196953:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144912.197020:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175477248 00000100:00100000:1.0:1746144912.197027:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175477248 00000100:00100000:1.0:1746144912.197110:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 178 00000100:00100000:1.0:1746144912.197117:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a621c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+33:1145:x1830965175477248:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:1.0:1746144912.197342:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a621c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1145:x1830965175477248:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 225us (391us total) trans 4294987554 rc 0/0 00000100:00100000:1.0:1746144912.197348:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 178 00000100:00100000:1.0:1746144912.198608:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144912.198650:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175477376 00000100:00100000:2.0:1746144912.198655:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175477376 00000100:00100000:2.0:1746144912.198688:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48290 00000100:00100000:2.0:1746144912.198694:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+34:1145:x1830965175477376:12345-192.168.202.16@tcp:101:lfs.0 00010000:00010000:2.0:1746144912.198707:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144912.198720:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091750e00/0x4076af67275164af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9583d expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144912.198755:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091750e00/0x4076af67275164af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9583d expref: 35 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144912.198796:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091750e00/0x4076af67275164af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x50:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9583d expref: 35 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144912.198811:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff8800a47e0d00) 00010000:00010000:2.0:1746144912.198813:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746144912.198816:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091750e00, rc 0) 00000100:00100000:2.0:1746144912.199273:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1145:x1830965175477376:12345-192.168.202.16@tcp:101:lfs.0 Request processed in 578us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144912.199279:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48290 00000100:00100000:2.0:1746144912.201073:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144912.201091:0:7114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175477632 00000100:00100000:3.0:1746144912.201098:0:7114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175477632 00000100:00100000:3.0:1746144912.201131:0:7114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 179 00000100:00100000:3.0:1746144912.201137:0:7114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+35:1145:x1830965175477632:12345-192.168.202.16@tcp:35:lfs.0 00000100:00100000:3.0:1746144912.201316:0:7114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1145:x1830965175477632:12345-192.168.202.16@tcp:35:lfs.0 Request processed in 178us (246us total) trans 4294987555 rc 0/0 00000100:00100000:3.0:1746144912.201322:0:7114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 179 00000100:00100000:3.0:1746144912.214585:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144912.215125:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175477760 00000100:00100000:2.0:1746144912.215133:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175477760 00000100:00100000:2.0:1746144912.215607:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48291 00000100:00100000:2.0:1746144912.215614:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1147:x1830965175477760:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1746144912.215632:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746144912.215647:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af67275164b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95844 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144912.215828:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091750000/0x4076af67275164bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.215838:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091750000/0x4076af67275164bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.215847:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091750000/0x4076af67275164bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:2.0:1746144912.215898:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:2.0:1746144912.215901:0:7113:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:2.0:1746144912.215918:0:7113:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091750000/0x4076af67275164bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00010000:00010000:2.0:1746144912.215935:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091750200/0x4076af67275164b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95844 expref: 28 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144912.215966:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091750000/0x4076af67275164bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95844 expref: 27 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144912.215972:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a47e0600) 00010000:00010000:2.0:1746144912.215975:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746144912.215977:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091750000, rc 0) 00000100:00100000:2.0:1746144912.216028:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131988380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+27:1147:x1830965175477760:12345-192.168.202.16@tcp:101:dd.0 Request processed in 414us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144912.216033:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48291 00000100:00100000:3.0:1746144912.217390:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.218820:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175477888 00000100:00100000:0.0:1746144912.218828:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175477888 00000100:00100000:0.0:1746144912.218860:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48292 00000100:00100000:0.0:1746144912.218866:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880131989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+36:1146:x1830965175477888:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:0.0:1746144912.218883:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746144912.220432:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.220470:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175478144 00000100:00100000:0.0:1746144912.220474:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175478144 00000100:00100000:0.0:1746144912.220494:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48293 00000100:00100000:0.0:1746144912.220498:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013198a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+27:1147:x1830965175478144:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:0.0:1746144912.220506:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144912.220513:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009334bc00/0x4076af67275164cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95852 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.220572:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009334b000/0x4076af67275164d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.220581:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009334b000/0x4076af67275164d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:0.0:1746144912.220590:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009334b000/0x4076af67275164d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:0.0:1746144912.220597:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4b:0x0]: returning size 26214400 00010000:00010000:0.0:1746144912.220680:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009334bc00/0x4076af67275164cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95852 expref: 30 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.220706:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009334b000/0x4076af67275164d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4b:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95852 expref: 29 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.220713:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff88009bbca000) 00010000:00010000:0.0:1746144912.220715:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746144912.220718:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009334b000, rc 0) 00000100:00100000:0.0:1746144912.220755:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013198a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+29:1147:x1830965175478144:12345-192.168.202.16@tcp:101:dd.0 Request processed in 255us (327us total) trans 4294987556 rc 0/0 00010000:00010000:1.0:1746144912.220756:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907200/0x4076af67275164c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9584b expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144912.220786:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48293 00010000:00010000:1.0:1746144912.220809:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af67275164e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.220816:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af67275164e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.220821:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af67275164e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:1.0:1746144912.220853:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:1.0:1746144912.220856:0:7111:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 29 stripe count 1 MDT count 1 00000004:00010000:1.0:1746144912.220863:0:7111:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af67275164e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.220877:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907200/0x4076af67275164c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9584b expref: 38 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.220916:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af67275164e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9584b expref: 37 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.220921:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a47e0600) 00010000:00010000:1.0:1746144912.220923:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1746144912.220926:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099a60e00, rc 0) 00000100:00100000:1.0:1746144912.220948:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880131989f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+37:1146:x1830965175477888:12345-192.168.202.16@tcp:101:dd.0 Request processed in 2082us (3561us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144912.220953:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48292 00000100:00100000:3.0:1746144912.223276:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144912.223603:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175478400 00000100:00100000:1.0:1746144912.223612:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175478400 00000100:00100000:1.0:1746144912.223652:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48294 00000100:00100000:1.0:1746144912.223658:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013198aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+29:1147:x1830965175478400:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1746144912.223675:0:7111:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144912.223677:0:7111:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746144912.223694:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091750000/0x4076af67275164bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95844 expref: 29 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.223705:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a47e0600) 00010000:00010000:1.0:1746144912.223709:0:7111:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144912.223716:0:7111:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af67275164e7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95859 expref: -99 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.223861:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60600/0x4076af67275164ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.223874:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60600/0x4076af67275164ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.223881:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60600/0x4076af67275164ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.223891:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af67275164f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.223896:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af67275164f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.223901:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af67275164f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.223949:0:7111:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60600/0x4076af67275164fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.223955:0:7111:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60600/0x4076af67275164fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.223960:0:7111:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60600/0x4076af67275164fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7111 initiator: MDT0 00000004:00200000:1.0:1746144912.223965:0:7111:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x50:0x0]: returning size 0 00010000:00010000:1.0:1746144912.224024:0:7111:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60600/0x4076af67275164ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.224029:0:7111:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60600/0x4076af67275164ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.224035:0:7111:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60600/0x4076af67275164ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.224039:0:7111:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099a60600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144912.224042:0:7111:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60600/0x4076af67275164ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.224047:0:7111:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60600/0x4076af67275164ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.224058:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a47e0600) 00010000:00010000:1.0:1746144912.224061:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144912.224064:0:7111:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60600/0x4076af67275164ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.224072:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60600/0x4076af67275164ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.224082:0:7111:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af67275164f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.224086:0:7111:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af67275164f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.224090:0:7111:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af67275164f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.224094:0:7111:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099a61a00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:1.0:1746144912.224096:0:7111:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af67275164f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.224101:0:7111:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af67275164f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.224106:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff88009bbcab00) 00010000:00010000:1.0:1746144912.224108:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746144912.224110:0:7111:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af67275164f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.224114:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61a00/0x4076af67275164f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7111 initiator: MDT0 00010000:00010000:1.0:1746144912.224139:0:7111:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60000/0x4076af67275164e7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95859 expref: 31 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.224148:0:7111:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4a60600/0x4076af67275164fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95859 expref: 30 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.224158:0:7111:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff8800a47e0d00) 00010000:00010000:1.0:1746144912.224160:0:7111:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144912.224161:0:7111:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4a60600, rc 0) 00000100:00100000:1.0:1746144912.224201:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013198aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+30:1147:x1830965175478400:12345-192.168.202.16@tcp:101:dd.0 Request processed in 543us (930us total) trans 4294987557 rc 0/0 00000100:00100000:1.0:1746144912.224207:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48294 00000100:00100000:0.0:1746144912.224833:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.224859:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.224881:0:7116:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175478784 00000100:00100000:0.0:1746144912.224884:0:7116:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175478784 00000100:00100000:0.0:1746144912.224906:0:7116:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:0.0:1746144912.224910:0:7116:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+37:1984:x1830965175478784:12345-192.168.202.16@tcp:63:ll_sa.0 00010000:00010000:0.0:1746144912.224928:0:7116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144912.224934:0:7116:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009334b800/0x4076af672751650a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95867 expref: -99 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.224958:0:7116:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907c00/0x4076af6727516511 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.224964:0:7116:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907c00/0x4076af6727516511 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.224971:0:7116:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907c00/0x4076af6727516511 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.224979:0:7116:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516518 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.224983:0:7116:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516518 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.224988:0:7116:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516518 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225034:0:7116:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880094383a00/0x4076af672751651f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x50:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225040:0:7116:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094383a00/0x4076af672751651f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225045:0:7116:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880094383a00/0x4076af672751651f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7116 initiator: MDT0 00000004:00200000:0.0:1746144912.225057:0:7116:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x50:0x0]: returning size 0 00000004:00200000:0.0:1746144912.225060:0:7116:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1746144912.225069:0:7116:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880094383a00/0x4076af672751651f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225074:0:7116:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880094383a00/0x4076af672751651f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225079:0:7116:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907c00/0x4076af6727516511 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225087:0:7116:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907c00/0x4076af6727516511 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225093:0:7116:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907c00/0x4076af6727516511 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225096:0:7116:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e907c00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144912.225098:0:7116:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907c00/0x4076af6727516511 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225103:0:7116:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907c00/0x4076af6727516511 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225109:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a47e0600) 00010000:00010000:0.0:1746144912.225112:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144912.225114:0:7116:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907c00/0x4076af6727516511 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225118:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e907c00/0x4076af6727516511 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225125:0:7116:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516518 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225129:0:7116:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516518 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225133:0:7116:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516518 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225136:0:7116:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e906600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144912.225138:0:7116:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516518 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225144:0:7116:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516518 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225149:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce6fcf (ffff880093f4cf00) 00010000:00010000:0.0:1746144912.225151:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144912.225152:0:7116:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516518 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225156:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e906600/0x4076af6727516518 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce6fcf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225171:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009334b800/0x4076af672751650a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95867 expref: 39 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.225179:0:7116:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880094383a00/0x4076af672751651f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x50:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95867 expref: 38 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.225184:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x50:0x0].0x0 (ffff8800a47e0d00) 00010000:00010000:0.0:1746144912.225186:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746144912.225188:0:7116:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880094383a00, rc 0) 00010000:00010000:0.0:1746144912.225191:0:7116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144912.225196:0:7116:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4782c00/0x4076af6727516526 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9586e expref: -99 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.225211:0:7116:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5f600/0x4076af672751652d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225216:0:7116:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5f600/0x4076af672751652d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225221:0:7116:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5f600/0x4076af672751652d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225228:0:7116:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5fe00/0x4076af6727516534 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225232:0:7116:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5fe00/0x4076af6727516534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225236:0:7116:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5fe00/0x4076af6727516534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225254:0:7116:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5f600/0x4076af672751652d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225259:0:7116:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5f600/0x4076af672751652d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225263:0:7116:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5f600/0x4076af672751652d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225267:0:7116:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5f600 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144912.225268:0:7116:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5f600/0x4076af672751652d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225273:0:7116:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5f600/0x4076af672751652d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225279:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a47e0600) 00010000:00010000:0.0:1746144912.225280:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144912.225282:0:7116:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5f600/0x4076af672751652d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225286:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5f600/0x4076af672751652d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225293:0:7116:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5fe00/0x4076af6727516534 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225298:0:7116:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5fe00/0x4076af6727516534 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225302:0:7116:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5fe00/0x4076af6727516534 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225306:0:7116:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5fe00 already unused, calling callback (ffffffffa136a690) 00010000:00010000:0.0:1746144912.225308:0:7116:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5fe00/0x4076af6727516534 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225312:0:7116:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5fe00/0x4076af6727516534 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225317:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xbce70cf (ffff880093f4c700) 00010000:00010000:0.0:1746144912.225318:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746144912.225320:0:7116:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5fe00/0x4076af6727516534 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225323:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a5fe00/0x4076af6727516534 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xbce70cf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7116 initiator: MDT0 00010000:00010000:0.0:1746144912.225346:0:7116:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=-2, rc=-2) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4782c00/0x4076af6727516526 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9586e expref: 39 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.225352:0:7116:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a47e0600) 00010000:00010000:0.0:1746144912.225353:0:7116:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1746144912.225356:0:7116:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a4782c00/0x4076af6727516526 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9586e expref: 39 pid: 7116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.225363:0:7116:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a4782c00, rc -2) 00000100:00100000:0.0:1746144912.225388:0:7116:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132756d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1984:x1830965175478784:12345-192.168.202.16@tcp:63:ll_sa.0 Request processed in 477us (528us total) trans 0 rc -2/-2 00000100:00100000:0.0:1746144912.225394:0:7116:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 12 00000100:00100000:1.0:1746144912.225953:0:7113:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175478656 00000100:00100000:1.0:1746144912.225958:0:7113:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175478656 00000100:00100000:1.0:1746144912.225987:0:7113:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 48295 00000100:00100000:1.0:1746144912.225992:0:7113:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1146:x1830965175478656:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:1.0:1746144912.226000:0:7113:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144912.226001:0:7113:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746144912.226011:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a60e00/0x4076af67275164e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9584b expref: 38 pid: 7111 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.226022:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800a47e0600) 00010000:00010000:1.0:1746144912.226027:0:7113:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746144912.226033:0:7113:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61200/0x4076af672751653b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af95860 expref: -99 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.226081:0:7113:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf22800/0x4076af6727516542 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144912.226088:0:7113:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf22800/0x4076af6727516542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7113 initiator: MDT0 00010000:00010000:1.0:1746144912.226093:0:7113:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf22800/0x4076af6727516542 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7113 initiator: MDT0 00000004:00200000:1.0:1746144912.226102:0:7113:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 26214400 00010000:00010000:1.0:1746144912.226167:0:7113:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099a61200/0x4076af672751653b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95860 expref: 40 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.226180:0:7113:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf22800/0x4076af6727516542 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95860 expref: 39 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.226185:0:7113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff880099b35800) 00010000:00010000:1.0:1746144912.226187:0:7113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746144912.226189:0:7113:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf22800, rc 0) 00000100:00100000:1.0:1746144912.226319:0:7113:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132756a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1146:x1830965175478656:12345-192.168.202.16@tcp:101:dd.0 Request processed in 325us (1485us total) trans 4294987558 rc 0/0 00000100:00100000:1.0:1746144912.226325:0:7113:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 48295 00000100:00100000:3.0:1746144912.230966:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144912.231378:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144912.232410:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144912.232457:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175478912 00000100:00100000:1.0:1746144912.232465:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175478912 00000100:00100000:1.0:1746144912.232506:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175479040 00000100:00100000:1.0:1746144912.232508:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175479040 00000100:00100000:1.0:1746144912.232528:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5905 00000100:00100000:1.0:1746144912.232534:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175478912:12345-192.168.202.16@tcp:101:ll_agl.0 00010000:00010000:1.0:1746144912.232548:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144912.232562:0:8433:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af6727516550 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af9589f expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144912.232580:0:8433:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1746144912.232594:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144912.232596:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144912.232602:0:8433:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af6727516550 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9589f expref: 10 pid: 8433 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144912.232616:0:8433:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af6727516550 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9589f expref: 10 pid: 8433 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144912.232624:0:8433:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf23800, rc 0) 00000100:00100000:1.0:1746144912.232661:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1985:x1830965175478912:12345-192.168.202.16@tcp:101:ll_agl.0 Request processed in 127us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144912.232666:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5905 00000100:00100000:1.0:1746144912.232681:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5906 00000100:00100000:1.0:1746144912.232686:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880093855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175479040:12345-192.168.202.16@tcp:101:ll_agl.0 00010000:00010000:1.0:1746144912.232691:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746144912.232700:0:8433:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009bf23600/0x4076af6727516557 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af958a6 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746144912.232712:0:8433:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1746144912.232719:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144912.232720:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144912.232723:0:8433:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf23600/0x4076af6727516557 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958a6 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144912.232733:0:8433:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009bf23600/0x4076af6727516557 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958a6 expref: 9 pid: 8433 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746144912.232740:0:8433:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009bf23600, rc 0) 00000100:00100000:1.0:1746144912.232753:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880093855f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175479040:12345-192.168.202.16@tcp:101:ll_agl.0 Request processed in 68us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144912.232782:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5906 00000100:00100000:1.0:1746144912.232796:0:9812:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175479168 00000100:00100000:1.0:1746144912.232798:0:9812:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175479168 00000100:00100000:1.0:1746144912.232816:0:9812:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 301 00000100:00100000:1.0:1746144912.232820:0:9812:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801391d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1983:x1830965175479168:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746144912.232827:0:9812:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746144912.232842:0:9812:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009bf22800/0x4076af6727516542 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95860 expref: 39 pid: 7113 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.232853:0:9812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff880099b35800) 00010000:00010000:1.0:1746144912.232857:0:9812:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746144912.232870:0:9812:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801391d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1983:x1830965175479168:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 50us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1746144912.232875:0:9812:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 301 00000100:00080000:2.0:1746144912.232933:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746144912.232936:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746144912.234965:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.234986:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175479296 00000100:00100000:0.0:1746144912.234992:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175479296 00000100:00100000:0.0:1746144912.235018:0:10401:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5907 00000100:00100000:0.0:1746144912.235024:0:10401:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1147:x1830965175479296:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:0.0:1746144912.235036:0:10401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746144912.235047:0:10401:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a5ec00/0x4076af672751655e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af958ad expref: -99 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.235066:0:10401:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af6727516550 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9589f expref: 9 pid: 8433 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144912.235077:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144912.235079:0:10401:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144912.235081:0:10401:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5ec00/0x4076af672751655e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958ad expref: 10 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.235105:0:10401:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af6727516550 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9589f expref: 9 pid: 8433 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144912.235116:0:10401:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af6727516550 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9589f expref: 9 pid: 8433 timeout: 606 lvb_type: 1 00000100:00100000:0.0:1746144912.235125:0:10401:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132757100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172547328:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144912.235919:0:10401:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a893e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746144912.241083:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144912.241119:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144912.241242:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175479552 00000100:00100000:1.0:1746144912.241249:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175479552 00000100:00100000:1.0:1746144912.241293:0:8436:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175479808 00000100:00100000:1.0:1746144912.241295:0:8436:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175479808 00000100:00100000:1.0:1746144912.241319:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4557 00000100:00100000:1.0:1746144912.241325:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175479552:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:1.0:1746144912.241353:0:8438:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516565 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.241365:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144912.241366:0:8438:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746144912.241370:0:8438:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516565 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.241384:0:8438:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516565 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144912.241438:0:10401:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132757100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10401:1830965172547328:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144912.241460:0:10401:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a5ec00/0x4076af672751655e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958ad expref: 10 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.241471:0:10401:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a5ec00, rc 0) 00000100:00100000:0.0:1746144912.241520:0:10401:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1147:x1830965175479296:12345-192.168.202.16@tcp:101:dd.0 Request processed in 6495us (6559us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144912.241527:0:10401:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5907 00000100:00100000:0.0:1746144912.241551:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4558 00000100:00100000:0.0:1746144912.241557:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+10:1983:x1830965175479808:12345-192.168.202.16@tcp:3:dd.0 00010000:00010000:0.0:1746144912.241572:0:31844:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a5ee00/0x4076af672751656c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.241580:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144912.241581:0:31844:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144912.241584:0:31844:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5ee00/0x4076af672751656c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.241592:0:31844:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a5ee00/0x4076af672751656c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144912.243635:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.243693:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175479936 00000100:00100000:0.0:1746144912.243699:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175479936 00010000:00010000:0.0:1746144912.243723:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af6727516550 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9589f expref: 12 pid: 8433 timeout: 606 lvb_type: 1 00000100:00100000:0.0:1746144912.243742:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11300 00000100:00100000:0.0:1746144912.243748:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+12:1985:x1830965175479936:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144912.243759:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144912.243801:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af6727516550 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9589f expref: 12 pid: 8433 timeout: 606 lvb_type: 1 00010000:00010000:0.0:1746144912.244082:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af6727516550 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9589f expref: 12 pid: 8433 timeout: 606 lvb_type: 1 00010000:00010000:0.0:1746144912.245308:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009bf23800/0x4076af6727516550 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9589f expref: 12 pid: 8433 timeout: 606 lvb_type: 1 00010000:00010000:0.0:1746144912.246142:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144912.246145:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144912.246153:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a5ec00/0x4076af672751655e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958ad expref: 9 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.246162:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5ec00/0x4076af672751655e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958ad expref: 9 pid: 10401 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.246191:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091a5ec00/0x4076af672751655e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958ad expref: 9 pid: 10401 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144912.246201:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880132757100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965172547456:192.168.202.16@tcp:105: 00000100:00100000:0.0:1746144912.246256:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a893e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746144912.255511:0:8438:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516565 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.255523:0:8438:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516565 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.255530:0:8438:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516565 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.255536:0:8438:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e907c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144912.255539:0:8438:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516565 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.255546:0:8438:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516565 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.255561:0:8438:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516565 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.255568:0:8438:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e907c00/0x4076af6727516565 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144912.255626:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1982:x1830965175479552:12345-192.168.202.16@tcp:3:dd.0 Request processed in 14297us (14546us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144912.255634:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4557 00000100:00100000:0.0:1746144912.257930:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880132757100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7097:1830965172547456:192.168.202.16@tcp:105: 00010000:00010000:0.0:1746144912.257948:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144912.257991:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+11:1985:x1830965175479936:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 14243us (14361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144912.258001:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11300 00010000:00010000:1.0:1746144912.258232:0:31844:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880091a5ee00/0x4076af672751656c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.258242:0:31844:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a5ee00/0x4076af672751656c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.258248:0:31844:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a5ee00/0x4076af672751656c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.258253:0:31844:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a5ee00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144912.258257:0:31844:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5ee00/0x4076af672751656c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.258263:0:31844:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a5ee00/0x4076af672751656c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.258276:0:31844:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a5ee00/0x4076af672751656c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144912.258281:0:31844:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a5ee00/0x4076af672751656c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 31844 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746144912.258316:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4c7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1983:x1830965175479808:12345-192.168.202.16@tcp:3:dd.0 Request processed in 16758us (17195us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746144912.258322:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4558 00000100:00100000:2.0:1746144912.268482:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144912.268525:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144912.268602:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175480320 00000100:00100000:0.0:1746144912.268613:0:10401:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175480192 00000100:00100000:1.0:1746144912.268615:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175480320 00000100:00100000:0.0:1746144912.268622:0:10401:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175480192 00002000:00100000:1.0:1746144912.268652:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (0->1048575) req@ffff88009b058e00 x1830965175480320/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.268666:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b058e00 with x1830965175480320 ext(0->1048575) 00002000:00010000:1.0:1746144912.268670:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b058e00 00000100:00100000:2.0:1746144912.268684:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 5908 00000100:00100000:1.0:1746144912.268692:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4559 00000100:00100000:2.0:1746144912.268694:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+53:1147:x1830965175480192:12345-192.168.202.16@tcp:101:dd.0 00010000:00010000:2.0:1746144912.268707:0:8432:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746144912.268709:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b058e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1985:x1830965175480320:12345-192.168.202.16@tcp:4:dd.0 00010000:00010000:2.0:1746144912.268720:0:8432:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091750000/0x4076af6727516573 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9b32c3fc7af958b4 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144912.268742:0:8432:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bf23600/0x4076af6727516557 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958a6 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144912.268748:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144912.268750:0:8432:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144912.268752:0:8432:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091750000/0x4076af6727516573 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958b4 expref: 54 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144912.268816:0:8432:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bf23600/0x4076af6727516557 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958a6 expref: 8 pid: 8433 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746144912.268827:0:8432:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bf23600/0x4076af6727516557 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958a6 expref: 8 pid: 8433 timeout: 606 lvb_type: 1 00000100:00100000:2.0:1746144912.268837:0:8432:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172547584:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144912.268913:0:8432:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4691cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746144912.274190:0:8432:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b4ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8432:1830965172547584:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144912.274222:0:8432:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091750000/0x4076af6727516573 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958b4 expref: 54 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144912.274240:0:8432:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091750000, rc 0) 00000100:00100000:0.0:1746144912.274302:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b058a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+54:1147:x1830965175480192:12345-192.168.202.16@tcp:101:dd.0 Request processed in 5609us (5827us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144912.274311:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 5908 00000100:00100000:0.0:1746144912.281170:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144912.281242:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175480448 00000100:00100000:2.0:1746144912.281252:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175480448 00010000:00010000:2.0:1746144912.281293:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bf23600/0x4076af6727516557 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958a6 expref: 9 pid: 8433 timeout: 606 lvb_type: 1 00000100:00100000:2.0:1746144912.281331:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11301 00000100:00100000:2.0:1746144912.281338:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132757100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175480448:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746144912.281353:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746144912.281376:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bf23600/0x4076af6727516557 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958a6 expref: 9 pid: 8433 timeout: 606 lvb_type: 1 00010000:00010000:2.0:1746144912.281394:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bf23600/0x4076af6727516557 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958a6 expref: 9 pid: 8433 timeout: 606 lvb_type: 1 00010000:00010000:2.0:1746144912.281419:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bf23600/0x4076af6727516557 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958a6 expref: 9 pid: 8433 timeout: 606 lvb_type: 1 00010000:00010000:2.0:1746144912.281440:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144912.281442:0:7097:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746144912.281450:0:7097:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091750000/0x4076af6727516573 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958b4 expref: 53 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144912.281458:0:7097:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091750000/0x4076af6727516573 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958b4 expref: 53 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746144912.281491:0:7097:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091750000/0x4076af6727516573 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af958b4 expref: 53 pid: 8432 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144912.281503:0:7097:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4ec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172547712:192.168.202.16@tcp:105: 00000100:00100000:2.0:1746144912.281587:0:7097:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a4691600 going to sleep for 11 seconds 00000100:00100000:2.0:1746144912.292927:0:7097:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b4ec380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7097:1830965172547712:192.168.202.16@tcp:105: 00010000:00010000:2.0:1746144912.292941:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746144912.292987:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132757100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175480448:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 11650us (11826us total) trans 0 rc 0/0 00000100:00100000:2.0:1746144912.292994:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11301 00000100:00100000:0.0:1746144912.301092:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.301141:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175480704 00000100:00100000:0.0:1746144912.301150:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175480704 00002000:00100000:0.0:1746144912.301195:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1d:0x0] (0->1048575) req@ffff880132757480 x1830965175480704/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.301205:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132757480 with x1830965175480704 ext(0->1048575) 00002000:00010000:0.0:1746144912.301211:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132757480 00000100:00100000:0.0:1746144912.301239:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4560 00000100:00100000:0.0:1746144912.301246:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+54:1985:x1830965175480704:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144912.307963:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b058e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1985:x1830965175480320:12345-192.168.202.16@tcp:4:dd.0 Request processed in 39253us (39425us total) trans 4294968625 rc 0/0 00000100:00100000:1.0:1746144912.307976:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4559 00002000:00100000:1.0:1746144912.307988:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x1e:0x0] (0->1048575) req@ffff88009b058e00 x1830965175480320/t4294968625(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.307998:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b058e00 with x1830965175480320 ext(0->1048575) 00002000:00010000:1.0:1746144912.308004:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b058e00 00000100:00100000:0.0:1746144912.319384:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132757480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+56:1985:x1830965175480704:12345-192.168.202.16@tcp:4:dd.0 Request processed in 18126us (18291us total) trans 4294968096 rc 0/0 00000100:00100000:0.0:1746144912.319397:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4560 00002000:00100000:0.0:1746144912.319409:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1d:0x0] (0->1048575) req@ffff880132757480 x1830965175480704/t4294968096(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.319419:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132757480 with x1830965175480704 ext(0->1048575) 00002000:00010000:0.0:1746144912.319425:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132757480 00000100:00100000:2.0:1746144912.319568:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.319948:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175480960 00000100:00100000:0.0:1746144912.319956:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175480960 00002000:00100000:0.0:1746144912.319990:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (1048576->2097151) req@ffff88009b4ec380 x1830965175480960/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.319997:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4ec380 with x1830965175480960 ext(1048576->2097151) 00002000:00010000:0.0:1746144912.320000:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b4ec380 00000100:00100000:0.0:1746144912.321094:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4561 00000100:00100000:0.0:1746144912.321104:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+12:1984:x1830965175480960:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144912.330311:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144912.330697:0:8438:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175481216 00000100:00100000:1.0:1746144912.330708:0:8438:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175481216 00002000:00100000:1.0:1746144912.330757:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1d:0x0] (1048576->2097151) req@ffff88012cf2ea00 x1830965175481216/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.330803:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2ea00 with x1830965175481216 ext(1048576->2097151) 00002000:00010000:1.0:1746144912.330809:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2ea00 00000100:00100000:1.0:1746144912.330832:0:8438:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4562 00000100:00100000:1.0:1746144912.330840:0:8438:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+56:1984:x1830965175481216:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144912.331339:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.331602:0:7114:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175481472 00000100:00100000:0.0:1746144912.331607:0:7114:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175481472 00000100:00100000:0.0:1746144912.331645:0:7114:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 180 00000100:00100000:0.0:1746144912.331651:0:7114:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+38:1146:x1830965175481472:12345-192.168.202.16@tcp:35:dd.0 00000100:00100000:0.0:1746144912.331863:0:7114:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132757800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1146:x1830965175481472:12345-192.168.202.16@tcp:35:dd.0 Request processed in 211us (523us total) trans 4294987559 rc 0/0 00000100:00100000:0.0:1746144912.331870:0:7114:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 180 00000100:00100000:0.0:1746144912.340417:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1984:x1830965175480960:12345-192.168.202.16@tcp:4:dd.0 Request processed in 19305us (20838us total) trans 4294968626 rc 0/0 00000100:00100000:0.0:1746144912.340431:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4561 00002000:00100000:0.0:1746144912.340442:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (1048576->2097151) req@ffff88009b4ec380 x1830965175480960/t4294968626(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.340459:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4ec380 with x1830965175480960 ext(1048576->2097151) 00002000:00010000:0.0:1746144912.340466:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b4ec380 00000100:00100000:2.0:1746144912.347146:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.347283:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175481728 00000100:00100000:0.0:1746144912.347293:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175481728 00002000:00100000:0.0:1746144912.347340:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (2097152->3145727) req@ffff88009b4ec700 x1830965175481728/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.347351:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4ec700 with x1830965175481728 ext(2097152->3145727) 00002000:00010000:0.0:1746144912.347356:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b4ec700 00000100:00100000:0.0:1746144912.347924:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4563 00000100:00100000:0.0:1746144912.347933:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+14:1985:x1830965175481728:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144912.348947:0:8438:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+58:1984:x1830965175481216:12345-192.168.202.16@tcp:4:dd.0 Request processed in 18105us (18644us total) trans 4294968097 rc 0/0 00000100:00100000:1.0:1746144912.348956:0:8438:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4562 00002000:00100000:1.0:1746144912.348964:0:8438:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1d:0x0] (1048576->2097151) req@ffff88012cf2ea00 x1830965175481216/t4294968097(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.348973:0:8438:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2ea00 with x1830965175481216 ext(1048576->2097151) 00002000:00010000:1.0:1746144912.348978:0:8438:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2ea00 00000100:00100000:0.0:1746144912.354297:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144912.354672:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175481984 00000100:00100000:2.0:1746144912.354681:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175481984 00002000:00100000:2.0:1746144912.354727:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1d:0x0] (2097152->3145727) req@ffff880132757b80 x1830965175481984/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144912.354738:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132757b80 with x1830965175481984 ext(2097152->3145727) 00002000:00010000:2.0:1746144912.354743:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132757b80 00000100:00100000:2.0:1746144912.354795:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4564 00000100:00100000:2.0:1746144912.354803:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+58:1984:x1830965175481984:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144912.361544:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1985:x1830965175481728:12345-192.168.202.16@tcp:4:dd.0 Request processed in 13597us (14393us total) trans 4294968627 rc 0/0 00000100:00100000:0.0:1746144912.361557:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4563 00002000:00100000:0.0:1746144912.361569:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (2097152->3145727) req@ffff88009b4ec700 x1830965175481728/t4294968627(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.361578:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4ec700 with x1830965175481728 ext(2097152->3145727) 00002000:00010000:0.0:1746144912.361585:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b4ec700 00000100:00100000:0.0:1746144912.369490:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144912.371424:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132757b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+60:1984:x1830965175481984:12345-192.168.202.16@tcp:4:dd.0 Request processed in 16614us (17130us total) trans 4294968098 rc 0/0 00000100:00100000:3.0:1746144912.371437:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4564 00002000:00100000:3.0:1746144912.371450:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1d:0x0] (2097152->3145727) req@ffff880132757b80 x1830965175481984/t4294968098(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144912.371460:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132757b80 with x1830965175481984 ext(2097152->3145727) 00002000:00010000:3.0:1746144912.371467:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132757b80 00000100:00100000:1.0:1746144912.372507:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175482240 00000100:00100000:1.0:1746144912.372517:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175482240 00002000:00100000:1.0:1746144912.372558:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (3145728->4194303) req@ffff880132755180 x1830965175482240/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.372566:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132755180 with x1830965175482240 ext(3145728->4194303) 00002000:00010000:1.0:1746144912.372570:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132755180 00000100:00100000:1.0:1746144912.372602:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4565 00000100:00100000:1.0:1746144912.372609:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+16:1984:x1830965175482240:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144912.383403:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.383442:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144912.383479:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175482752 00000100:00100000:3.0:1746144912.383492:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175482752 00002000:00100000:3.0:1746144912.383539:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1e:0x0] (4194304->5242879) req@ffff880132756300 x1830965175482752/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144912.383549:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132756300 with x1830965175482752 ext(4194304->5242879) 00002000:00010000:3.0:1746144912.383555:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132756300 00000100:00100000:3.0:1746144912.383588:0:8437:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175482496 00000100:00100000:3.0:1746144912.383590:0:8437:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175482496 00002000:00100000:3.0:1746144912.383601:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1d:0x0] (3145728->4194303) req@ffff880132755500 x1830965175482496/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144912.383608:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132755500 with x1830965175482496 ext(3145728->4194303) 00002000:00010000:3.0:1746144912.383610:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132755500 00000100:00100000:3.0:1746144912.383630:0:8437:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4566 00000100:00100000:3.0:1746144912.383637:0:8437:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+18:1985:x1830965175482752:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144912.383865:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4567 00000100:00100000:3.0:1746144912.383870:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880132755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+60:1984:x1830965175482496:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144912.395935:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132755180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1984:x1830965175482240:12345-192.168.202.16@tcp:4:dd.0 Request processed in 23312us (26442us total) trans 4294968628 rc 0/0 00000100:00100000:1.0:1746144912.395947:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4565 00002000:00100000:1.0:1746144912.395959:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (3145728->4194303) req@ffff880132755180 x1830965175482240/t4294968628(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.395969:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132755180 with x1830965175482240 ext(3145728->4194303) 00002000:00010000:1.0:1746144912.395976:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132755180 00000100:00100000:2.0:1746144912.401311:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144912.401412:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175483008 00000100:00100000:1.0:1746144912.401422:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175483008 00002000:00100000:1.0:1746144912.401467:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1d:0x0] (4194304->5242879) req@ffff88009b4eca80 x1830965175483008/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.401478:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4eca80 with x1830965175483008 ext(4194304->5242879) 00002000:00010000:1.0:1746144912.401484:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4eca80 00000100:00100000:1.0:1746144912.401507:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4568 00000100:00100000:1.0:1746144912.401515:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+62:1985:x1830965175483008:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144912.403443:0:8437:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132756300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1985:x1830965175482752:12345-192.168.202.16@tcp:4:dd.0 Request processed in 19796us (20036us total) trans 4294968629 rc 0/0 00000100:00100000:0.0:1746144912.403456:0:8437:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4566 00002000:00100000:0.0:1746144912.403467:0:8437:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1e:0x0] (4194304->5242879) req@ffff880132756300 x1830965175482752/t4294968629(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.403476:0:8437:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132756300 with x1830965175482752 ext(4194304->5242879) 00002000:00010000:0.0:1746144912.403482:0:8437:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880132756300 00000100:00100000:3.0:1746144912.406660:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880132755500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+64:1984:x1830965175482496:12345-192.168.202.16@tcp:4:dd.0 Request processed in 22777us (23206us total) trans 4294968099 rc 0/0 00000100:00100000:3.0:1746144912.406671:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4567 00002000:00100000:3.0:1746144912.406683:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1d:0x0] (3145728->4194303) req@ffff880132755500 x1830965175482496/t4294968099(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144912.406691:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880132755500 with x1830965175482496 ext(3145728->4194303) 00002000:00010000:3.0:1746144912.406697:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880132755500 00000100:00100000:2.0:1746144912.410889:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144912.410989:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175483264 00000100:00100000:3.0:1746144912.411001:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175483264 00002000:00100000:3.0:1746144912.411050:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1e:0x0] (5242880->6291455) req@ffff88009b4ece00 x1830965175483264/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144912.411060:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4ece00 with x1830965175483264 ext(5242880->6291455) 00002000:00010000:3.0:1746144912.411066:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b4ece00 00000100:00100000:3.0:1746144912.411402:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4569 00000100:00100000:3.0:1746144912.411411:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+20:1985:x1830965175483264:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144912.419834:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+64:1985:x1830965175483008:12345-192.168.202.16@tcp:4:dd.0 Request processed in 18308us (18523us total) trans 4294968100 rc 0/0 00000100:00100000:1.0:1746144912.419847:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4568 00002000:00100000:1.0:1746144912.419858:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1d:0x0] (4194304->5242879) req@ffff88009b4eca80 x1830965175483008/t4294968100(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.419867:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4eca80 with x1830965175483008 ext(4194304->5242879) 00002000:00010000:1.0:1746144912.419874:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4eca80 00000100:00100000:3.0:1746144912.419978:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144912.420096:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175483520 00000100:00100000:1.0:1746144912.420103:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175483520 00002000:00100000:1.0:1746144912.420128:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1d:0x0] (5242880->6291455) req@ffff88012cf2d180 x1830965175483520/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.420134:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2d180 with x1830965175483520 ext(5242880->6291455) 00002000:00010000:1.0:1746144912.420137:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2d180 00000100:00100000:1.0:1746144912.420729:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4570 00000100:00100000:1.0:1746144912.420736:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+64:1985:x1830965175483520:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144912.424755:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+22:1985:x1830965175483264:12345-192.168.202.16@tcp:4:dd.0 Request processed in 13337us (13868us total) trans 4294968630 rc 0/0 00000100:00100000:0.0:1746144912.424811:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4569 00002000:00100000:0.0:1746144912.424821:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1e:0x0] (5242880->6291455) req@ffff88009b4ece00 x1830965175483264/t4294968630(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.424829:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4ece00 with x1830965175483264 ext(5242880->6291455) 00002000:00010000:0.0:1746144912.424834:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b4ece00 00000100:00100000:3.0:1746144912.433555:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.433629:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175483776 00000100:00100000:0.0:1746144912.433635:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175483776 00002000:00100000:0.0:1746144912.433665:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1e:0x0] (6291456->7340031) req@ffff88012cf2f100 x1830965175483776/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.433673:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2f100 with x1830965175483776 ext(6291456->7340031) 00002000:00010000:0.0:1746144912.433678:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cf2f100 00000100:00100000:0.0:1746144912.433692:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4571 00000100:00100000:0.0:1746144912.433697:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012cf2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+22:1984:x1830965175483776:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144912.437075:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+66:1985:x1830965175483520:12345-192.168.202.16@tcp:4:dd.0 Request processed in 16330us (17088us total) trans 4294968101 rc 0/0 00000100:00100000:1.0:1746144912.437084:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4570 00002000:00100000:1.0:1746144912.437094:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1d:0x0] (5242880->6291455) req@ffff88012cf2d180 x1830965175483520/t4294968101(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.437101:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2d180 with x1830965175483520 ext(5242880->6291455) 00002000:00010000:1.0:1746144912.437106:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012cf2d180 00000100:00100000:0.0:1746144912.442434:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144912.443140:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012cf2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+24:1984:x1830965175483776:12345-192.168.202.16@tcp:4:dd.0 Request processed in 9439us (9588us total) trans 4294968631 rc 0/0 00000100:00100000:2.0:1746144912.443149:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4571 00002000:00100000:2.0:1746144912.443159:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1e:0x0] (6291456->7340031) req@ffff88012cf2f100 x1830965175483776/t4294968631(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144912.443168:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012cf2f100 with x1830965175483776 ext(6291456->7340031) 00002000:00010000:2.0:1746144912.443173:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012cf2f100 00000100:00100000:2.0:1746144912.443716:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175484032 00000100:00100000:2.0:1746144912.443722:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175484032 00002000:00100000:2.0:1746144912.443746:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1d:0x0] (6291456->7340031) req@ffff8800877f0000 x1830965175484032/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144912.443757:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877f0000 with x1830965175484032 ext(6291456->7340031) 00002000:00010000:2.0:1746144912.443760:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877f0000 00000100:00100000:2.0:1746144912.443805:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4572 00000100:00100000:2.0:1746144912.443812:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+66:1984:x1830965175484032:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144912.454960:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144912.455029:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175484288 00000100:00100000:1.0:1746144912.455038:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175484288 00002000:00100000:1.0:1746144912.455072:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (7340032->8388607) req@ffff88013572c000 x1830965175484288/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.455080:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013572c000 with x1830965175484288 ext(7340032->8388607) 00002000:00010000:1.0:1746144912.455085:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013572c000 00000100:00100000:1.0:1746144912.455102:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4573 00000100:00100000:1.0:1746144912.455108:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013572c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+24:1984:x1830965175484288:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144912.461227:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+68:1984:x1830965175484032:12345-192.168.202.16@tcp:4:dd.0 Request processed in 17407us (18792us total) trans 4294968102 rc 0/0 00000100:00100000:2.0:1746144912.461237:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4572 00002000:00100000:2.0:1746144912.461246:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1d:0x0] (6291456->7340031) req@ffff8800877f0000 x1830965175484032/t4294968102(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144912.461254:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877f0000 with x1830965175484032 ext(6291456->7340031) 00002000:00010000:2.0:1746144912.461259:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877f0000 00000100:00100000:0.0:1746144912.461413:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144912.461464:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175484544 00000100:00100000:3.0:1746144912.461471:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175484544 00002000:00100000:3.0:1746144912.461494:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1d:0x0] (7340032->8388607) req@ffff8800877f0380 x1830965175484544/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144912.461501:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877f0380 with x1830965175484544 ext(7340032->8388607) 00002000:00010000:3.0:1746144912.461503:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877f0380 00000100:00100000:3.0:1746144912.461516:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4574 00000100:00100000:3.0:1746144912.461522:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+68:1984:x1830965175484544:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144912.466477:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013572c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1984:x1830965175484288:12345-192.168.202.16@tcp:4:dd.0 Request processed in 11361us (11516us total) trans 4294968632 rc 0/0 00000100:00100000:1.0:1746144912.466487:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4573 00002000:00100000:1.0:1746144912.466497:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (7340032->8388607) req@ffff88013572c000 x1830965175484288/t4294968632(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:1.0:1746144912.466505:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013572c000 with x1830965175484288 ext(7340032->8388607) 00002000:00010000:1.0:1746144912.466510:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013572c000 00000100:00100000:3.0:1746144912.473252:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+70:1984:x1830965175484544:12345-192.168.202.16@tcp:4:dd.0 Request processed in 11722us (11831us total) trans 4294968103 rc 0/0 00000100:00100000:3.0:1746144912.473262:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4574 00002000:00100000:3.0:1746144912.473270:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1d:0x0] (7340032->8388607) req@ffff8800877f0380 x1830965175484544/t4294968103(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144912.473277:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800877f0380 with x1830965175484544 ext(7340032->8388607) 00002000:00010000:3.0:1746144912.473282:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800877f0380 00000100:00100000:2.0:1746144912.473715:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144912.473828:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175484800 00000100:00100000:3.0:1746144912.473833:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175484800 00002000:00100000:3.0:1746144912.473857:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1e:0x0] (8388608->9437183) req@ffff88009b4ed180 x1830965175484800/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144912.473864:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4ed180 with x1830965175484800 ext(8388608->9437183) 00002000:00010000:3.0:1746144912.473867:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b4ed180 00000100:00100000:3.0:1746144912.474041:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4575 00000100:00100000:3.0:1746144912.474047:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+26:1984:x1830965175484800:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144912.483918:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.484215:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175485056 00000100:00100000:0.0:1746144912.484223:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175485056 00002000:00100000:0.0:1746144912.484257:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1d:0x0] (8388608->9437183) req@ffff88009b4ed500 x1830965175485056/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.484266:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4ed500 with x1830965175485056 ext(8388608->9437183) 00002000:00010000:0.0:1746144912.484270:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4ed500 00000100:00100000:0.0:1746144912.484298:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4576 00000100:00100000:0.0:1746144912.484305:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+70:1984:x1830965175485056:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144912.489702:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+28:1984:x1830965175484800:12345-192.168.202.16@tcp:4:dd.0 Request processed in 15645us (15978us total) trans 4294968633 rc 0/0 00000100:00100000:3.0:1746144912.489712:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4575 00002000:00100000:3.0:1746144912.489722:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x1e:0x0] (8388608->9437183) req@ffff88009b4ed180 x1830965175484800/t4294968633(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144912.489729:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4ed180 with x1830965175484800 ext(8388608->9437183) 00002000:00010000:3.0:1746144912.489734:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b4ed180 00000100:00100000:0.0:1746144912.490658:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+72:1984:x1830965175485056:12345-192.168.202.16@tcp:4:dd.0 Request processed in 6350us (6746us total) trans 4294968104 rc 0/0 00000100:00100000:0.0:1746144912.490666:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4576 00002000:00100000:0.0:1746144912.490672:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1d:0x0] (8388608->9437183) req@ffff88009b4ed500 x1830965175485056/t4294968104(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.490680:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4ed500 with x1830965175485056 ext(8388608->9437183) 00002000:00010000:0.0:1746144912.490683:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4ed500 00000100:00100000:1.0:1746144912.498629:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.498698:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175485312 00000100:00100000:0.0:1746144912.498706:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175485312 00002000:00100000:0.0:1746144912.498742:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (9437184->10485759) req@ffff8800a4f0bb80 x1830965175485312/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.498751:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f0bb80 with x1830965175485312 ext(9437184->10485759) 00002000:00010000:0.0:1746144912.498755:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4f0bb80 00000100:00100000:0.0:1746144912.498822:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4577 00000100:00100000:0.0:1746144912.498830:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+28:1984:x1830965175485312:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144912.504188:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4f0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+30:1984:x1830965175485312:12345-192.168.202.16@tcp:4:dd.0 Request processed in 5351us (5557us total) trans 4294968634 rc 0/0 00000100:00100000:0.0:1746144912.504200:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4577 00002000:00100000:0.0:1746144912.504209:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (9437184->10485759) req@ffff8800a4f0bb80 x1830965175485312/t4294968634(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.504217:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4f0bb80 with x1830965175485312 ext(9437184->10485759) 00002000:00010000:0.0:1746144912.504222:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4f0bb80 00000100:00100000:1.0:1746144912.517242:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.517315:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175485568 00000100:00100000:0.0:1746144912.517323:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175485568 00002000:00100000:0.0:1746144912.517358:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1d:0x0] (9437184->10485759) req@ffff8800925a8a80 x1830965175485568/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.517368:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a8a80 with x1830965175485568 ext(9437184->10485759) 00002000:00010000:0.0:1746144912.517373:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925a8a80 00000100:00100000:0.0:1746144912.517398:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4578 00000100:00100000:0.0:1746144912.517404:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800925a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+72:1985:x1830965175485568:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144912.529423:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800925a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+74:1985:x1830965175485568:12345-192.168.202.16@tcp:4:dd.0 Request processed in 12010us (12178us total) trans 4294968105 rc 0/0 00000100:00100000:0.0:1746144912.529433:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4578 00002000:00100000:0.0:1746144912.529446:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x240000400:0x1d:0x0] (9437184->10485759) req@ffff8800925a8a80 x1830965175485568/t4294968105(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.529454:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800925a8a80 with x1830965175485568 ext(9437184->10485759) 00002000:00010000:0.0:1746144912.529459:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800925a8a80 00000100:00100000:2.0:1746144912.537360:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.537440:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175485824 00000100:00100000:0.0:1746144912.537448:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175485824 00002000:00100000:0.0:1746144912.537485:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (10485760->11534335) req@ffff88009b4ed880 x1830965175485824/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.537498:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4ed880 with x1830965175485824 ext(10485760->11534335) 00002000:00010000:0.0:1746144912.537503:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b4ed880 00000100:00100000:0.0:1746144912.537531:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4579 00000100:00100000:0.0:1746144912.537538:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+30:1984:x1830965175485824:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:1.0:1746144912.544894:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144912.545869:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175486080 00000100:00100000:3.0:1746144912.545878:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175486080 00002000:00100000:3.0:1746144912.545913:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1d:0x0] (10485760->11534335) req@ffff88009ad5f480 x1830965175486080/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144912.545921:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5f480 with x1830965175486080 ext(10485760->11534335) 00002000:00010000:3.0:1746144912.545925:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5f480 00000100:00100000:3.0:1746144912.545952:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4580 00000100:00100000:3.0:1746144912.545958:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ad5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+74:1984:x1830965175486080:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144912.547744:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+32:1984:x1830965175485824:12345-192.168.202.16@tcp:4:dd.0 Request processed in 10200us (10385us total) trans 4294968635 rc 0/0 00000100:00100000:0.0:1746144912.547752:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4579 00002000:00100000:0.0:1746144912.547760:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (10485760->11534335) req@ffff88009b4ed880 x1830965175485824/t4294968635(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.547791:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4ed880 with x1830965175485824 ext(10485760->11534335) 00002000:00010000:0.0:1746144912.547796:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009b4ed880 00000100:00100000:1.0:1746144912.559419:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.559569:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175486336 00000100:00100000:0.0:1746144912.559577:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175486336 00002000:00100000:0.0:1746144912.559610:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (11534336->12582911) req@ffff88012d366300 x1830965175486336/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.559619:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d366300 with x1830965175486336 ext(11534336->12582911) 00002000:00010000:0.0:1746144912.559623:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d366300 00000100:00100000:0.0:1746144912.559645:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4581 00000100:00100000:0.0:1746144912.559650:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+32:1984:x1830965175486336:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:2.0:1746144912.562276:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ad5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+76:1984:x1830965175486080:12345-192.168.202.16@tcp:4:dd.0 Request processed in 16312us (17384us total) trans 4294968106 rc 0/0 00000100:00100000:2.0:1746144912.562292:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4580 00002000:00100000:2.0:1746144912.562301:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1d:0x0] (10485760->11534335) req@ffff88009ad5f480 x1830965175486080/t4294968106(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144912.562309:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ad5f480 with x1830965175486080 ext(10485760->11534335) 00002000:00010000:2.0:1746144912.562314:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ad5f480 00000100:00100000:2.0:1746144912.568420:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.570034:0:31840:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175486592 00000100:00100000:0.0:1746144912.570044:0:31840:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175486592 00002000:00100000:3.0:1746144912.576102:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1d:0x0] (11534336->12582911) req@ffff88009b4edc00 x1830965175486592/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144912.576112:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4edc00 with x1830965175486592 ext(11534336->12582911) 00002000:00010000:3.0:1746144912.576117:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4edc00 00000100:00100000:3.0:1746144912.578248:0:31840:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4582 00000100:00100000:3.0:1746144912.578261:0:31840:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+76:1984:x1830965175486592:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:0.0:1746144912.579978:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144912.580031:0:19321:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175486976 00000100:00100000:2.0:1746144912.580039:0:19321:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175486976 00000100:00100000:2.0:1746144912.580079:0:19321:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 181 00000100:00100000:2.0:1746144912.580084:0:19321:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+30:1147:x1830965175486976:12345-192.168.202.16@tcp:35:dd.0 00000001:00080000:2.0:1746144912.580258:0:19321:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 4294987560 00000100:00100000:2.0:1746144912.580330:0:19321:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+32:1147:x1830965175486976:12345-192.168.202.16@tcp:35:dd.0 Request processed in 246us (358us total) trans 4294987561 rc 0/0 00000100:00100000:2.0:1746144912.580336:0:19321:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 181 00000020:00080000:2.0:1746144912.580340:0:19321:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1746144912.580667:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+34:1984:x1830965175486336:12345-192.168.202.16@tcp:4:dd.0 Request processed in 21015us (21252us total) trans 4294968636 rc 0/0 00000100:00100000:0.0:1746144912.580675:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4581 00002000:00100000:0.0:1746144912.580683:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (11534336->12582911) req@ffff88012d366300 x1830965175486336/t4294968636(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.580691:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012d366300 with x1830965175486336 ext(11534336->12582911) 00002000:00010000:0.0:1746144912.580696:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012d366300 00000100:00100000:3.0:1746144912.584843:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.585262:0:31844:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175487104 00000100:00100000:0.0:1746144912.585272:0:31844:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175487104 00002000:00100000:0.0:1746144912.585306:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (12582912->13631487) req@ffff88013572c380 x1830965175487104/t0(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/0 e 0 to 0 dl 1746144923 ref 1 fl New:/200/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 00002000:00100000:0.0:1746144912.585315:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013572c380 with x1830965175487104 ext(12582912->13631487) 00002000:00010000:0.0:1746144912.585320:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013572c380 00000100:00100000:0.0:1746144912.585349:0:31844:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 4583 00000100:00100000:0.0:1746144912.585356:0:31844:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013572c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+34:1985:x1830965175487104:12345-192.168.202.16@tcp:4:dd.0 00000100:00100000:3.0:1746144912.592934:0:31840:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:7454cbaf-97e3-4716-92c6-77cd48a94a90+78:1984:x1830965175486592:12345-192.168.202.16@tcp:4:dd.0 Request processed in 14669us (24512us total) trans 4294968107 rc 0/0 00000100:00100000:3.0:1746144912.592944:0:31840:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4582 00002000:00100000:3.0:1746144912.592955:0:31840:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x240000400:0x1d:0x0] (11534336->12582911) req@ffff88009b4edc00 x1830965175486592/t4294968107(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:3.0:1746144912.592968:0:31840:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009b4edc00 with x1830965175486592 ext(11534336->12582911) 00002000:00010000:3.0:1746144912.592973:0:31840:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009b4edc00 00000100:00100000:2.0:1746144912.620153:0:31844:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013572c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:7454cbaf-97e3-4716-92c6-77cd48a94a90+36:1985:x1830965175487104:12345-192.168.202.16@tcp:4:dd.0 Request processed in 34790us (35311us total) trans 4294968637 rc 0/0 00000100:00100000:2.0:1746144912.620164:0:31844:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 4583 00002000:00100000:2.0:1746144912.620173:0:31844:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x280000400:0x1e:0x0] (12582912->13631487) req@ffff88013572c380 x1830965175487104/t4294968637(0) o4->7454cbaf-97e3-4716-92c6-77cd48a94a90@192.168.202.16@tcp:553/0 lens 488/448 e 0 to 0 dl 1746144923 ref 1 fl Complete:/200/0 rc 0/0 job:'dd.0' uid:0 gid:0 00002000:00100000:2.0:1746144912.620180:0:31844:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013572c380 with x1830965175487104 ext(12582912->13631487) 00002000:00010000:2.0:1746144912.620184:0:31844:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013572c380 00010000:00010000:1.0:1746144912.643968:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746144912.893352:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144912.893391:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144912.893419:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144912.893433:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144912.893436:0:7107:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175487232 00000100:00100000:3.0:1746144912.893445:0:7107:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175487232 00000100:00100000:0.0:1746144912.893550:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175487488 00000100:00100000:0.0:1746144912.893554:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175487488 00000100:00100000:0.0:1746144912.893577:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175488000 00000100:00100000:0.0:1746144912.893578:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175488000 00000100:00100000:0.0:1746144912.893596:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 404 00000100:00100000:0.0:1746144912.893602:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012d364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175487488:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144912.893652:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012d364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175487488:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 51us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144912.893657:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 404 00000100:00100000:0.0:1746144912.893669:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 405 00000100:00100000:0.0:1746144912.893673:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+36:1985:x1830965175488000:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144912.893687:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+36:1985:x1830965175488000:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 14us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144912.893691:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 405 00000100:00100000:0.0:1746144912.893701:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175487744 00000100:00100000:0.0:1746144912.893703:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175487744 00000100:00100000:0.0:1746144912.893717:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 335 00000100:00100000:0.0:1746144912.893720:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+32:1985:x1830965175487744:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144912.893737:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135ea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7454cbaf-97e3-4716-92c6-77cd48a94a90+32:1985:x1830965175487744:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 16us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144912.893741:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 335 00000100:00100000:0.0:1746144912.893759:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.893800:0:7111:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175487360 00000100:00100000:0.0:1746144912.893802:0:7111:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175487360 00000100:00100000:0.0:1746144912.893814:0:7111:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 336 00000100:00100000:0.0:1746144912.893818:0:7111:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1985:x1830965175487360:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144912.893835:0:7111:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+39:1985:x1830965175487360:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 17us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144912.893839:0:7111:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 336 00000100:00100000:0.0:1746144912.893875:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144912.893884:0:8432:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175487616 00000100:00100000:0.0:1746144912.893886:0:8432:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175487616 00000100:00100000:3.0:1746144912.893898:0:7107:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 379 00000100:00100000:0.0:1746144912.893898:0:8432:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 406 00000100:00100000:0.0:1746144912.893902:0:8432:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175487616:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1746144912.893903:0:7107:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4574b85-29c1-4863-b96a-3fe350afea52+12:1985:x1830965175487232:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:0.0:1746144912.893920:0:8432:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1985:x1830965175487616:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 18us (44us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144912.893921:0:7107:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4b6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a4574b85-29c1-4863-b96a-3fe350afea52+12:1985:x1830965175487232:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 18us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144912.893926:0:7107:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 379 00000100:00100000:0.0:1746144912.893927:0:8432:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 406 00000100:00100000:0.0:1746144912.893961:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144912.893975:0:8433:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175487872 00000100:00100000:3.0:1746144912.893978:0:8433:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175487872 00000100:00100000:3.0:1746144912.893991:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 407 00000100:00100000:3.0:1746144912.893995:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+78:1985:x1830965175487872:12345-192.168.202.16@tcp:400:kworker.0 00000100:00100000:3.0:1746144912.894014:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7454cbaf-97e3-4716-92c6-77cd48a94a90+78:1985:x1830965175487872:12345-192.168.202.16@tcp:400:kworker.0 Request processed in 18us (52us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144912.894018:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 407 00000001:00080000:2.0:1746144913.053531:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294968105 is committed 00000001:00080000:2.0:1746144913.053594:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294968106 is committed 00000001:00080000:2.0:1746144913.053615:0:8514:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 4294968107 is committed 00000001:02000400:3.0:1746144913.412153:0:5085:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanityn test_16j: @@@@@@ FAIL: dio copy 1 w/bsize 1049600 failed: 1 00000001:00080000:3.0:1746144913.495405:0:7157:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294987559 is committed 00000001:00080000:3.0:1746144913.495415:0:7157:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294987556 is committed 00000004:00080000:3.0:1746144913.495421:0:7157:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 17 committed 00000004:00080000:3.0:1746144913.495982:0:7157:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 17 committed 00000004:00080000:3.0:1746144913.495999:0:7157:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 16 committed 00000001:00080000:3.0:1746144913.496008:0:7157:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294987557 is committed 00000004:00080000:3.0:1746144913.496014:0:7157:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 18 committed 00000001:00080000:3.0:1746144913.496040:0:7157:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 4294987561 is committed 00000100:00100000:3.0:1746144913.496679:0:3309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172547968:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1746144913.496737:0:3309:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144913.496801:0:3309:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746144913.496807:0:3309:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800877f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172547840:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1746144913.496826:0:3309:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746144913.496850:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172547968 00000100:00100000:3.0:1746144913.496856:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172547968 00000100:00100000:3.0:1746144913.496886:0:8430:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172547840 00000100:00100000:3.0:1746144913.496888:0:8430:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172547840 00000100:00100000:3.0:1746144913.496901:0:8430:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5909 00000100:00100000:3.0:1746144913.496907:0:8430:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013572c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1830965172547968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1746144913.496925:0:8430:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:27 count 1 00010000:00010000:3.0:1746144913.496945:0:8430:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800943c1c00/0x4076af672751657a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.496961:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012d327c00/0x4076af672751605d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955e3 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.496969:0:8430:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009422ae00/0x4076af6727516095 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ff expref: 35 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144913.496976:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144913.496977:0:8430:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144913.496980:0:8430:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800943c1c00/0x4076af672751657a lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.497000:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009422ae00/0x4076af6727516095 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ff expref: 35 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144913.497014:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009422ae00/0x4076af6727516095 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ff expref: 35 pid: 8430 timeout: 607 lvb_type: 1 00000100:00100000:3.0:1746144913.497024:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013572ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172548096:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144913.497070:0:8430:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012d327c00/0x4076af672751605d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955e3 expref: 8 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.497078:0:8430:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012d327c00/0x4076af672751605d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955e3 expref: 8 pid: 8430 timeout: 607 lvb_type: 0 00000100:00100000:3.0:1746144913.497085:0:8430:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013572d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172548224:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144913.497101:0:8430:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4139300 going to sleep for 11 seconds 00000100:00100000:3.0:1746144913.497114:0:8433:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5910 00000100:00100000:3.0:1746144913.497119:0:8433:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013572ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1830965172547840:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1746144913.497130:0:8433:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:27 count 1 00010000:00010000:3.0:1746144913.497142:0:8433:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800916fbe00/0x4076af6727516581 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.497152:0:8433:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727516064 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ea expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.497158:0:8433:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af672751609c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95606 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144913.497165:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144913.497166:0:8433:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746144913.497168:0:8433:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800916fbe00/0x4076af6727516581 lrc: 5/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.497180:0:8433:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af672751609c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95606 expref: 9 pid: 8430 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746144913.497186:0:8433:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af672751609c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95606 expref: 9 pid: 8430 timeout: 607 lvb_type: 1 00000100:00100000:3.0:1746144913.497194:0:8433:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013572d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1830965172548352:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144913.497218:0:8433:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727516064 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ea expref: 7 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.497224:0:8433:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727516064 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ea expref: 7 pid: 8430 timeout: 607 lvb_type: 0 00000100:00100000:3.0:1746144913.497231:0:8433:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013572d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1830965172548480:192.168.202.16@tcp:104: 00000100:00100000:3.0:1746144913.497256:0:8433:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b4139780 going to sleep for 11 seconds 00000100:00080000:2.0:1746144913.498581:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746144913.498594:0:3306:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009b4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965172548608:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1746144913.498653:0:3306:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746144913.498681:0:20722:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965172548608 00000100:00100000:0.0:1746144913.498686:0:20722:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965172548608 00000100:00100000:0.0:1746144913.498708:0:20722:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5911 00000100:00100000:0.0:1746144913.498719:0:20722:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3306:x1830965172548608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1746144913.498735:0:20722:0:(ofd_dev.c:1750:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:29 count 1 00010000:00010000:0.0:1746144913.498750:0:20722:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a60000/0x4076af6727516588 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.498786:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b466200/0x4076af67275163cf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9575d expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.498794:0:20722:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516431 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af957e9 expref: 35 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144913.498800:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144913.498801:0:20722:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144913.498803:0:20722:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a60000/0x4076af6727516588 lrc: 5/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.498821:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af957e9 expref: 35 pid: 10401 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746144913.498830:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516431 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af957e9 expref: 35 pid: 10401 timeout: 607 lvb_type: 1 00000100:00100000:0.0:1746144913.498840:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800877f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965172548736:192.168.202.16@tcp:104: 00010000:00010000:0.0:1746144913.498889:0:20722:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009b466200/0x4076af67275163cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9575d expref: 8 pid: 8432 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.498897:0:20722:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009b466200/0x4076af67275163cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9575d expref: 8 pid: 8432 timeout: 607 lvb_type: 0 00000100:00100000:0.0:1746144913.498904:0:20722:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800877f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965172548864:192.168.202.16@tcp:104: 00000100:00100000:0.0:1746144913.498920:0:20722:0:(client.c:2553:ptlrpc_set_wait()) set ffff880135add840 going to sleep for 11 seconds 00000100:00100000:2.0:1746144913.504301:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013572ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172548096:192.168.202.16@tcp:104: 00000100:00100000:2.0:1746144913.504313:0:8430:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013572d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8430:1830965172548224:192.168.202.16@tcp:104: 00010000:00010000:2.0:1746144913.504333:0:8430:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800943c1c00/0x4076af672751657a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746144913.505279:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144913.505423:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175488128 00000100:00100000:3.0:1746144913.505429:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175488128 00010000:00010000:3.0:1746144913.505460:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012d327c00/0x4076af672751605d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955e3 expref: 9 pid: 8430 timeout: 607 lvb_type: 0 00000100:00100000:3.0:1746144913.505495:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11302 00000100:00100000:3.0:1746144913.505502:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+9:1984:x1830965175488128:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144913.505514:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144913.505518:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012d327c00/0x4076af672751605d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955e3 expref: 9 pid: 8430 timeout: 607 lvb_type: 0 00010000:00010000:3.0:1746144913.505527:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012d327c00/0x4076af672751605d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955e3 expref: 9 pid: 8430 timeout: 607 lvb_type: 0 00010000:00010000:3.0:1746144913.505546:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012d327c00/0x4076af672751605d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955e3 expref: 9 pid: 8430 timeout: 607 lvb_type: 0 00010000:00010000:3.0:1746144913.505559:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144913.505601:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1984:x1830965175488128:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 99us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144913.505607:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11302 00000100:00100000:3.0:1746144913.506609:0:8433:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013572d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1830965172548480:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144913.506698:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800877f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965172548736:192.168.202.16@tcp:104: 00000100:00100000:1.0:1746144913.506710:0:20722:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800877f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20722:1830965172548864:192.168.202.16@tcp:104: 00010000:00010000:1.0:1746144913.506730:0:20722:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099a60000/0x4076af6727516588 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746144913.507533:0:8433:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013572d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8433:1830965172548352:192.168.202.16@tcp:104: 00010000:00010000:3.0:1746144913.507548:0:8433:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800916fbe00/0x4076af6727516581 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746144913.528820:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:2.0:1746144913.528895:0:3300:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:3.0:1746144913.528988:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175488256 00000100:00100000:3.0:1746144913.528997:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175488256 00010000:00010000:3.0:1746144913.529029:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727516064 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ea expref: 8 pid: 8430 timeout: 607 lvb_type: 0 00000100:00100000:3.0:1746144913.529052:0:7097:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175488384 00000100:00100000:3.0:1746144913.529055:0:7097:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175488384 00010000:00010000:3.0:1746144913.529066:0:7097:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b466200/0x4076af67275163cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9575d expref: 8 pid: 8432 timeout: 607 lvb_type: 0 00000100:00100000:3.0:1746144913.529095:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11303 00000100:00100000:3.0:1746144913.529101:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175488256:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144913.529113:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144913.529117:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727516064 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ea expref: 8 pid: 8430 timeout: 607 lvb_type: 0 00010000:00010000:3.0:1746144913.529127:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727516064 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ea expref: 8 pid: 8430 timeout: 607 lvb_type: 0 00010000:00010000:3.0:1746144913.529147:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009bb68e00/0x4076af6727516064 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ea expref: 8 pid: 8430 timeout: 607 lvb_type: 0 00010000:00010000:3.0:1746144913.529158:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144913.529196:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175488256:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 94us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144913.529202:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11303 00000100:00100000:3.0:1746144913.529215:0:7097:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11304 00000100:00100000:3.0:1746144913.529220:0:7097:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8801368e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+8:1985:x1830965175488384:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746144913.529227:0:7097:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746144913.529230:0:7097:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b466200/0x4076af67275163cf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9575d expref: 8 pid: 8432 timeout: 607 lvb_type: 0 00010000:00010000:3.0:1746144913.529238:0:7097:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b466200/0x4076af67275163cf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9575d expref: 8 pid: 8432 timeout: 607 lvb_type: 0 00010000:00010000:3.0:1746144913.529250:0:7097:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b466200/0x4076af67275163cf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af9575d expref: 8 pid: 8432 timeout: 607 lvb_type: 0 00010000:00010000:3.0:1746144913.529258:0:7097:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746144913.529272:0:7097:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8801368e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9d7af19e-38f7-44a8-82cf-031a58749c81+7:1985:x1830965175488384:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 52us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746144913.529277:0:7097:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11304 00000100:00100000:1.0:1746144913.539106:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:1.0:1746144913.539184:0:3299:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144913.543300:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175488512 00000100:00100000:0.0:1746144913.543311:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175488512 00010000:00010000:0.0:1746144913.543351:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516431 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af957e9 expref: 36 pid: 10401 timeout: 607 lvb_type: 1 00000100:00100000:0.0:1746144913.543375:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175488640 00000100:00100000:0.0:1746144913.543377:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175488640 00010000:00010000:0.0:1746144913.543389:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af672751609c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95606 expref: 10 pid: 8430 timeout: 607 lvb_type: 1 00000100:00100000:0.0:1746144913.543402:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11305 00000100:00100000:0.0:1746144913.543408:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+36:1985:x1830965175488512:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144913.543418:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144913.543423:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516431 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af957e9 expref: 36 pid: 10401 timeout: 607 lvb_type: 1 00010000:00010000:0.0:1746144913.543433:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516431 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af957e9 expref: 36 pid: 10401 timeout: 607 lvb_type: 1 00010000:00010000:0.0:1746144913.543450:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009b0d0000/0x4076af6727516431 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af957e9 expref: 36 pid: 10401 timeout: 607 lvb_type: 1 00010000:00010000:0.0:1746144913.543462:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144913.543464:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144913.543467:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099a60000/0x4076af6727516588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.543487:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099a60000/0x4076af6727516588 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.543505:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144913.543550:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+35:1985:x1830965175488512:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 141us (4449us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144913.543556:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11305 00000100:00100000:0.0:1746144913.543570:0:7098:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11306 00000100:00100000:0.0:1746144913.543575:0:7098:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800932ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+10:1984:x1830965175488640:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144913.543581:0:7098:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144913.543585:0:7098:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af672751609c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95606 expref: 10 pid: 8430 timeout: 607 lvb_type: 1 00010000:00010000:0.0:1746144913.543592:0:7098:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af672751609c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95606 expref: 10 pid: 8430 timeout: 607 lvb_type: 1 00010000:00010000:0.0:1746144913.543603:0:7098:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009422a000/0x4076af672751609c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af95606 expref: 10 pid: 8430 timeout: 607 lvb_type: 1 00010000:00010000:0.0:1746144913.543610:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144913.543612:0:7098:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144913.543614:0:7098:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800916fbe00/0x4076af6727516581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.543619:0:7098:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800916fbe00/0x4076af6727516581 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.543630:0:7098:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144913.543644:0:7098:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800932ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7454cbaf-97e3-4716-92c6-77cd48a94a90+9:1984:x1830965175488640:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 69us (4460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144913.543649:0:7098:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11306 00000100:00100000:0.0:1746144913.544416:0:3301:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.16@tcp (source: 12345-192.168.202.16@tcp) 00000100:00100000:0.0:1746144913.544570:0:7098:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830965175488768 00000100:00100000:0.0:1746144913.544574:0:7098:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830965175488768 00010000:00010000:0.0:1746144913.544586:0:7098:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009422ae00/0x4076af6727516095 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ff expref: 35 pid: 8430 timeout: 607 lvb_type: 1 00000100:00100000:0.0:1746144913.544603:0:8447:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.16@tcp, seq: 11307 00000100:00100000:0.0:1746144913.544608:0:8447:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800877f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+35:1983:x1830965175488768:12345-192.168.202.16@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746144913.544613:0:8447:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746144913.544617:0:8447:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009422ae00/0x4076af6727516095 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ff expref: 35 pid: 8430 timeout: 607 lvb_type: 1 00010000:00010000:0.0:1746144913.544628:0:8447:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009422ae00/0x4076af6727516095 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ff expref: 35 pid: 8430 timeout: 607 lvb_type: 1 00010000:00010000:0.0:1746144913.544638:0:8447:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009422ae00/0x4076af6727516095 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.202.16@tcp remote: 0x9b32c3fc7af955ff expref: 35 pid: 8430 timeout: 607 lvb_type: 1 00010000:00010000:0.0:1746144913.544645:0:8447:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144913.544647:0:8447:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746144913.544649:0:8447:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800943c1c00/0x4076af672751657a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.544655:0:8447:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800943c1c00/0x4076af672751657a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.544666:0:8447:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746144913.544681:0:8447:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800877f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7454cbaf-97e3-4716-92c6-77cd48a94a90+34:1983:x1830965175488768:12345-192.168.202.16@tcp:103:ldlm_bl.0 Request processed in 74us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746144913.544686:0:8447:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.16@tcp, seq: 11307 00010000:00010000:0.0:1746144913.544698:0:8430:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800943c1c00/0x4076af672751657a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.544704:0:8430:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800943c1c00/0x4076af672751657a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.544711:0:8430:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800943c1c00/0x4076af672751657a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.544721:0:8430:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800943c1c00/0x4076af672751657a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.544730:0:8430:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1746144913.545176:0:8430:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013572c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1830965172547968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48268us (48438us total) trans 4294968638 rc 0/0 00000100:00100000:0.0:1746144913.545181:0:8430:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5909 00010000:00010000:0.0:1746144913.545197:0:7101:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1746144913.545202:0:7101:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800943c1c00/0x4076af672751657a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.545208:0:7101:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800943c1c00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:0.0:1746144913.545211:0:7101:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800943c1c00/0x4076af672751657a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.545217:0:7101:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800943c1c00/0x4076af672751657a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.545225:0:7101:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800943c1c00/0x4076af672751657a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.545229:0:7101:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800943c1c00/0x4076af672751657a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8430 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746144913.545241:0:7101:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746144913.545242:0:7101:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746144913.545244:0:7101:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746144913.545269:0:3309:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b4edf80/2, rc 0, transno 4294968638 00000100:00100000:0.0:1746144913.545274:0:3309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b4edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172547968:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1746144913.545561:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746144913.545566:0:7109:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746144913.545576:0:8433:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800916fbe00/0x4076af6727516581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.545583:0:8433:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800916fbe00/0x4076af6727516581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.545589:0:8433:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800916fbe00/0x4076af6727516581 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.545595:0:8433:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800916fbe00/0x4076af6727516581 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.545606:0:8433:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1746144913.545981:0:8433:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013572ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1830965172547840:12345-0@lo:6:osp-syn-0-0.0 Request processed in 48861us (49152us total) trans 4294968108 rc 0/0 00000100:00100000:3.0:1746144913.545987:0:8433:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5910 00010000:00010000:3.0:1746144913.546000:0:8446:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1746144913.546005:0:8446:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800916fbe00/0x4076af6727516581 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.546011:0:8446:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800916fbe00 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:3.0:1746144913.546013:0:8446:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800916fbe00/0x4076af6727516581 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.546019:0:8446:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800916fbe00/0x4076af6727516581 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.546029:0:8446:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800916fbe00/0x4076af6727516581 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.546034:0:8446:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800916fbe00/0x4076af6727516581 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746144913.546046:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746144913.546048:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746144913.546049:0:8446:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746144913.546985:0:20722:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099a60000/0x4076af6727516588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144913.546993:0:20722:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099a60000/0x4076af6727516588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144913.546999:0:20722:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099a60000/0x4076af6727516588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144913.547006:0:20722:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099a60000/0x4076af6727516588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144913.547017:0:20722:0:(ldlm_lockd.c:2182:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1746144913.547351:0:20722:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098c23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3306:x1830965172548608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 48636us (48697us total) trans 4294968639 rc 0/0 00000100:00100000:1.0:1746144913.547357:0:20722:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5911 00010000:00010000:1.0:1746144913.547482:0:7100:0:(ldlm_lockd.c:2812:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1746144913.547487:0:7100:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099a60000/0x4076af6727516588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144913.547493:0:7100:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099a60000 already unused, calling callback (ffffffffa087bd70) 00010000:00010000:1.0:1746144913.547496:0:7100:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a60000/0x4076af6727516588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144913.547501:0:7100:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099a60000/0x4076af6727516588 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144913.547511:0:7100:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099a60000/0x4076af6727516588 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144913.547517:0:7100:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099a60000/0x4076af6727516588 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20722 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746144913.547529:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746144913.547530:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746144913.547531:0:7100:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1746144913.551269:0:3306:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009b4ee300/2, rc 0, transno 4294968639 00000100:00100000:0.0:1746144913.551278:0:3306:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009b4ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1830965172548608:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1746144913.551305:0:3309:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800877f1500/2, rc 0, transno 4294968108 00000100:00100000:0.0:1746144913.551313:0:3309:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800877f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1830965172547840:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1746144913.645969:0:7101:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 68791 lines, 68791 kept, 0 dropped, 0 bad.